Home-Slide, Interviews, UAE

Agentic AI demands stronger governance, human accountability, says MAST founder

Abhay Pandey, founder and CEO, MAST Consulting.

Abhay Pandey explains why enterprises must embed compliance, cybersecurity, transparency, and human oversight into agentic AI systems to balance automation with trust, control, and regulatory alignment.

Enterprises adopting agentic AI are entering a new phase of automation where AI systems are no longer limited to generating recommendations or content, but are increasingly capable of interacting with enterprise environments, triggering workflows, accessing systems, and making operational decisions autonomously.

This shift is creating fresh challenges around governance, cybersecurity, compliance, accountability, and risk management, particularly in environments handling sensitive enterprise, financial, customer, or government data. Organisations are now under growing pressure to ensure that AI systems operate within clearly defined legal, ethical, and operational boundaries while remaining transparent, explainable, and auditable.

Abhay Pandey, founder and CEO, MAST Consulting, shares insights into how businesses can securely deploy agentic AI while maintaining human oversight and organisational control. 

Pandey discusses the importance of governance frameworks, Zero Trust principles, international standards such as ISO/IEC 42001, and risk-based human approval models in helping enterprises balance automation with accountability and regulatory compliance.

Interview Excerpts

How can organisations ensure that agentic AI systems operate within defined compliance, legal, and ethical boundaries, especially when they are capable of making autonomous decisions?
Agentic AI should not enter the enterprise as an open-ended tool. It needs to be deployed within a defined operating model, where the system knows what it can do, what it cannot do, and when human approval is required. That means clear decision boundaries, approval hierarchies, access controls, audit trails, and risk thresholds before the first use case goes live.

Compliance, legal, cybersecurity, and business teams need to review use cases together, because the risk is rarely technical alone. Fairness, privacy, transparency, and accountability should be built into the design process rather than added later.

“Regular risk reviews, bias testing, monitoring, and alignment with standards such as ISO/IEC 42001 can help ensure AI remains useful without becoming uncontrolled.”

What are the key cybersecurity, data privacy, and governance risks associated with deploying agentic AI in enterprise environments, and how can businesses mitigate them effectively?
The important thing to remember is that agentic AI does not just produce content or recommendations. It can access systems, use data, call APIs, trigger workflows, and take actions across the enterprise. That changes the risk profile quite significantly. The main risks include data leakage, prompt injection, excessive access privileges, insecure integrations, biased outputs, and actions that may violate internal policy or regulation. A loosely defined AI agent flow can create operational risk very quickly, especially if it has access to sensitive systems.

Businesses should treat agentic AI as part of their security and governance architecture. Zero Trust principles, strict identity and access management, encrypted data handling, API security, continuous monitoring, and human approval for high-risk actions are essential. Regular testing, adversarial simulations, privacy impact assessments, and model validation should also become part of the deployment lifecycle.

In a typical workplace, which compliance-sensitive or security-critical tasks should never be fully delegated to agentic AI without human oversight?
Any decision with legal, financial, ethical, regulatory, or reputational consequences should not be fully delegated to AI. This still includes many things, even at this stage of AI adoption – regulatory approvals, employee termination, legal interpretation, financial authorisation, fraud investigations, disciplinary actions, medical recommendations, and the handling of highly sensitive customer or government data.

AI can still be useful in these areas. But the final decision should remain with qualified people who understand context, liability, and consequence.

“AI can support the process, but it should not own the judgment where the outcome is sensitive, irreversible, or legally significant.”

How should responsibilities and accountability be defined when an AI agent makes an incorrect, biased, or non-compliant decision?
Organisations should be very clear on one point, which is that accountability does not move from people to the AI system. Agentic AI is still an enterprise tool, even if it can act with a degree of autonomy. Responsibility sits with the organisation, the business owners, and the teams that approved and deployed the system. This is especially important when AI agents are operating across multiple systems or departments.

Every AI-driven action should be traceable through logs, decision records, approval workflows, and documented policies. There should also be a response process for AI failures, whether the issue is bias, inaccuracy, unauthorised action, or non-compliance. Vendor contracts can define certain obligations, but internal accountability cannot be outsourced.

From a regulatory and audit perspective, how important are transparency, explainability, and traceability in agentic AI systems operating within enterprises?
If an AI agent takes an action, the organisation must be able to explain what happened, what data was used, what control was in place, and who was responsible for the deployment. Regulators and auditors will increasingly expect organisations to demonstrate how AI decisions are made, what data was used, who approved deployments, and how risks are managed. Without traceability, organisations may struggle to investigate incidents, justify decisions, or prove compliance during audits. 

“Enterprises should maintain detailed logs, model documentation, decision histories, and governance records. Transparent AI operations will strengthen trust among customers, regulators, and stakeholders while supporting accountability and responsible use of autonomous systems.”

What role will international standards and frameworks such as ISO/IEC 42001, AI governance frameworks, and data protection regulations play in shaping responsible adoption of agentic AI?
Standards like the ISO/IEC 42001 help businesses define how AI should be governed, monitored, reviewed, and improved over time. Data protection laws such as GDPR and regional privacy regulations are equally important because agentic AI will often interact with personal, financial, operational, or customer data. 

Early alignment with recognised standards will help businesses build trust with customers, regulators, boards, and partners. Putting these systems in place early will be a competitive advantage at this point of the enterprise AI journey because it positions organisations to scale AI without constantly reacting to risk.

How can businesses balance automation and efficiency gains from agentic AI while still maintaining human judgment, accountability, and decision-making authority?
The right approach is a human-led, AI-assisted model. Agentic AI is well suited to repetitive analysis, data correlation, workflow orchestration, monitoring, reporting, and operational support. Human beings should continue to own strategic, ethical, financial, legal, and regulatory decisions.

One model that could help with this is risk classification – low-risk tasks can be automated with monitoring, medium-risk tasks may require review, and high-risk tasks should require explicit human approval. Right now, this is the surest way to gain speed and efficiency without losing control. Clear escalation paths, governance structures, access controls, and regular performance reviews are important.

“The goal should be to expand human capability, not remove human responsibility from decisions that require judgment.”

What could a real-world enterprise environment look like where agentic AI is securely integrated into operations while remaining compliant, auditable, and aligned with organisational policies?
In a mature enterprise environment, agentic AI operates within tightly governed boundaries integrated across business, cybersecurity, compliance, and IT operations. AI agents may assist with customer support, risk analysis, compliance monitoring, threat detection, workflow automation, and reporting, while all critical decisions require human approval. Every AI action is logged, monitored, and traceable through centralised governance dashboards. 

Access to sensitive systems is controlled through Zero Trust principles and role-based permissions. Policies, standards, and risk controls are embedded into AI workflows from the design stage itself. Regular audits, model reviews, and compliance assessments ensure the AI ecosystem remains secure, transparent, accountable, and aligned with organizational and regulatory expectations.

 

Previous Article

GET TAHAWULTECH.COM IN YOUR INBOX

The free newsletter covering the top industry headlines