By Dream Beyond Research

    Dream Beyond AI Software Assurance Series

    The Invisible Danger of AI Agents: Power Without Responsibility

    AI agent conversations tend to revolve around intelligence. But as AI agents move from answering questions to actually doing things inside businesses, another question becomes just as important: What is this agent authorized to do?

    AI agent governanceDream Beyond 5-Level Agent Authority Model

    Can the agent reason?

    Can it understand a complicated request?

    Can it use tools?

    Can it complete a multi-step workflow?

    Those are important questions.

    But as AI agents move from answering questions to actually doing things inside businesses, another question becomes just as important:

    What is this agent authorized to do?

    That distinction matters because intelligence and authority are different properties.

    A highly capable agent with read-only access may present limited operational risk.

    A less capable agent with permission to modify customer records, send emails, deploy code, approve transactions, or delete information may present substantially greater risk.

    The next phase of AI governance therefore needs to move beyond evaluating what an agent knows.

    Organizations also need to govern what an agent can do.

    Intelligence does not equate to authority.

    The architectural shift

    Traditional business applications usually operate through relatively explicit control paths.

    1. A user takes an action.
    2. The application checks permissions.
    3. Business rules determine whether the action is allowed.
    4. The system performs the operation.

    However, AI agents change this structure.

    An agent may receive a goal, reason about how to accomplish it, select tools, call APIs, interpret results, modify its plan, and continue executing.

    That means decision-making can move upstream from the application into the agent.

    The agent may increasingly decide which legitimate capability to use, when to use it, and in what sequence.

    Now this creates a new risk surface.

    The issue might not necessarily be that the agent has been compromised. It could be that it has been granted legitimate authority beyond what it needs, which can lead to unintended consequences.

    OWASP characterizes this category of issues as Excessive Agency. It recognizes excessive functionality, permissions, and autonomy as typical sources of detrimental agent conduct. OWASP explicitly advises restricting available tools, limiting permissions, implementing authorization outside the model, and obtaining human approval for significant actions.

    This is a subtle but important distinction.

    Security teams have spent decades asking: Who has access?

    Agentic systems require another question: What decisions can this non-human actor make with that access?

    A Simple Example

    Imagine an AI assistant whose job is to summarize a company's incoming customer emails.

    It needs access to the mailbox.

    There are several ways to implement that access.

    One implementation gives the agent permission to read messages.

    Another gives the agent permission to read, send, delete, move, and forward messages because those capabilities happen to exist in the email integration being used.

    Both implementations can summarize emails.

    But they have completely different authority profiles.

    If malicious content inside an incoming email manipulates the agent, the first implementation may produce a bad summary.

    The second implementation may be able to send information outside the organization, delete messages, or communicate with customers.

    OWASP illustrates excessive agency with a comparable scenario, emphasizing an architectural lesson.

    The safest agent has authority that is purposefully limited and enforced by the surrounding system.

    Authority Has Multiple Dimensions

    When evaluating an AI agent at Dream Beyond, authority is not regarded as a binary permission of yes or no.

    Authority has several dimensions.

    • An agent may have access to different systems.
    • It may have read access in one system and write access in another.
    • It may be able to recommend an action without executing it.
    • It may execute reversible actions automatically but require approval for irreversible ones.
    • It can oversee ten customer records, but it lacks the capacity to manage ten thousand.
    • It may be allowed to spend $10 but not $10,000.
    • It may perform an action once but not perform it repeatedly.
    • It may be permitted to create a draft but prohibited from publishing it.

    This means an agent's real authority is determined by the combination of its tools, permissions, autonomy, scope, and constraints.

    Current enterprise guidance is moving strongly in this direction.

    Microsoft recommends giving agents their own identities, applying least-privilege access, binding tool calls to explicit authorization, using narrowly scoped credentials, and requiring fresh human confirmation for irreversible or high-impact actions such as sending, deleting, purchasing, deploying, or changing permissions.

    Google's current guidance for agentic systems similarly distinguishes between human-approved execution and agent-only execution and recommends dedicated agent identities and least-privilege permissions.

    NIST's AI Risk Management Framework also treats human oversight as something that should be explicitly defined, assessed, and documented according to the system's context and organizational policies.

    The emerging pattern is clear.

    Agent governance increasingly looks like identity management, authorization, workflow control, and risk management combined.

    The Dream Beyond 5-Level Agent Authority Model

    To make this easier to reason about, Dream Beyond proposes a five-level model for describing agent authority.

    The goal is to assess how much an Agent can influence its environment and its level of intelligence.

    The objective is to:

    1

    Level 1: Observe

    The agent can access information but cannot change external state.

    Examples include reading documents, searching approved knowledge sources, examining logs, and analyzing records. This does not render the agent completely risk-free. The exposure of sensitive data and the potential for incorrect analysis remain concerns. But its operational authority is deliberately limited.

    2

    Level 2: Recommend

    The agent can analyze information and propose an action, but a human remains responsible for execution.

    It may draft an email, recommend a configuration change, propose a financial action, suggest a finding, or prepare a remediation plan. The boundary is important to ensure it does not do anything that goes out of control once executed. The agent can influence the decision, but it cannot complete the consequential action.

    3

    Level 3: Act With Approval

    The agent can prepare and execute actions, but defined consequential actions require explicit human approval.

    A human's role extends beyond simple supervision, as the workflow incorporates a definitive approval step before proceeding. This is particularly useful for actions involving financial transactions, customers, production settings, compliance findings, destructive operations, or external communication.

    4

    Level 4: Act Within Boundaries

    The agent operates autonomously inside a predefined authority envelope.

    The organization limits what systems it can access, what operations it can perform, what data it can use, how frequently it can act, what financial or operational thresholds apply, and which actions still require escalation. This is where architecture assumes a crucial role. The controls should be integrated into the surrounding system, with enforcement outside the agent's prompt.

    5

    Level 5: Delegated Autonomous Authority

    The agent has broad authority to pursue objectives and execute multi-step actions without routine human approval.

    This level may be appropriate for some tightly governed environments, but the risk changes significantly. Identity, authorization, monitoring, audit trails, recovery mechanisms, escalation, limits, and ownership become essential. Level 5 does not imply unlimited authority. Instead, it indicates that significant authority has been intentionally delegated and organized according to established protocols.

    Higher Intelligence Does Not Require Higher Authority

    One of the most important principles in this model is that capability and authority should not rise together automatically.

    A highly intelligent agent can remain Level 1.

    • A sophisticated coding agent can inspect a production system without having production deployment credentials.
    • A financial agent can identify suspicious transactions without having permission to move funds.
    • A security agent can recommend firewall changes without being allowed to apply them.
    • A customer-service agent can draft a refund without having authority to issue one.

    This is important because organizations can realize much of AI's benefits without needing to give it full autonomy right away.

    AI product design often considers autonomy a measure of progress, with increased autonomy viewed as a sign of advancement. However, from a governance perspective, this assumption can be dangerous.

    The authority level must be established based on business risk, reversibility, accountability, and the potential consequences of failure. Model capability is one input to that decision.

    Microsoft's current responsible AI guidance also makes a similar distinction, recommending human approval when agent actions are difficult to reverse or could impact people, finances, or compliance.

    Prompts Are Not Permission Systems

    This may be the most important technical distinction.

    Never delete customer data unless specifically authorized.

    is useful behavioral guidance. However, it is not an authorization control.

    If the agent possesses a credential that allows customer data to be deleted, the underlying system may still accept the operation.

    A stronger architecture looks different.

    • The agent's identity does not have a delete permission.
    • Or the delete operation passes through an authorization service.
    • Or a policy engine evaluates the request.
    • Or the action enters an approval workflow.
    • Or the tool itself does not expose destructive functionality.

    In other words:

    Do not ask the model to enforce a boundary that the software architecture can enforce deterministically.

    OWASP advises implementing authorization within downstream systems and keeping the LLM outside the permission decision.

    This principle will become increasingly important as agents gain access to enterprise systems.

    Authority Must Also Be Observable

    Preventing an action is only part of governance.

    Organizations also need to know what happened.

    • Which agent acted?
    • Which user or process initiated the request?
    • Which tools did the agent call?
    • Which systems were affected?
    • What approval occurred?
    • What data influenced the decision?
    • What was the result?
    • Can the action be reversed?
    • Who owns the agent?

    Microsoft's newer agent governance guidance emphasizes dedicated agent identities and audit trails that connect agent interactions, tool usage, and outcomes.

    This is the reason why the identity of agents holds significance. When twenty agents utilize a single generic service account, accountability diminishes.

    If each agent has a defined identity, permissions, ownership, and activity history, governance becomes much more practical.

    The Executive Question

    This issue should not remain inside engineering teams.

    A CEO, CIO, CTO, CISO, or board member responsible for an agentic AI initiative should be able to ask:

    What authority have we actually delegated to this agent?

    The answer should be more precise than: It has access to Salesforce. Or: It can use our internal APIs.

    A mature answer should describe the authority envelope.

    What can it read?
    What can it change?
    What can it communicate externally?
    What can it purchase?
    What can it approve?
    What can it delete?
    What requires human authorization?
    What thresholds exist?
    How is the agent identified?
    How are actions audited?
    How quickly can its authority be revoked?

    These questions translate AI governance from an abstract policy discussion into something architects, security teams, executives, and auditors can inspect.

    How We Are Applying This at Dream Beyond

    We are applying this principle while building our own AI-enabled assessment workflows.

    Our AI Risk Analyst can review assessment information, draft an executive summary, suggest findings, and identify evidence gaps.

    But an AI-generated suggestion does not automatically become an official finding.

    A human reviewer carefully evaluates the recommendation and clearly formulates the conclusion, making sure to articulate this distinction explicitly. The agent's role is to assist in the assessment process. It does not have the authority to declare the organization's risk posture independently or without discussion.

    This may appear slower than letting the agent create everything automatically.

    We consider that friction useful.

    Good governance sometimes means deliberately preventing an AI system from doing something it is technically capable of doing.

    As confidence, evidence, controls, and use cases mature, specific authority can be expanded. However, the expansion should be intentional.

    Start With an Authority Inventory

    Before deploying an enterprise agent, organizations should know more than what model powers it.

    They should know what authority surrounds it.

    A useful assessment starts by examining five things:

    Tools
    What capabilities can the agent invoke?
    Permissions
    What can those tools actually do in downstream systems?
    Autonomy
    Which operations happen without human approval?
    Scope
    Which users, records, environments, accounts, and resources are reachable?
    Controls
    What limits, approvals, policies, logs, alerts, recovery mechanisms, and kill switches exist?

    Together, these define the agent's practical authority.

    An agent cannot misuse a tool it does not possess.

    It cannot delete data with an identity that has no delete permission.

    It cannot silently complete a high-impact transaction if the surrounding workflow requires independent approval.

    This is why authority architecture matters.

    The Question Is Changing

    The first wave of enterprise AI focused on whether AI could produce useful answers.

    The next wave is increasingly about whether AI can take useful actions.

    That transition changes the governance problem.

    When software begins to reason about which actions to take, permission design, human oversight, agent identity, auditability, and authorization architecture become part of AI safety.

    The question is no longer only:

    Can this agent do the job?

    We also need to ask:

    What happens if it does the wrong job perfectly?

    And then:

    What authority did we give it to make that mistake matter?

    That is the question organizations should answer before autonomy becomes infrastructure.

    Dream Beyond 5-Level Agent Authority Model

    Assess Your AI Agent Authority Level

    Dream Beyond is developing an AI Agent Authority Assessment based on the five-level model above.

    The assessment is designed to help organizations identify:

    • the authority currently delegated to an AI agent
    • excessive tools or permissions
    • missing human approval boundaries
    • high-impact autonomous actions
    • identity and auditability gaps
    • areas where authority should be reduced, isolated, or governed

    The goal is not to eliminate agent autonomy.

    The goal is to make autonomy intentional, bounded, observable, and accountable.

    Dream Beyond

    Building software organizations can trust.