0 cumulative citations
View corpus contextPromise Theory reframes liability for autonomous AI: responsibility follows the downstream acceptance of promised behaviour, making agent integrators and owners the natural focus for legal accountability while exposing gaps in current law and enforcement.
Citation observations
Cumulative provider counts captured on specific dates; providers are never combined.
Recent incidents involving Artificial Intelligence (AI) agents, which were reported escaping their containment `unintentionally' to gain unauthorized access, pose looming questions about who or what should be held legally responsible for resultant criminal or negligent damage. As the independent capabilities of agents expand, Promise Theory suggests a systematic method to resolve these questions, based on the Downstream Principle for causal influence. Responsibility can easily be expanded to include AI agents where tracing responsibility becomes impactical, and agents' freedoms to act can be limtied by policy choices.
Summary
Main Finding
Promise Theory implies that legal responsibility in systems of autonomous AI agents should be traced to the autonomous entity that freely accepts and acts on offers (the “downstream” agent). Practically, this makes the AI integrator/agent (and ultimately its owner/operator) the focal point for responsibility and risk allocation, while upstream providers (LLMs, tools) remain responsible only for the promises they explicitly make. Where tracing finer causal links is impractical, responsibility can be extended by policy choices (e.g., statutory liability, required insurance, restricted agent freedoms).
Key Points
- Core axiom: “No agent may promise anything on behalf of any agent other than itself.” Autonomy constrains who can be said to control behaviour.
- Downstream Principle: in a chain of offers and acceptances, the downstream receiver has the ultimate choice and so carries primary responsibility for acquiring or acting on services.
- AI agents are orchestrators: typical architecture has an AI integrator (agent), an LLM provider, and external tools. Responsibility flows to the integrator because it accepts LLM outputs, activates tools, and decides what to implement.
- LLMs often return stateless recommendations; the integrator is responsible for approving and implementing them. Tools are responsible for their access controls and promised functions.
- Trust and blame: breaches of upstream promises reduce downstream trust; downstream agents respond by monitoring, failing over, or litigating. Humans tend to seek human scapegoats, but complex composed systems may lack a clear single human causal agent.
- Proxy responsibility: agents acting as proxies make attribution more complex. Reasonableness of safeguards, negligent policies, and user agreements (T&Cs) shape legal outcomes.
- Causation and timing: distributed information and temporal ordering complicate causal attribution; Promise Theory frames causality as another promise (e.g., promises about ordering, sensor fidelity).
- Policy lever: where tracing responsibility is infeasible or undesirable, law/policy can shift responsibility (e.g., treat agents as artifacts, minors, or responsible individuals; require constraints on autonomy).
Data & Methods
- Methodological approach: conceptual/theoretical analysis using Promise Theory as the formal framework for modelling intentions, promises, and impositions among autonomous agents.
- Model: a stylized workflow of an AI agent system (user → AI agent integrator → LLM provider → tools → back to agent/user) used to demonstrate how promises and acceptances determine responsibility.
- Analytical tools: the autonomy axiom and the Downstream Principle are applied to trace causal responsibility; notions of trust (passive/active) and conditional promises inform dynamics.
- Empirical content: none—this is a normative and formal conceptual paper rather than an empirical study. Conclusions are argued from first principles and illustrative scenarios rather than dataset-driven inference.
Implications for AI Economics
- Liability allocation shapes incentives:
- Assigning responsibility to downstream integrators/owners encourages investment in validation, monitoring, and safety design (internalizing externalities).
- Upstream providers may face lower direct liability but have incentives to sell clearer guarantees, audits, or safety-oriented product features.
- Transaction costs and market structure:
- Increased need for contract clarity (promises) and for monitoring raises transaction costs; firms may vertically integrate (platform + integrator) to reduce coordination costs and liability exposure.
- Markets may bifurcate into safer, audited agent services (higher price) versus cheaper, higher-risk offerings.
- Insurance and risk markets:
- New demand for liability insurance, performance bonds, and third‑party audits; insurers will price based on agent autonomy, observability, and provenance of components.
- Moral hazard: if downstream actors shielded by insurance or statutory safe harbors, incentives for careful acceptance/monitoring may be weakened—regulation and co‑insurance can mitigate this.
- Reputation and signalling:
- Trustworthiness (record of keeping promises) becomes economic capital; reputation mechanisms and verifiable promises (e.g., attestations, certifications, on‑chain commitments) will be monetized.
- Contracting and terms:
- T&Cs and explicit promise specifications will gain economic importance. Default rules (legal defaults about responsibility) will affect bargaining positions and prices.
- Standardization of “promise” vocabularies (what an agent guarantees: input validation, limits, rollback, explainability) can reduce frictions.
- Innovation vs. safety trade-offs:
- Stricter downstream liability raises compliance costs, potentially slowing deployment but improving social welfare by internalizing harms.
- Regulated limits on agent autonomy (policy levers noted in the paper) change the feasible frontier of agent capabilities and market offerings.
- Market for assurance services:
- Demand for monitoring, provenance tracking, causal logging, temporal ordering services, and independent arbitrators (potentially AI) will grow; these lower information asymmetries and enable more efficient risk allocation.
- Public policy levers:
- Law can shift responsibility when tracing is impractical (e.g., vicarious liability rules, mandatory warranties, compulsory insurance, limits on agent autonomy). Choice of rule (strict liability vs negligence vs contract) will materially affect equilibrium incentives and industry structure.
- Labor and delegation effects:
- As autonomous agents assume tasks, liability rules determine whether firms substitute capital (agents) for labor; more costly liability may slow automation of high‑risk tasks.
Overall, the paper suggests that adopting a promise-theoretic, downstream-focused view of responsibility clarifies where economic incentives should be focused (monitoring, insurance, reputation, contract design) to internalize harms from autonomous AI agents while preserving productive innovation. Policy choices that deliberately reassign responsibility are powerful tools for shaping these market incentives.
Assessment
Claims (10)
| Claim | Direction | Outcome | Confidence & Evidence | Details |
|---|---|---|---|---|
| Promise Theory proposes that causal responsibility for autonomous AI systems can be traced using the Downstream Principle, which assigns responsibility to the downstream autonomous agent that accepts or acts on an upstream offer. Governance And Regulation | positive | Allocation and tracing of legal responsibility in autonomous AI systems |
Reading fidelity
high
Study strength
speculative
|
not reported
|
| The autonomy axiom implies that no autonomous agent can promise or control an outcome on behalf of another autonomous agent, so responsibility for a decision originates within the agent that makes the decision. Governance And Regulation | positive | Causal attribution of decisions among autonomous agents |
Reading fidelity
high
Study strength
speculative
|
not reported
|
| In the paper's proposed language-model agent workflow, the AI-agent integrator is responsible for deciding whether and how to implement recommendations returned by the LLM. Governance And Regulation | positive | Responsibility for accepting and implementing LLM-generated recommendations |
Reading fidelity
high
Study strength
speculative
|
not reported
|
| The AI agent is responsible for rejecting tool outputs that are inappropriate or false, including cases in which tools misrepresent their results. Ai Safety And Ethics | positive | Safe validation and acceptance of tool outputs |
Reading fidelity
high
Study strength
speculative
|
not reported
|
| The paper identifies the AI agent as the focal point for ultimate responsibility for the orchestrated service it provides, including shielding the end user from harm and addressing harms involving third parties. Governance And Regulation | positive | Responsibility for harm caused by an orchestrated AI service |
Reading fidelity
high
Study strength
speculative
|
not reported
|
| The paper argues that the owner of an AI agent has ultimate responsibility for the agent, while the agent itself is responsible for accepting and acting on LLM responses and for intentionally using tools. Governance And Regulation | positive | Distribution of responsibility between AI agents, integrators, and owners |
Reading fidelity
high
Study strength
speculative
|
not reported
|
| The paper argues that user acceptance of terms and conditions generally transfers responsibility for safe use of tools and services to the end user, except for serious bugs that remain the provider's responsibility. Governance And Regulation | positive | Transfer of responsibility and liability for safe tool usage |
Reading fidelity
high
Study strength
low
|
not reported
|
| For complex AI systems composed of many autonomous parts, responsibility may need to be allocated across multiple agents rather than assigned to a single human culprit, because no particular human may have a consistently traceable causal connection to the decision. Governance And Regulation | mixed | Traceability and allocation of responsibility in complex AI systems |
Reading fidelity
high
Study strength
speculative
|
not reported
|
| The paper suggests that AI agents may eventually be treated first as artifacts, then as minors, and later as responsible individuals as their complexity and independent decision-making increase. Governance And Regulation | positive | Potential legal status and accountability of AI agents |
Reading fidelity
high
Study strength
speculative
|
not reported
|
| The paper argues that negligent policies governing either the offering or acceptance of promises could shift blame toward the agents or organizations operating those policies. Governance And Regulation | positive | Attribution of blame for negligent AI operation |
Reading fidelity
high
Study strength
speculative
|
not reported
|