The Commonplace
Home Papers Evidence Explore Trends Syntheses Digests References Docs 🎲 Workforce Futures
← Papers
Direction, evidence grade, and study type are AI-generated labels (gpt-5-mini), not human-verified. Syntheses are LLM-written. "Tensions" are machine-detected candidates, not confirmed contradictions. A research-acceleration tool, not peer review. How this is built →

AOS proposes separating semantic control from runtime coordination so agentic systems can be governed and audited across vendors and regions. The two-plane reference architecture sets invariants, interfaces, and capability-centred abstractions but remains unvalidated by implementation-scale evidence.

The Agent Operating System (AOS): A Reference Operating Architecture for Distributed Agentic Systems
Ankur Sharma, Deep Shah · August 04, 2026
arxiv descriptive n/a evidence 7/10 relevance Full text usable extracted full text Source PDF

Structured author observations

Linked only from stored provider relations; the raw author line above is never matched by name.

Arxiv

Latest observation:

  1. Ankur Sharma unresolved corpus identity
  2. Deep Shah unresolved corpus identity

Semantic Scholar

Latest observation:

  1. Ankur S. Sharma provider ID
  2. Deep Shah provider ID
The paper proposes AOS, a vendor-neutral two-plane reference operating architecture (Control & Governance Plane and Runtime & Coordination Plane) to make distributed agentic systems governable, observable, and interoperable while preserving heterogeneous runtimes and infrastructure.

Citation observations

Cumulative provider counts captured on specific dates; providers are never combined.

Large language models have transformed artificial intelligence from isolated prediction services into components of long-running, distributed systems that reason, invoke tools, retrieve external state, delegate tasks, and act on behalf of users and organizations. The surrounding ecosystem has responded with agent frameworks, workflow engines, model-serving platforms, memory systems, communication protocols, and observability tools. These technologies improve execution, but they do not provide a stable, implementation-independent operating architecture for governing intent, selecting capabilities, preserving authority across delegation, controlling uncertainty, coordinating runtime behavior, and reconstructing why consequential actions occurred. This paper proposes the Agent Operating System (AOS), a vendor-neutral reference operating architecture for distributed agentic systems. AOS contains two internal planes: a Control & Governance Plane responsible for intent, policy, trust, authority, confidence, auditability, observability, and human oversight; and a Runtime & Coordination Plane responsible for agent lifecycle, workflow coordination, model and tool routing, context and memory coordination, scheduling, traffic management, and runtime assurance. Platform services, Linux or Windows, container runtimes, and physical infrastructure remain outside the AOS boundary and are integrated through explicit interfaces. The paper specifies AOS concepts, invariants, interface objects, optimization objectives, deployment profiles, and reliability responsibilities. It also identifies tradeoffs and unresolved research questions. AOS is not presented as a replacement for existing frameworks or infrastructure; it is proposed as the operating architecture through which heterogeneous components can be composed into governable, reliable, observable, and interoperable agentic systems.

Summary

Main Finding

AOS-0001 proposes the Agent Operating System (AOS), a vendor‑neutral, implementation‑independent reference operating architecture for distributed agentic AI systems. Its central design is a logical two‑plane separation: (1) a Control & Governance Plane that manages intent, authority, policy, trust, confidence, and auditability, and (2) a Runtime & Coordination Plane that manages agent lifecycle, workflow coordination, routing to models/tools, context/memory, scheduling, and runtime assurance. The architecture foregrounds capability‑centric abstraction, authority‑preserving delegation, evidence‑backed confidence as an operational control signal, and semantic observability to make agentic systems governable, reliable, and interoperable while remaining compatible with existing OS, platform, and infrastructure services.

Key Points

  • Two‑plane architecture
    • Control & Governance Plane: normalizes intent, enforces policy/trust, evaluates delegation and confidence, issues directives and audit obligations.
    • Runtime & Coordination Plane: binds approved capabilities to providers, executes workflows, routes model/tool calls, and implements runtime assurance.
  • Capability‑centric abstraction: requests reference stable capability names (e.g., ai.case.summary.generate) rather than concrete models/vendors; multiple providers may satisfy a capability.
  • Authority‑preserving delegation: delegation is modeled as a bounded transfer of authority with explicit parent lineage, scope, expiry, obligations, and revocation semantics to preserve accountability across heterogeneous providers and execution hops.
  • Confidence as a control signal: confidence is elevated from metric to actionable state (proceed / warning / retry / fallback / escalate / terminate) and must be evidence‑backed (combining model calibration, provenance, freshness, validation, provider trust, etc.).
  • Semantic observability and provenance: logs/traces/metrics augmented with intent, capability, policy, trust, confidence, context provenance, and delegation chains to permit reconstruction of causal chains and enforcement decisions.
  • Compatibility with existing infrastructure: AOS defines interfaces and invariants but uses existing OS/kernel mechanisms (cgroups, seccomp, namespaces) and platform services as enforcement substrates and external dependencies.
  • Deployment models: supports embedded, centralized, regional, federated, edge, and sovereign deployments while preserving local authority and enabling interoperability.
  • Conformance and extension: defines canonical objects, service‑provider interfaces, protocol bindings, and conformance profiles to permit multiple implementations (e.g., aos-core as a reference).
  • Mathematical/formal components: the paper provides formalizations for feasibility constraints, provider ranking, confidence aggregation, authority monotonicity, placement/latency/cost/energy/risk objectives.
  • Scope and non‑goals: architectural proposal only—no universal API, programming language, or mandatory vendor choices; not an empirical benchmark paper.

Data & Methods

  • Nature of the work: conceptual architecture and systems research preprint (draft v0.8). No experimental dataset or empirical benchmarks reported.
  • Methods employed:
    • Systems and literature synthesis across OS design, distributed systems, cloud orchestration, agent frameworks, observability, security, and AI governance.
    • Architectural specification: definition of boundary, plane responsibilities, canonical data objects, interface contracts, invariants, and deployment profiles.
    • Formal/analytical modeling: mathematical objectives and constraints for provider feasibility, ranking, confidence aggregation, authority monotonicity, and placement/latency/cost tradeoffs.
    • Design artifacts promised in appendices and follow‑on specs: canonical data objects, reference sequences, state machines, threat model, conformance profiles, and glossary.
    • Reference implementation strategy: aos-core is cited as an evolving reference implementation validating selected concepts (but not normative).
  • Limitations / methodological caveats:
    • No empirical evaluation or performance benchmarks are presented.
    • Later specifications (AOS‑0002 … AOS‑0010) and aos-core are intended to refine protocol/implementation details, confidence aggregation rules, and empirical validation.
    • Normative language is constrained to architectural invariants; protocol and wire behavior are deferred to subsequent documents.

Implications for AI Economics

  • Market structure and competition
    • Capability abstraction lowers vendor lock‑in by allowing multiple providers to satisfy the same capability, enabling easier switching and comparison on latency, cost, reliability, and trust metrics. This could increase competition and reduce monopoly rents for model vendors.
    • Conformance profiles and canonical interfaces create common layers where third‑party capability providers, policy engines, and assurance tools can compete, potentially fostering modular markets and network effects around standards.
  • Pricing and monetization
    • Capability as a billing/unit concept supports clearer productization and pricing models (per-capability, per-confidence tier, failover/fallback premiums). Providers may price not just compute but assurance, explainability, and confidence guarantees.
    • Confidence as an operational control signal enables pay‑for‑quality offerings (e.g., higher cost for providers with better calibrated confidence and verification mechanisms).
  • Transaction costs, auditing, and compliance
    • Semantic observability and preserved delegation lineage reduce ex post investigation and compliance costs by making causal chains reconstructible, potentially lowering audit overhead and regulatory friction.
    • Explicit governance semantics and conformance profiles can reduce negotiation and integration costs between organizations (faster onboarding, clearer liabilities).
  • Risk allocation and liability
    • Authority‑preserving delegation and explicit obligation metadata make contractual responsibility and audit trails clearer, affecting how liability is assigned across vendors, integrators, and customers. This could reduce legal uncertainty but may also shift costs into compliance management and tooling.
    • Standardized confidence/assurance signals may be used in insurance underwriting and risk pricing for AI‑driven services.
  • Deployment, jurisdiction, and data‑locality economics
    • Built‑in deployment profiles supporting sovereign, regional, and federated modes acknowledge regulatory/data‑locality constraints, enabling more economically feasible cross‑border deployments while preserving local control—reducing the cost of regulatory compliance for multinational deployments.
    • However, enforcing such locality and provenance constraints may raise operational costs (replicated data, regional capacity reserves).
  • Operational efficiency and resource allocation
    • The architecture’s emphasis on provider ranking (including latency, cost, energy) and runtime routing allows dynamic cost/latency/energy optimization, potentially reducing average cost-per-task through more efficient provider selection and fallback strategies.
    • Instrumentation and semantic metadata will impose overhead (compute, storage, developer effort). The net economic effect depends on whether reduced incident/restart/compliance costs exceed instrumentation and coordination costs.
  • Labor and organizational impacts
    • Human oversight and escalation semantics imply ongoing human‑in‑the‑loop roles (approval, remediation, auditing), affecting staffing models and possibly increasing demand for governance engineers, auditors, and assurance specialists.
    • Clearer auditability may enable safer delegation of tasks to agents, changing labor allocation (automation of routine tasks vs. higher‑value oversight).
  • Standardization externalities and potential centralization
    • If an industry group or dominant vendor leads the de facto AOS implementation, early standard adoption could create winner‑take‑most effects despite the architecture’s vendor‑neutral intent; careful governance of standards bodies will matter economically.
  • Research and measurement needs (economic research agenda)
    • Empirical calibration of confidence aggregation: how different confidence designs change provider selection, error rates, and economic outcomes.
    • Cost–benefit studies of semantic observability vs. instrumentation overhead.
    • Market experiments on capability pricing, insurance products tied to confidence/assurance guarantees, and protocol adoption incentives.

Overall, AOS‑0001 outlines an architectural foundation that could materially lower transaction and compliance costs, enable richer market competition around modular capabilities and assurance services, and reshape risk allocation—while introducing implementation and operational overheads whose net economic effects require empirical study.

Assessment

Paper Typedescriptive Evidence Strengthn/a — The manuscript is a conceptual reference architecture and specification proposal without empirical or causal analysis; no data or causal identification methods are used. Methods Rigormedium — The paper systematically defines objects, invariants, interfaces, deployment profiles and a mathematical formulation, and situates the proposal in prior systems work, which shows rigorous architectural reasoning; however, it lacks empirical validation, benchmarks, implementation evaluation, and stress testing to demonstrate practicality or performance. SampleNo empirical sample or dataset — the work is a design/specification using conceptual examples, mappings to existing tools (e.g., Linux cgroups, seccomp), references to related standards/proposals, and a reference implementation effort (aos-core) but contains no measured data. Themesorg_design governance GeneralizabilityNo empirical validation — applicability to production environments, scale, and heterogeneous deployments is untested., Assumes availability and integration of existing platform services, OS enforcement mechanisms, and identity/policy infrastructure; environments lacking these primitives may not support AOS guarantees., Performance, latency, cost, and reliability trade-offs are specified conceptually but not measured; real-world constraints could limit feasibility., Legal, regulatory, and organizational differences (data residency, sovereignty, contractual constraints) may constrain deployment modalities beyond the paper's profiles., Vendor-neutrality may be hard to realize in ecosystems dominated by one or two cloud/model providers, limiting interoperability in practice.

Claims (9)

ClaimDirectionOutcomeConfidence & EvidenceDetails
AOS proposes a vendor-neutral reference operating architecture for distributed agentic systems consisting of two internal planes: a Control & Governance Plane and a Runtime & Coordination Plane. Governance And Regulation positive Architectural separation of governance and execution responsibilities
Reading fidelity high
Study strength speculative
not reported
0.03
The Control & Governance Plane is intended to manage intent, policy, trust, authority, confidence, auditability, observability, and human oversight, while the Runtime & Coordination Plane manages lifecycle, workflow coordination, routing, memory, scheduling, traffic management, and runtime assurance. Organizational Efficiency positive Organizational allocation of control and runtime functions
Reading fidelity high
Study strength speculative
not reported
0.03
AOS uses a capability-centric abstraction in which consumers request stable capabilities rather than binding directly to a particular model, agent, or vendor. Task Allocation positive Interoperable task allocation across alternative providers
Reading fidelity high
Study strength speculative
not reported
0.03
Before ranking feasible providers, the AOS control plane rejects providers that violate hard constraints such as authorization, data residency, protocol compatibility, or minimum trust. Governance And Regulation positive Policy-constrained provider selection
Reading fidelity high
Study strength speculative
not reported
0.03
AOS models delegation as a bounded transfer of authority: delegated scope must not exceed the parent scope, and delegation lineage must remain observable. Ai Safety And Ethics positive Authority preservation and traceability across delegation
Reading fidelity high
Study strength speculative
not reported
0.03
AOS treats confidence as an operational control signal rather than merely a dashboard value, allowing confidence assessments to trigger proceeding, warning, retry, fallback, escalation, or termination. Ai Safety And Ethics positive Runtime assurance and control actions under uncertainty
Reading fidelity high
Study strength speculative
not reported
0.03
AOS augments conventional telemetry with semantic information including intent, capability, policy, trust, confidence, context, delegation, and causal relationships. Governance And Regulation positive Reconstruction of causal and authority relationships behind agent actions
Reading fidelity high
Study strength speculative
not reported
0.03
AOS is designed to support embedded, centralized, regional, federated, edge, and sovereign deployment models while preserving explicit state ownership and traceable interfaces between decisions and actions. Organizational Efficiency positive Distributed interoperability and governance across deployment topologies
Reading fidelity high
Study strength speculative
not reported
0.03
The paper does not claim benchmark superiority, universal completeness, or empirical product performance; its quantitative examples are illustrative rather than empirical results. Other null_result Empirical performance or benchmark superiority
Reading fidelity high
Study strength high
not reported
0.3

Notes