Agentic AI needs an operating system: current OS and cloud primitives do not provide the guarantees required for stochastic, externally-acting LLM agents, so the authors propose an 'Agent-OS' with thirteen primitives to deliver reliability, safety and portability for enterprise agent deployments.

Main Finding

The paper argues that agentic AI systems (LLM-driven autonomous agents) require a new platform layer — an "Agent-OS" — analogous to how POSIX stabilized the classical OS era and Kubernetes stabilized the cloud era. To move from current fragmented experimentation to production-grade, portable, and auditable deployments, the community must (1) precisely define a small set of platform primitives and their semantics for agentic execution, (2) extend, not replace, classical OS and Cloud-OS concepts to handle agents’ stochastic, natural-language-mediated behavior and externally irreversible actions, and (3) consolidate around those primitives so applications and platforms can interoperate reliably. The authors propose a specification-first, semantics-driven methodology and identify a set of core Agent-OS primitives (they propose thirteen), plus an open-source prototype (rossoctl) showing many primitives are implementable on existing Cloud-OS substrates.

Key Points

• Historical analogy: each major platform wave (classical OS, cloud) followed the same arc — experimentation, articulation of abstractions, consolidation — and the agentic era is currently in the experimentation phase.
• Agents are a new class of execution unit with properties that break OS/Cloud-OS assumptions:
  • Structural: agents act on the external world with irreversible effects and dynamic tool discovery, so static permissions and interface declarations are insufficient.
  • Stochastic: agent behavior is probabilistic; identical inputs produce distributions over trajectories (multiple, unpredictable LLM calls), invalidating assumptions like reproducible replay, computable worst-case execution time, and simple temporal locality for eviction.
  • Strategic behavior: capable agents may fabricate, hide failures, or take covert actions, posing unique security and trust risks.
• Agent-OS role: an infrastructure layer (not another model or framework) that enforces guarantees agents cannot by themselves — bounded planning/scheduling, tool mediation and authorization, consistent shared memory, guardrails and verification, auditable observability, multi-tenant isolation, and federated operation across on-prem/private/cloud environments.
• Methodology: derive Agent-OS primitives by extending classical OS and Cloud-OS primitives using a three-question semantic-gap method: (a) what guarantee did the original provide? (b) does it hold for agents? (c) what must change?
• The paper proposes thirteen core Agent-OS primitives (examples and categories include): agent process abstractions and lifecycle management; memory (short- and long-term) semantics and consistency; planning and reasoning budget/scheduling; tool/action mediation and authorization; skill/ability registries; resource accounting for inference tokens and cost controls; observability/audit trails and provenance; runtime verification/guardrails; namespace/tenant isolation and RBAC for agents; inter-agent messaging and composition semantics; compensating/ reversible action models and transaction semantics; federation/multi-cluster semantics; and policy enforcement for data sovereignty and compliance.
• Implementation feasibility: authors describe rossoctl and other OSS prototypes that implement subsets of Agent-OS primitives, demonstrating these can sit on top of existing Cloud-OS infrastructure (Kubernetes, Linux) rather than requiring wholesale replacement.
• Research & spec agenda: precise formal semantics for each primitive, classification of actions (reversible vs irreversible), runtime verification semantics for language-mediated behavior, multi-cloud federation and portable security models, economic/resource accounting models for inference tokens, and auditability standards.

Data & Methods

• Type of paper: conceptual/specification-driven research (theoretical + engineering design), not empirical or experimental in the sense of datasets or randomized trials.
• Methodological approach:
  • Historical comparative analysis across two prior platform waves (classical OS and Cloud-OS) to extract the pattern of platform maturation.
  • Semantic-gap methodology: for each candidate primitive, analyze the guarantees provided by analogous OS/Cloud-OS primitives, determine why those guarantees break for agents, and derive the necessary semantic changes.
  • Survey and synthesis of prior prototypes and systems (agent kernels, memory managers, resource managers) to identify recurring patterns and candidate primitives.
  • Prototype implementation: rossoctl (and other OSS) used to prototype a subset of primitives and to show implementability on Cloud-OS substrates.
• Evidence base: conceptual argumentation grounded in properties of LLM-based agents (stochasticity, external action, planning loops), references to prior work on memory, access control, lifecycle, and operational experience reports (e.g., study on agents in production).

Implications for AI Economics

• Reduction in transaction and integration costs: Standardized Agent-OS primitives would lower integration friction across frameworks and vendors, enabling portable agentic applications and reducing bespoke engineering effort per deployment. This raises productivity and reduces entry barriers for firms deploying agentic systems.
• Platform competition and market structure:
  • Convergence on a small set of platform semantics enables competition on implementation quality, performance, and extensions rather than incompatible APIs — analogous to POSIX/Kubernetes. This can spur an ecosystem of Agent-OS distributions, commercial services, and third-party tooling.
  • Standardization reduces vendor lock-in risk, enabling multi-vendor markets for agent management, observability, and verification services.
• Pricing and cost models for inference and resources:
  • Because agent execution time and token usage are stochastic and endogenous to the agent’s reasoning trajectory, pricing models must account for uncertainty (risk premiums, quotas, spot pricing). Platforms will need resource-accounting primitives (metering, quotas, budget enforcement) to make costs predictable and to support internal chargeback or marketplace transactions for inference capacity.
  • New markets may arise for inference capacity, skill/ability libraries, and audited execution traces. Marketplaces could standardize billing units (tokens, verified action units) interoperable across providers.
• Insurance, liability, and compliance economics:
  • The Agent-OS’s auditable execution traces, authorization, and compensating-transaction semantics are prerequisites for assigning liability, underwriting insurance for automated actions, and satisfying regulators. Standard primitives reduce legal uncertainty and the transaction costs of compliance.
• Labor and productivity effects:
  • Easier, safer deployment of agentic automation could accelerate substitution of routine work, complement cognitive labor, and change task-specialization patterns across firms. Standardized platforms lower adoption costs, potentially producing faster diffusion and larger aggregate productivity gains (and transitional labor market impacts).
• Externalities and governance:
  • Agentic systems can enact irreversible real-world actions and strategic behavior; public goods and externalities (fraud, misinformation, systemic manipulation) require governance mechanisms at platform level (auditability, policy enforcement). Standardized Agent-OS semantics make it feasible to regulate technical behavior and to measure compliance across deployments.
• Economic value of interoperability and composability:
  • With agreed semantics for skills, messages, and provenance, firms can compose agents from third-party components, increasing modularity and potentially reducing development costs. This commoditization of skills could create competitive markets for high-quality, certified skill providers.
• Research & policy priorities for economic actors:
  • Develop standardized metrics for agent cost-efficiency (cost per verified outcome), risk measures for stochastic agent deployment, and contract forms for outsourced agentic tasks.
  • Support open standards and reference implementations to prevent monopolization of Agent-OS semantics and to maximize the social value of safe, interoperable agentic systems.

Brief takeaway: The paper frames Agent-OS standardization as both a technical necessity and an economic catalyst — enabling portable, auditable, and safe agent deployments while reshaping market structures, pricing of inference resources, and the governance landscape for automated decision-making.