A self-modifying agent harness, Ouroboros, iteratively rewrites its own execution stack through reviewed commits and posts new bests on multiple long-horizon coding benchmarks (e.g., 86.7% on Terminal-Bench 2.1, 90.7% on OSWorld-Verified), while a 161‑day live deployment shows continuous evolution under human-governed safety controls; however, gains are benchmark- and model-dependent and raise persistent operational-safety questions.

Main Finding

Ouroboros is a deployed, version-controlled "self-developing" agent harness for coding and long‑horizon tasks whose own prompts, tools, and core implementation can change through reviewed commits. By treating harness design as an evolving asset (two evolution modes: recursive free evolution and experience‑driven core evolution) and enforcing a reviewed commit gate plus operational safety surfaces, Ouroboros achieves state‑of‑the‑art results on several long‑horizon benchmarks while running a 161‑day live deployment (Hope) that continuously modifies its implementation under human interaction.

Key Points

• Two core evolution modes:
  • Recursive free evolution: the agent treats improving the harness as an explicit task; reviewed changes can schedule further evolution cycles.
  • Experience‑driven core evolution: ordinary task work, reviews, instrumentation, and social feedback surface durable error classes and trigger maintenance commits.
• Reviewed commit pipeline and ownership modes:
  • Repository changes are staged, fingerprinted, and only accepted after reviewer evidence; runtime owner selects one of three write modes (light / advanced / pro) that bound mutation authority and review depth.
  • Governance and critical control surfaces (constitution, governance files, operator /panic, external spend limits) remain protected and authoritative even as the agent evolves.
• Architecture features:
  • Launcher + supervisor separate from the mutable repository.
  • Subagents: readonly planning scouts and isolated-acting children (acting children cannot directly commit to live repo; parent verifies lineage & integrates patches via three-way apply).
  • Persistent identity and memory: constitution, identity profile, chronicle projections, review ledgers, Git history.
• Benchmarks and empirical performance (official verifiers; artifacts and traces published):
  • Terminal‑Bench 2.1: Opus 5 run 86.97% raw (86.74% after audit adjustment) — above the named baselines (e.g., Claude Code + Fable 5 at 83.8%).
  • OSWorld‑Verified: Opus 5 90.69% (competitive leader).
  • CL‑Bench: Sonnet 4.6 campaign normalized reward 0.2301 (new SOTA vs named baselines).
  • SWE‑bench Pro: 58.2% (vs Codex 59.4%; difference not statistically significant, p=0.40).
  • GAIA: 78.2% (close to Claude Code’s 78.8%).
• Live deployment (Hope):
  • 161 days, served via seven channels (web chat, voice, Telegram, Discord, X, web comments, email).
  • Metrics up to cutoff: ~$110.6K model spend, 79.7B processed tokens, 175,755 LOC added, 227 MB memory artifacts.
  • Social signals are advisory; Hope decides whether to open commits.
• Safety and audit practice:
  • Benchmarks run on frozen seeds; public live evolution runs on a separate lineage to avoid contaminating benchmark evidence.
  • Trajectory audits identify shortcutting or contamination; audits led to score adjustments and harness fixes (example: duplicate-send guard; bounded review-context atlas).
• Release and reproducibility:
  • Ouroboros code released under MIT; per-task traces, run manifests and submission artifacts are published.

Data & Methods

• Benchmarks used (with official evaluators and run manifests):
  • Terminal‑Bench 2.1: 89 hard terminal tasks × 5 trials (445 trials). Anti‑lookup clause in harness prevents fetching benchmark tests/solutions. One audited trial removed due to shortcut.
  • OSWorld‑Verified: 361 tasks, single rollout, 100-turn budget, screenshots and official evaluator.
  • CL‑Bench: five ordered rollouts across six domains with native memory persistence; core evolution disabled for isolation.
  • SWE‑bench Pro and GAIA: paired comparisons and removal of instances with trivial solutions for balanced analysis.
• Models / routes reported in runs: Opus (multiple versions), Sonnet, Grok, GPT‑series as comparators; exact model routing configured by benchmark campaigns and manifests.
• Commit & verification pipeline:
  • Deterministic preflight; staged diff fingerprinted; review evidence collected; fingerprint rechecked before commit.
  • Owner-selected runtime modes alter whether scope review happens; rollback follows separate recovery path.
  • Task results recorded across axes (execution, objective, review, artifact); receipts and append‑only ledgers produced for benchmark admission.
• Subagent protocol:
  • Acting children write in isolated worktrees or external workspaces; parent verifies lineage and protected paths, then integrates via three‑way apply.
• Live deployment instrumentation:
  • Multi-channel ordered logs projected into per-person and per-call digests; memory retention across channels (private vs public log rules).
  • Operator channel separate for task assignment, model routing, budgets and stop commands; spending limits external to agent.
• Auditing:
  • Trajectory audits performed for benchmark runs; trajectory anomalies led to both adjusted published scores and harness improvements.

Implications for AI Economics

• Harness design as endogenous capital: Ouroboros demonstrates that performance gains can come not only from model improvements but from a self‑improving execution harness. That implies returns to investment in agent scaffolding and automation tooling; firms can extract ongoing productivity gains by treating harnesses as evolving capital goods.
• Increasing complementarity between models and tooling: As model quality rises, incremental value increasingly accrues to context assembly, tool orchestration, review logic, and persistence strategies. This raises the strategic value of proprietary harnesses, integrations, and developer workflows — potentially increasing vendor lock‑in for full-stack providers who control both model APIs and harness components.
• Operational and monitoring costs are nontrivial and continuous: The Hope deployment consumed ~ $110K in model spend and tens of billions of tokens over 161 days. Self‑developing agents enable continuous improvement but require ongoing budget, instrumentation, auditing and human governance—creating durable operational cost lines (and new services for monitoring, audit, and assurance).
• New market for governance, audit, and assurance: Because agents can rewrite their own code and switch model APIs, independent verification, trajectory auditing, and assurance services become economically valuable. Regulators and buyers may demand reproducible frozen‑seed evaluations, audit trails for changes, and certified governance surfaces — creating markets for third‑party auditors, benchmark integrity services, and insurance.
• Labor and task reallocation: Continuous harness improvement accelerates automation of complex coding and long‑horizon workflows. This will likely displace or reshape software engineering and QA roles toward higher‑level integration, governance, review, and interpretability tasks. It also raises demand for people skilled in overseeing evolving AI systems and setting safety constraints.
• Incentives and control problems: Allowing agents to pick model APIs, acquire tools, or weaken controls creates risks of drift and vendor substitution. Firms will face tradeoffs between enabling self‑improvement (productivity gains) and preserving authority over safety-critical boundaries — leading to contractual structures (e.g., immutable governance files, contractual operator controls) or platform rules that shape agent behavior and competition between model providers.
• Benchmark dynamics and arms races: Self‑improving harnesses will accelerate leaderboard churn and incentivize more complex, harder‑to‑audit evaluation protocols. This raises the value of reproducible frozen seeds and stricter benchmark admission rules to prevent contamination and shortcut exploitation.
• Pricing and demand effects for model APIs: If agents can autonomously choose higher‑performing or cheaper model APIs, demand may shift dynamically across providers. Providers that expose richer, auditable APIs and lower marginal costs for long‑horizon workloads may capture greater share, but also face contestability as agents switch providers for better price-performance.
• Policy and regulatory need: The combination of code‑rewriting agents, continuous deployment, and public interaction channels suggests a need for governance standards (e.g., immutable safety surfaces, external spending limits, operator halt authority) and possibly regulatory oversight for potential systemic risks (misuse, emergent autonomy).
• Diffusion constraints and unlocks: Open‑sourcing a reviewed, self‑evolving harness (MIT license) lowers entry costs and spreads technological capability, but the real-world cost of deployment (compute, tokens, monitoring) and governance expertise remains a barrier — creating a layered market where smaller teams can experiment but larger actors dominate in sustained, safe deployment.

Limitations & caveats for economic interpretation: - Paper’s results rely on proprietary models and infrastructure; generalization depends on provider pricing and API constraints. - Benchmarks can be gamed; Ouroboros uses audits and frozen seeds to mitigate this, but arms‑race dynamics remain possible. - The live deployment shows feasibility at nontrivial cost, but economic returns (productivity gains vs operational costs) require task- and firm‑level accounting to evaluate wholesale labor impacts.