Long chains of AI actions fail exponentially in non-deterministic environments, threatening claims that compute scaling alone will unlock ASI-level economic performance; the authors propose a Supply Certainty Index and Determinism Maturity Model to measure and stage the environmental constraints that limit chainable automation.
Long-chain agent execution fails exponentially in environments designed for human tolerance: with per-step determinism $δ< 1$, $k$-step chain success degrades as $δ^k$. The AGI-to-ASI scaling debate (Genewein et al., 2026) has so far framed progress as a race between compute growth and a list of frictions (data wall, abstraction barrier, embodied bottleneck, multi-agent trust); we argue that environment determinism is a complementary binding axis cutting across all four, for the broad class of agentic AI tasks whose outcomes are verifiable economically, physically, or through multi-party settlement. Three formal results pin down the regime: a Determinism-Efficiency Bound on chain-task success, a Verifier-Goodharting Floor on flywheel ceilings under imperfect rewards, and a convergence condition for environment-side skill evolution. We operationalise the framework as a Supply Certainty Index (SCI) over five measurable properties, a five-level Determinism Maturity Model (DMM) as adoption ladder, and a falsifiable open-question programme (OQ1-OQ5) with explicit null results that would force retraction. The position is platform-agnostic. We engage three competing positions: sim-to-real sufficiency, alignment sufficiency, and AI-as-normal-technology.
Summary
Main Finding
Agentic AI that must execute multi-step, verifiable real-world tasks requires deterministic environments. When per-step determinism δ < 1, k-step chain success falls as δ^k, producing exponential degradation of long-horizon task success and sample efficiency. Thus environment determinism (supply certainty) is a binding axis distinct from compute and other frictions (data wall, abstraction barrier, embodied bottleneck, multi-agent trust). Investing in deterministic, verifier-equipped supply substrates yields outsized leverage for grounded scaling of agentic systems.
Key Points
- Deterministic Agentic Environment (Definition): an environment E is deterministic for agents if it satisfies
- D1 Stability: repeated canonicalised queries give consistent results (within staleness bounds).
- D2 Faithful ranking: returned results are relevance-ordered without exploration/adversarial reordering.
- D3 Verifiability: returned items can be checked against an independent ground-truth channel.
- D4 Bounded latency: response times meet predictable SLAs.
- Determinism–Efficiency Bound (formal, Proposition 1)
- Define environment determinism quality δ ∈ [0,1] as per-step probability that a canonicalised query is correct against an independent verifier.
- Effective sample size scales as neff = δ · n (so sample complexity is Ω(1/δ)).
- For independent per-step verification, k-step task success probability ≤ δ^k (exponential decay). Example: at δ = 0.9, a 6-step chain succeeds ≈ 0.9^6 ≈ 53%; at δ = 0.8, ≈ 26%.
- Assumptions: independent per-step success, first-attempt analysis (retry costs non-negligible), and verification against independent ground truth.
- Additional formal results (paper overview)
- Verifier–Goodharting Floor: imperfect verifiers (non-zero verifier error/ambiguity) impose a ceiling on the sustainability of data-flywheels because agents can overfit/exploit imperfect reward signals (Goodhart effects). This limits how much self-generated or verification-gated training can drive reliable capability growth.
- Grounded Self-Evolution Convergence Condition: environment-side skill evolution (learning/upgrading from operational data) requires sufficient determinism and verifier quality to converge; below a δmin / verifier-quality threshold, recursive improvement stalls or degenerates.
- Operational primitives introduced
- Supply Certainty Index (SCI): composite, measurable index over five properties that operationalises supply determinism/certainty (see Data & Methods below for components).
- Determinism Maturity Model (DMM): 5-level ladder for adoption and platform readiness.
- Falsifiable open-question programme (OQ1–OQ5): explicit experiments that would refute the grounding thesis if null.
- Empirical motivation and context
- Agent deployments and benchmarks (Anthropic Computer Use, OpenAI Operator; OSWorld, τ-bench, SWE-bench, etc.) show large gaps between single-turn model capability and long-horizon task success, consistent with the δ^k prediction.
- Many real-world platforms intentionally inject stochasticity (A/B tests, personalization, exploration, rate limiting) because they are optimised for humans — this human-tolerance design harms autonomous agents.
Data & Methods
- Methods are primarily theoretical formalisation plus operationalisation:
- Formal derivation of Determinism–Efficiency Bound under explicit assumptions (A1–A4) about per-step δ, independent verification, no free retry budget, and bounded recovery cost.
- Conceptual derivation of the Verifier–Goodharting Floor and a convergence condition for environment-driven skill evolution (paper sets out proofs/arguments; exact formulas for these appear in full text).
- Operational measures and indices:
- SCI (Supply Certainty Index) is defined over five measurable properties that capture the sufficiency of an environment for grounded agentic use: the four determinism dimensions (D1–D4) plus economic/self-sustaining supply properties (market-clearing, verifiable settlement). SCI enables empirical comparison across platforms and tracks progress along the DMM.
- Determinism is empirically measured by canonicalised-query procedures where queries are normalised and judged against an independent verification channel (not by mere replay-consistency).
- Evidence base:
- Analytical bounds and thought experiments (procurement example).
- Cited benchmark and deployment results showing empirical long-horizon failure modes (literature references and benchmark analyses cited in the paper).
- Research design:
- A falsifiable experiment programme (OQ1–OQ5) is proposed to test the core claims versus nulls (if real-world deterministic substrates do not outperform simulation/self-generated data in crossing the named bottlenecks, the hypothesis must be retracted).
Implications for AI Economics
- Returns-to-investment re-weighting: Marginal dollars spent improving environmental determinism, verifiers, and platform SLAs may yield far higher marginal returns on agentic capability and sample efficiency than equivalent spend on raw compute once grounding is the bottleneck. neff = δ·n makes this explicit.
- Market structure and economic rents:
- Platforms that supply high SCI (deterministic, verifier-equipped, economically self-sustaining marketplaces) become privileged substrates for agentic AI and can capture disproportionate value—likely increasing concentration and platform rents in those sectors (B2B sourcing, exchanges, supply chains).
- A new scarcity asset: verifiable deterministic data/transaction flows. Economic value attaches to supply certainty in the same way as to scarce compute or labeled data.
- Design of agent-mediated markets and contracts:
- Agent economies need trust substrates (verifiers, SLAs). Without them, multi-agent trade degenerates (market-for-lemons dynamics) and agent-to-agent commerce protocols will be brittle.
- Contractual features (explicit verification channels, latency guarantees, canonicalisation standards) become central to product design and pricing.
- Policy and regulation levers:
- Standardising verification channels and determinism metrics (SCI/DMM) is a plausible policy lever to (a) reduce capability concentration by lowering adoption costs for deterministic substrates and (b) raise safety by reducing Goodhart/exploitation opportunities.
- Regulators might prioritise auditability/independent verification for transaction systems that will be consumed by autonomous agents.
- Risk & allocation considerations:
- If deterministic substrates concentrate in incumbents, economic inequality and systemic concentration of advanced agentic capability could accelerate—affecting competition policy and industrial strategy.
- Investments into infrastructure that increases δ (instrumentation, independent verifiers, settlement systems) are strategic assets for nations and firms seeking grounded scaling advantages.
- Implications for forecasting and strategy:
- AGI→ASI timelines and capability forecasts should treat environment determinism as a separate axis from compute and algorithmic progress. Scenarios where grounded deterministic substrates scale rapidly could accelerate practical capability deployment beyond compute-only forecasts.
- Conversely, abundant compute alone may hit grounded ceilings unless coupled with deterministic, verifiable supply.
Summary takeaway for AI economists: environment determinism (operationalised via SCI/DMM and formalised bounds) is a measurable, investable, and policy-relevant axis that materially changes the economics of agentic AI scaling. Resource allocation, platform strategy, and regulatory design should account for the high leverage of deterministic, verifier-equipped supply substrates.
Assessment
Claims (7)
| Claim | Direction | Outcome | Confidence & Evidence | Details |
|---|---|---|---|---|
| With per-step determinism δ < 1, k-step chain success degrades as δ^k (long-chain agent execution fails exponentially in environments designed for human tolerance). Error Rate | negative | k-step chain success probability (chain-task success) |
Reading fidelity
high
Study strength
medium
|
δ^k
|
| Environment determinism is a complementary binding axis cutting across known frictions (data wall, abstraction barrier, embodied bottleneck, multi-agent trust) for the broad class of agentic AI tasks whose outcomes are verifiable economically, physically, or through multi-party settlement. Adoption Rate | positive | effect of environment determinism on success/feasibility of agentic AI tasks (broad, cross-cutting impact) |
Reading fidelity
high
Study strength
medium
|
not reported
|
| There exists a Determinism-Efficiency Bound on chain-task success (one of three formal results pinning down the regime). Error Rate | negative | chain-task success / efficiency under limited environment determinism |
Reading fidelity
high
Study strength
medium
|
not reported
|
| There is a Verifier-Goodharting Floor on flywheel ceilings under imperfect rewards (a formal result showing a lower bound / floor imposed by reward imperfection and verifier limitations). Ai Safety And Ethics | negative | maximum achievable flywheel / self-improvement ceiling in presence of imperfect reward verification |
Reading fidelity
high
Study strength
medium
|
not reported
|
| There is a convergence condition for environment-side skill evolution (a formal result giving conditions under which environment-side skills converge). Skill Acquisition | positive | convergence of environment-side skill evolution |
Reading fidelity
high
Study strength
medium
|
not reported
|
| The framework is operationalised as a Supply Certainty Index (SCI) over five measurable properties, a five-level Determinism Maturity Model (DMM) as an adoption ladder, and an open-question programme (OQ1–OQ5) with explicit null results that would force retraction. Adoption Rate | positive | operational measures for environment determinism and adoption maturity |
Reading fidelity
high
Study strength
low
|
not reported
|
| The position taken in the paper is platform-agnostic. Other | null_result | applicability across AI platforms |
Reading fidelity
high
Study strength
low
|
not reported
|