A simple 'reproduction number' for AI R&D decides whether AI assistance will self-amplify or fade: when the transmitted recursive gain exceeds frontier hardening (RAI>1) small improvements compound across development cycles. Theoretical analysis shows amplification can be transient, delayed, or an ecosystem-level phenomenon even if individual labs are subcritical.

Main Finding

The paper formulates recursive AI self-improvement as a local stability transition in an AI–R&D dynamical system and identifies a scalar threshold — the recursive reproduction number RAI — that determines whether incremental capability improvements amplify or decay across development cycles. RAI = χ a / σ. If RAI > 1, small capability gains are locally self-amplifying; if RAI < 1, they are damped. This threshold is a property of the feedback loop (gain, transmitted fraction, and frontier hardness) and need not coincide with any particular absolute capability level; networks of actors can be collectively supercritical even when each actor is individually subcritical.

Key Points

• Basic ingredients of the model:
  • a(x,t): recursive gain — how much an increase in current capability raises unconstrained future R&D productivity.
  • χ(x,t): operational closure — fraction of potential recursive gain that survives the development pipeline.
  • σ(x): frontier hardening — marginal difficulty of further improvements as capability advances.
  • τ(t): delay — end-to-end time between an improvement and its feedback into future R&D.
  • r(t) and f(x): baseline research throughput and direct-improvement productivity.
• Recursive reproduction number:
  • RAI ≡ g / σ = (χ a) / σ. Local amplification occurs when RAI > 1.
  • In a linearized delayed model, characteristic equation λ + vσ = v g e^{-λ τ} yields local stability/instability conditions.
• Decoupling of pace and criticality:
  • Baseline throughput (compute, effort, expenditure) can speed progress without changing whether the system is subcritical or supercritical in the minimal model — i.e., fast progress ≠ necessarily self-amplifying RSI.
  • Delay τ controls how visible/fast an amplifying mode becomes; at high throughput the delay imposes an upper bound on amplification rate.
• Finite runway and transience:
  • If the research frontier is finite and hardens (σ → ∞ as x → X), then RAI → 0 near the frontier: supercriticality can be transient within a paradigm.
• Multi-actor ecosystems:
  • For n actors, the reproduction matrix K has entries Kij = gij / σi (gij = gain transferred from j to i). Collective criticality is determined by the spectral radius ρ(K): the ecosystem is unstable if ρ(K) > 1.
  • Cross-actor transfer can make the whole system supercritical even when each actor's diagonal term Kii < 1.
• Measurable determinants for diagnosing recursive amplification: χ, a, σ, τ, transfer coefficients gij, and development-cycle duration.

Data & Methods

• Model type: continuous-time dynamical system with delayed feedback. Core equation (summary form):
  • ẋ(t) = r(t) f[x(t)] exp(Φ(x[t−τ], t)), with ∂Φ/∂x = g = χ a.
• Linearization and stability analysis:
  • Small perturbation model: ξ̇(t) = −v σ ξ(t) + v g ξ(t − τ).
  • Characteristic equation and analysis of roots yields threshold conditions (Proposition 1).
• Finite-frontier example:
  • Uses f(x) = (1 − x/X)^β to model increasing difficulty; shows σ(x) = β/(X − x) and that RAI → 0 as x → X (Proposition 2).
• Multi-actor extension:
  • Linear local approximation across actors yields Eq. (11) and reproduction matrix K; stability governed by spectral radius (Proposition 3).
• Numerical scenarios:
  • Conditional, illustrative simulations (not probabilistic forecasts). Reference choices: normalized current capability x0 = 0, frontier X = 1, β = 2, delay τ = 0.5 yr. Baseline throughput rref chosen so “no-RSI” AGI time ≃ 2050 (rref ≃ 1/24 yr−1). AGI/ASI thresholds set at xAGI = 0.50 and xASI = 0.80 for illustration.
  • Code and notebooks to reproduce figures are provided: https://github.com/burtsev/recursive-criticality-ai
• Empirical data: the paper does not fit the model to observational time series; it points to emerging benchmarks and lab evaluations (MLE-bench, RE-Bench, PaperBench), task-cost functions, and expert surveys as sources to estimate model components.

Implications for AI Economics

• Distinction between sources of rapid progress:
  • Policymakers, forecasters and investors should distinguish whether fast capability growth is driven by higher baseline throughput (compute, labor, scaling) or by genuinely self-amplifying recursive feedback (RAI > 1). The hazards and policy responses differ.
• Observable quantities to monitor (for early warning and economic forecasting):
  • Realized recursive gain (a and χ): measure how improvements in model-in-the-loop R&D increase downstream productivity.
  • Frontier hardening (σ): estimate marginal decline in direct-improvement productivity as capability advances (e.g., via task-cost curves).
  • End-to-end delay (τ) and development-cycle duration: shorter cycles raise the maximum possible amplification rate.
  • Cross-actor transfer coefficients (gij) and network topology: measure how quickly advances diffuse and recombine across firms/labs/countries; compute spectral radius ρ(K).
• Policy levers and interventions:
  • Changing the pace vs changing dynamics: increasing compute/funding speeds progress but typically does not change RAI in the minimal model; altering operational closure (χ), feedback strength (a), delays (τ), or information-sharing networks does change recursive criticality.
  • Information sharing and collaboration can increase systemic recursion: while sharing accelerates aggregate progress, it may push the coupled ecosystem across the collective criticality threshold even if individual actors remain subcritical.
  • Bottlenecks in pipeline (reducing χ) and longer validated-development cycles (increasing τ) can damp recursive amplification; conversely, automation of evaluation and integration (increasing χ, reducing τ) strengthens recursive loops.
• Risk assessment and forecasting:
  • Because RAI is local and can change with capability, transient episodes of self-amplification are possible; crossing the RAI = 1 boundary can occur before acceleration is visibly clear.
  • Forecasts based solely on historical growth rates may misattribute causes; empirical estimation of the model components is needed for better counterfactuals and risk modeling.
• Empirical agenda for AI economics:
  • Estimate task-specific cost functions c_t(q, ε; p) to derive capability coordinates x(t).
  • Design field measurements for χ (fraction of AI-produced outputs adopted), a (productivity multipliers attributable to AI in R&D), σ (marginal hardening), τ (elapsed time from contribution to downstream deployment), and cross-actor gij (diffusion/transfer rates).
  • Use benchmarking suites that mimic multi-step research workflows (MLE-bench, PaperBench) to quantify effective closure and delays.
  • Construct and monitor reproduction matrices across major labs/firms to assess collective criticality (compute spectral radius, sensitivity to sharing policies).
• Economic trade-offs:
  • Interventions that slow the transformation of AI contributions into validated successor capability (reducing χ or increasing τ) can reduce systemic amplification risk, but also reduce aggregate productivity and welfare from beneficial innovations — trade-offs for policy design.
• Strategic implications for actors:
  • Firms aiming to accelerate capability should target increasing realized recursive gain and closure (a and χ) and shortening τ; regulators or competitors concerned about destabilizing feedback may focus on limiting transfer channels or increasing evaluation/validation friction.

In sum, the paper provides a compact, measurable framework (RAI and its multi-actor extension) to separate (i) ordinary acceleration driven by scale/throughput from (ii) genuinely self-amplifying recursive improvement. That separation yields concrete empirical targets (χ, a, σ, τ, gij) for economists, policymakers and researchers who want to monitor, forecast, or influence the dynamics of AI-driven technological change.