Claims of an imminent superintelligence catastrophe are unsupported by 2023–2025 evidence; current generative models are powerful but narrow, and the real economic concern is consolidation of computational power and an AI investment bubble rather than demonstrated existential risk.

Main Finding

The paper argues that 2025’s high-profile existential-risk claims (notably Kokotajlo et al., 2025 and Yudkowsky & Soares, 2025) lack empirical warrant. Reviewing the 2023–2025 record, the author finds no evidence for the key links of the Good–Bostrom chain (sustained recursive self‑improvement, autonomous strategic agency, intractable lethal misalignment). Instead, demonstrable, tractable economic risks—labour displacement, bias/epistemic harms, and extreme concentration of computational and economic power (surveillance capitalism)—require urgent policy attention. The paper formalises this as an AI Risk Hierarchy that separates observable Level 1 risks from speculative Level 2 existential risks and argues for a Bayesian update lowering the probability of near‑term superintelligence catastrophe.

Key Points

• Empirical absence of the intelligence explosion:
  • No architecture (2012–2025) has shown sustained, open‑ended autonomous self‑improvement; human researchers remain the source of architectural innovation.
  • Scaling laws (Kaplan et al. 2020; Hoffmann et al. 2022; Epoch AI 2024–25) show smooth power‑law progress across many orders of magnitude—no inflection point or phase transition consistent with a take‑off.
  • Frontier labs report saturation of gains from internal reasoning loops (OpenAI o1/o3 reports), with performance saturating after a few iterations.
• Rising marginal costs and diminishing returns:
  • R&D/compute spending has increased sharply (cited projection: from ~$52B to ~$250B annually), while incremental benchmark gains (e.g., MMLU) have declined (16.1 → 3.6 points, 2021→2025).
  • This pattern indicates capabilities are bought via large human‑controlled resource inputs, not automated self‑amplification.
• Technical limitations of current models are consistent with statistical/architectural artefacts, not emergent agency:
  • Confabulation, bias amplification, and sycophancy reflect training/data effects and human‑defined objectives; measured catastrophic failure rates have decreased with standard techniques.
• Political‑economic drivers divert attention to speculative risks:
  • The existential‑risk narrative functions ideologically to distract from surveillance capitalism and concentration of power (Whittaker, Zuboff).
  • The 2025 “AI bubble” (McWilliams’ “digital lettuce”) channels trillions into depreciating hardware (GPUs/data centres) with lagging revenues; e.g., cited valuation anomalies (OpenAI ~US$300B vs. reported large losses).
• Formal contributions:
  • An AI Risk Hierarchy (Table I) distinguishing Level 1 observable, tractable risks from Level 2 speculative, currently unobserved risks.
  • Comparative matrix (Table II) situating this empirical critique against prominent 2025 doom narratives.
• Policy implication summary:
  • Prioritise governance of observable economic harms (labour market displacement, antitrust/data governance, epistemic integrity) over preemptive governance aimed at an unobserved entity.

Data & Methods

• Evidence base: synthesis of empirical sources and technical reports for 2023–Q3 2025, including:
  • Epoch AI meta‑analysis (compute growth, capability trends, 2025 Q3 point)
  • Scaling law literature (Kaplan et al., 2020; Hoffmann et al., 2022)
  • Frontier lab technical reports (OpenAI o1/o3; AlphaEvolve mentions)
  • Sector investment and valuation data (PitchBook, CB Insights, McKinsey projections; McWilliams 2025)
  • Technical evaluations and error analyses (studies on confabulation, bias, sycophancy; Sun et al. 2024b; Kalai et al. 2025; Wan et al. 2025)
  • Thought‑leadership and political economy critiques (Whittaker 2025a–c; Zuboff 2019, 2025)
• Methods:
  • Quantitative reconstruction of an Observed Loss Trajectory by translating observed compute growth into expected loss reduction via established power‑law scaling (used to show smooth progress rather than an inflection).
  • Descriptive trend analysis of R&D/compute expenditure vs. benchmark gains to demonstrate diminishing returns.
  • Comparative qualitative analysis (Table II) contrasting empirical record with speculative arguments.
  • Conceptual development of a risk hierarchy (evidentiary status × tractability) and application of Bayesian reasoning to update existential‑risk priors given 60 years of null observations.
• Limits noted by author:
  • Analysis is bounded to data through November 2025; absence of evidence to date does not logically preclude future acceleration, but warrants reweighting of near‑term risk probabilities.

Implications for AI Economics

• Reallocate policy and research priorities toward tractable economic harms:
  • Labour markets: prepare for displacement and “jobless growth” (300M+ jobs at risk cited); invest in retraining, social insurance, active labour market policies, and measure net employment effects rather than assuming net job creation.
  • Market power and data governance: prioritize antitrust, compute‑concentration monitoring (e.g., four firms controlling a large fraction of compute), data portability, and limits on monopoly access to behavioural data.
  • Epistemic/consumer protection: regulate deployment practices to mitigate confabulation and bias (transparency, auditing, liability regimes, mandatory evaluation metrics).
• Investment and macroeconomic consequences:
  • The “digital lettuce” phenomenon implies heavy capital misallocation into perishable compute assets; economists should monitor valuation‑to‑revenue ratios, depreciation schedules for AI hardware, and systemic risk from a potential bubble burst.
  • Rising R&D marginal costs and diminishing returns change social returns calculus: public funding and subsidies should be assessed against measured capability gains, not speculative future payoffs.
• Research funding and prioritization:
  • Apply Bayesian updating: reduce the share of funding devoted to speculative near‑term existential safety relative to governance and mitigation of observed economic harms (though long‑term safety research need not be eliminated).
  • Emphasise empirical, reproducible studies: compute‑concentration metrics, capability‑per‑dollar trends, labour displacement incidence by sector, and rigorous measurement of model failure modes.
• Metrics for monitoring and policy triggers:
  • Track empirical indicators that would justify revising existential risk priors: evidence of sustained autonomous, open‑ended self‑modification; falling marginal human input requirements for capability gains; non‑human‑initiated architectural innovation with goal‑directed behaviour.
  • Meanwhile, operationalise Level 1 indicators for immediate action: job displacement rates, concentration indices for compute/data, revenue/valuation gaps, rates of model confabulation in deployed systems, and demographic distribution of harms.
• Governance consequences:
  • Avoid regulatory misallocation driven by speculative narratives that can be leveraged by dominant firms to obtain safety‑as‑credibility and regulatory immunity.
  • Use antitrust, tax, and data‑rights tools to redistribute bargaining power and align incentives toward public welfare rather than speculative private capture.

Caveat: the paper’s conclusions apply to the empirical record through November 2025; they recommend a Bayesian down‑weighting of near‑term existential catastrophe but explicitly leave open the possibility of future acceleration if concrete, replicable evidence of the required phenomena appears.