AGI need not be a single cliff-edge: four credible routes could lead from human-level AI to far more capable systems, and bottlenecks along these routes will shape whether change is incremental or explosive.
Over the last decade, building human-level artificial general intelligence has moved from far-fetched speculation to being a concrete next-decade target for many of the largest AI organisations. Achieving this goal would have profound and far-reaching impacts on human society, which raises many complex questions for the decade ahead. This report investigates how AI itself might continue to develop in a post-AGI world along the continuum of machine intelligence. The endpoint of this continuum, Universal AI, is theoretically well understood, which provides some formal grounding for the main focus of this report: the transition from human-level AGI to artificial general superintelligence, which, intuitively, can be understood as a system that is more intelligent and cognitively capable than large organisations of humans. After characterizing ASI, the report discusses four potential pathways from AGI to ASI: scaling AGI, AI paradigm shifts, recursive improvement, and ASI emerging from large-scale multi-agent collectives. The report then discusses possible frictions and bottlenecks along these pathways. Determining whether the impact of these frictions will be negligible or substantial raises a number of concrete open research questions. Due to large uncertainties for predicting ASI progress, it cannot be ruled out that AI progress might continue to accelerate over the next years. This could imply that the image of a single transformative step change, caused by the introduction of human-level AGI into our society, could be inaccurate. More apt might be the prospect of a series of transformative societal changes caused by AI-enabled progress and breakthroughs across many areas of science and technology. Preparing for this prospect requires a massively interdisciplinary endeavour of global scope and interest.
Summary
Main Finding
The report maps how progress could continue beyond human-level AGI to artificial superintelligence (ASI). It argues that continued exponential (or faster) growth in effective compute — driven by hardware, investment, and large algorithmic-efficiency gains — together with four distinct technological pathways could plausibly produce ASI. Which pathway(s) dominate, and whether frictions (technical, economic, physical, social, regulatory) substantially slow or block progress, are open empirical questions. Preparing for these possibilities requires systematic measurement, modelling, and broad interdisciplinary policy work.
Key Points
-
Informal characterizations used in the report
- AGI: roughly median human-level artificial general intelligence — competent across most cognitive tasks.
- ASI: artificial general superintelligence — systems that are broadly and substantially superhuman across virtually all tasks and domains of human interest.
- The report grounds these informal notions with the Legg–Hutter view of intelligence as average performance over (computable) tasks to motivate a continuum between AGI and ASI.
-
Advantages of digital intelligence that grow with more compute (listed individually)
- Speed: faster internal processing and shorter wall-clock latency for thinking, planning, simulation.
- Replicability: near-zero marginal cost to create additional independent instances.
- Parallelism: ability to run many instances concurrently to explore many strategies or tasks.
- Scalability: increasing compute improves capability and/or number of instances available.
- Memory and bandwidth: orders-of-magnitude greater and cheaper long-term storage and recall than humans.
- High-dimensional perception and pattern extraction at scale (large models trained on massive datasets).
- Cheap iterative experimentation (rapid simulation, synthetic data generation).
- Test-time scaling (“thinking longer” / chain-of-thought) that can substitute for training breakthroughs.
- Precise repeatability and instrumentability for engineering and validation.
- Speed of coordination: instantaneous digital communication between instances or services.
- Self-improvement potential: automated search/optimization of model/architecture/hyperparameters.
- Availability: continuous operation without human biological constraints.
-
Four potential pathways from AGI to ASI (not mutually exclusive)
- Scaling AGI: continue scaling compute, data and model size; test-time scaling and massive parallel instances produce qualitatively greater capabilities.
- AI paradigm shifts: new algorithms, architectures, learning paradigms or modalities that unlock major capability jumps without requiring enormous extra compute.
- Recursive improvement / automation of R&D: AI accelerates its own design, data curation, experiment planning, or hardware co-design leading to self-amplifying (possibly super-exponential) progress.
-
ASI from large-scale multi-agent collectives: many interacting, specialized agents (or many AGIs) coordinate to produce collective capabilities that exceed individual human organisations.
-
Frictions and bottlenecks (the report catalogs many possible sources of slowdown; see next section for a summarized list and per-pathway impacts). The report emphasizes uncertainty about which frictions will be decisive and lists concrete open research questions to measure and resolve them.
-
Forecasting and uncertainty: effective compute has historically grown fast (compounding hardware improvement, investment, and algorithmic efficiency). Projecting capability depends on (a) compute growth and (b) how capability scales with compute; both are uncertain and must be tracked quantitatively. The report recommends sustained measurement, diverse models, and ensembling of forecasts.
Data & Methods
- No new empirical dataset; the report synthesizes prior empirical findings and theory:
- Literature review of scaling laws, algorithmic-efficiency studies, and empirical compute/benchmark trends (e.g., Kaplan et al., Ho et al., Epoch AI summaries cited in the report).
- Conceptual modelling and thought experiments using the Legg–Hutter formalism and Universal AI ideas to frame upper bounds and asymptotic considerations.
- Extrapolations of effective compute growth decomposed into three multiplicative factors: hardware improvements (Moore-like scaling), investment growth, and algorithmic efficiency gains — with numerical illustrations (example conservative estimate ~10× effective compute per year if all three compound).
- Qualitative pathway analysis: enumerating mechanisms by which AGI could progress to ASI and identifying frictions, then mapping frictions onto pathways.
- Identification of quantitative indicators to track (compute stock, algorithmic efficiency, automation of experiments, count and speed of instances, etc.) and a list of open research questions for reducing uncertainty.
Frictions / Bottlenecks (each followed by effect on the four pathways)
Note: the report enumerates many possible frictions; below are the major ones the authors highlight and how they would tend to affect the four pathways.
-
Compute / hardware manufacturing limits (chip fabrication capacity, cost)
- Scaling AGI: high impact — reduces ability to train larger models or run many instances.
- Paradigm shifts: lower impact — new algorithms can partially substitute for raw compute.
- Recursive improvement: moderate impact — hardware limits slow feedback loops that depend on large compute.
- Multi-agent collectives: moderate impact — many agents require compute; limits constrain scale.
-
Energy and infrastructure constraints (power, datacenter capacity, gigawatt-scale projects)
- Scaling AGI: high impact.
- Paradigm shifts: low-to-moderate impact.
- Recursive improvement: moderate impact.
- Multi-agent collectives: moderate impact.
-
Data limitations (quality, novelty, and labeling constraints; exhaustion of “easy” internet-scale data)
- Scaling AGI: moderate-to-high impact if models require ever more diverse high-quality training data.
- Paradigm shifts: can be alleviated by better learning paradigms (self-supervision, simulation).
- Recursive improvement: low-to-moderate (AI could synthesize useful training data).
- Multi-agent collectives: low-to-moderate (agents can generate interaction data).
-
Diminishing returns to scaling (scaling laws may plateau; more compute yields smaller capability gains)
- Scaling AGI: high impact — stalls progress unless overcome by algorithmic gains.
- Paradigm shifts: potentially low impact — a paradigm change can produce a step change.
- Recursive improvement: uncertain — if returns fall, self-improvement loops may decelerate.
- Multi-agent collectives: moderate — collective effects can sometimes overcome single-model plateaus.
-
Algorithmic bottlenecks / limits to current paradigms (e.g., sample inefficiency, brittleness, poor generalization)
- Scaling AGI: moderate impact — can be partially masked by more compute but may block key capabilities.
- Paradigm shifts: direct relevance — breakthroughs relieve this friction.
- Recursive improvement: high impact if AI cannot reliably design better algorithms.
- Multi-agent collectives: moderate impact; coordination requires robust algorithms.
-
Research automation bottlenecks (difficulty in automating experimental science, hardware design, or theory creation)
- Scaling AGI: low-to-moderate impact.
- Paradigm shifts: high impact — automation accelerates paradigm discovery.
- Recursive improvement: central friction — slows or blocks self-improvement loops.
- Multi-agent collectives: moderate impact (coordination tools matter).
-
Verification, robustness and evaluation limits (difficulty testing and validating general capabilities safely)
- Scaling AGI: moderate impact (limits deployment).
- Paradigm shifts: moderate impact.
- Recursive improvement: high impact — unchecked self-improvement is risky and hard to evaluate.
- Multi-agent collectives: high impact — emergent behaviours harder to validate.
-
Alignment, safety and governance constraints (policy, deliberate halting/limiting by actors)
- Scaling AGI: potentially high impact (regulation may constrain compute access).
- Paradigm shifts: moderate impact (governance can slow deployment).
- Recursive improvement: high impact — deliberate safety controls could curtail feedback loops.
- Multi-agent collectives: high impact — policy might limit large coordinated agent deployments.
-
Economic and coordination frictions (investment cycles, access to capital, concentration vs. distributed R&D)
- Scaling AGI: high impact — compute- and capital-heavy route benefits incumbents.
- Paradigm shifts: lower impact — smaller actors can sometimes catalyze paradigm changes.
- Recursive improvement: high impact — requires significant organized effort and coordination.
- Multi-agent collectives: mixed — could be enabled by many actors or dominated by a few.
-
Supply-chain and material constraints (rare-earths, specialised fabs)
- Scaling AGI: moderate-to-high impact.
- Paradigm shifts: low-to-moderate impact.
- Recursive improvement: moderate impact.
- Multi-agent collectives: moderate impact.
-
Embodiment and real-world interaction limits (robotics, sensors, and grounded learning challenges)
- Scaling AGI: low-to-moderate impact for purely digital capabilities; high if ASI depends on physical action.
- Paradigm shifts: may be required to bridge to embodied domains.
- Recursive improvement: moderate — self-improvement that depends on physical experiments will be slower.
- Multi-agent collectives: depends on application; can be high for physically grounded collectives.
-
Multi-agent coordination costs and game-theoretic limits (incentives, miscoordination, emergent competition)
- Scaling AGI: lower impact.
- Paradigm shifts: low impact.
- Recursive improvement: moderate impact.
- Multi-agent collectives: high impact — collective ASI requires solving coordination at scale.
-
Physical / thermodynamic limits (ultimate bounds on compute per energy / per volume)
- Scaling AGI: long-term limiting factor; low immediate impact.
- Paradigm shifts: may be circumvented by more efficient paradigms.
- Recursive improvement: presents an asymptotic ceiling.
- Multi-agent collectives: aggregate compute still bounded by these limits.
-
Social and political resistance (public opposition, labour displacement backlash)
- Scaling AGI: can slow deployment and investment.
- Paradigm shifts: may provoke regulatory attention.
- Recursive improvement: could trigger safety-driven throttles.
- Multi-agent collectives: likely to attract scrutiny and governance.
The report stresses that assessing the real-world relevance of each friction requires targeted measurement and modelling; many frictions interact non-linearly.
Open research questions (examples highlighted by the report)
- How does capability scale with effective compute for a broad set of tasks beyond current benchmarks? Where do diminishing returns appear?
- What are reliable empirical measures of algorithmic efficiency gains and how to track them publicly?
- What quantitative indicators best capture automation of scientific and engineering research by AI?
- Which frictions are most likely to produce “S-shaped” vs. hyperbolic growth dynamics in AI capabilities?
- What are the economic dynamics of compute as an input (pricing, allocation, market concentration) and how do they affect global access?
- How do multi-agent dynamics scale — when and how do collectives outperform centralized AGI?
- What verification and evaluation frameworks scale to high-generalization systems?
- How to model and empirically test the safety and governance levers that can slow or shape ASI pathways?
Implications for AI Economics
- Compute as a central factor of production: If compute (and algorithmic efficiency) largely determine frontier capability, compute markets, pricing, and access become critical economic levers. This alters capital allocation: large compute owners obtain outsized returns, increasing concentration.
- Capital intensity and returns to scale: Pathways that rely on massive training runs or many instances favor large firms and states, increasing winner-take-all dynamics and potentially reducing competition. Paradigm-shift or algorithmic routes lower capital barriers, allowing more entrants.
- Labor and productivity: AGI → ASI scenarios imply major productivity gains across sectors. Short-term disruption (worker displacement, restructuring) is likely; long-term effects depend on complementarity between humans and AI, policy responses, and how gains are distributed.
- R&D acceleration and endogenous growth: Recursive improvement would change the dynamics of technological progress, shortening innovation cycles and increasing volatility in the returns to R&D investments. This raises valuation uncertainty for firms and public policy (e.g., whether to subsidize safety research).
- Risk, insurance, and systemic externalities: Faster, concentrated capability growth raises systemic risk (misuse, accidents, geopolitical instability). Markets may underprice these externalities, calling for public intervention, regulation, and insurance innovations.
- International trade and comparative advantage: Nations with compute capacity and AI ecosystems could specialize in AI-enabled production, reshaping trade patterns. Access to compute may become a strategic asset.
- Policy-relevant economic metrics to track: effective compute growth, model training costs, count/speed of deployed instances, concentration measures (market share of top compute providers), and indicators of automation in scientific R&D.
- Policy levers and economic interventions implied by the report: investments in shared safe compute infrastructure, R&D funding for alignment and verification, taxes/subsidies to shape incentives, export controls, and antitrust actions to address concentration — all require careful economic modelling to anticipate second-order effects.
Limitations for economic inference - High uncertainty in mapping compute → capabilities makes precise economic forecasts unreliable; scenario analysis and robust policymaking are emphasized. - Nonlinear interactions between technical, social and regulatory factors mean that economic outcomes will depend critically on policy choices and coordination.
Shortcomings, caveats, and recommended next steps (as emphasized by the report)
- The report is exploratory and qualitative in many parts; empirical validation of key claims (especially scaling relationships) is essential.
- High uncertainty around rates of compute growth, algorithmic-efficiency gains, and how capability maps to real-world tasks.
- The authors call for a sustained interdisciplinary programme: improved measurement and forecasting, better public data on compute and model capabilities, research on alignment/verification, economics of compute, governance mechanisms, and monitoring of automation in research processes.
Note on post-publication developments - I cannot provide verified post-publication updates beyond my training cutoff (June 2024). The report itself asks future summarizers to record developments and progress on the open questions it lists. For current (post-2024) empirical updates, track institutions that publish compute and capability metrics (benchmark stitching studies, Epoch AI, and major lab transparency reports) and the literature on algorithmic efficiency and AI-assisted R&D.
If you’d like, I can: - Produce a one-page policy brief for economists or policymakers summarizing economic risks and interventions. - Produce a concise checklist of empirical indicators to monitor (compute, algorithmic efficiency, instances, etc.) with suggested data sources.
Assessment
Claims (8)
| Claim | Direction | Outcome | Confidence & Evidence | Details |
|---|---|---|---|---|
| Building human-level artificial general intelligence has moved from far-fetched speculation to being a concrete next-decade target for many of the largest AI organisations. Research Productivity | positive | the timing/target horizon for achieving human-level AGI among large AI organisations |
Reading fidelity
high
Study strength
medium
|
|
| The endpoint of the machine-intelligence continuum, Universal AI, is theoretically well understood, which provides some formal grounding for the report's focus. Other | positive | theoretical understanding of Universal AI |
Reading fidelity
high
Study strength
low
|
|
| Artificial superintelligence (ASI) can be intuitively understood as a system that is more intelligent and cognitively capable than large organisations of humans. Other | neutral | relative cognitive capability of ASI compared to large human organisations |
Reading fidelity
high
Study strength
speculative
|
|
| There are four potential pathways from AGI to ASI: scaling AGI, AI paradigm shifts, recursive improvement, and ASI emerging from large-scale multi-agent collectives. Other | neutral | pathways/mechanisms by which AGI could transition to ASI |
Reading fidelity
high
Study strength
speculative
|
|
| There exist frictions and bottlenecks along these AGI→ASI pathways, and whether their impacts are negligible or substantial is an open set of concrete research questions. Research Productivity | mixed | magnitude of frictions/bottlenecks affecting AGI→ASI transitions |
Reading fidelity
high
Study strength
low
|
|
| Due to large uncertainties for predicting ASI progress, it cannot be ruled out that AI progress might continue to accelerate over the next years. Research Productivity | positive | rate of AI progress (acceleration vs. deceleration) |
Reading fidelity
high
Study strength
speculative
|
|
| The image of a single transformative step change caused by the introduction of human-level AGI may be inaccurate; a more apt prospect is a series of transformative societal changes caused by AI-enabled progress and breakthroughs across many areas of science and technology. Consumer Welfare | mixed | pattern of societal change attributable to AI (single-step vs. series of changes) |
Reading fidelity
high
Study strength
speculative
|
|
| Preparing for the prospect of continued and possibly accelerating AI progress requires a massively interdisciplinary endeavour of global scope and interest. Governance And Regulation | positive | need for interdisciplinary, global preparatory efforts/policy coordination |
Reading fidelity
high
Study strength
low
|