Under plausible adoption and chip-supply scenarios, hundreds of millions of AI 'digital minds' could exist globally by 2050, though the authors caution the figure is highly uncertain and could vary by orders of magnitude.

Main Finding

Derek Shiller (Rethink Priorities) projects that, under plausible assumptions, the number of “digital minds” (AI systems with observable traits like agency, personality, and goal-directed behavior) will scale to millions by the early 2030s and could reach billions by 2050. Compute capacity is unlikely to be the principal constraint; adoption depends mainly on demand, consumer comfort with person-like agents, and social/economic choices. Uncertainty is large (95% intervals span multiple orders of magnitude) and different kinds of minds dominate median vs. expectation-value calculations.

Key Points

• Definition: “Digital minds” are operationalized by observable traits (not a commitment about phenomenal consciousness). Key candidate traits: consistent goals/desires, stable personality, complex environment interaction, learning/growth, and general intelligence/creativity. Entities need not satisfy all traits; a degree-of-mindedness score is used.
• Two complementary estimation strategies:
• Demand/use-case approach: forecast adoption by role (consumer virtual friends, personal assistants, game NPCs, robot embodiments, white-collar replacements, simulation participants, etc.).
• Supply/compute approach: project growth in AI-relevant chip compute and assume plausible shares of total compute allocated to running digital minds; translate compute allocations into counts of individuals.
• Core quantitative takeaways (representative numbers from report):
  • Approach 1 (use-case demand): median ~4.8 million digital minds in 2030, ~1.34 billion in 2050. A high-tail (97.5%) yields numbers up to ~2.26 billion in 2030 and ~9.13×10^10 in 2050.
  • Approach 2 (compute supply): depending on allocation and compute-growth scenario:
    • Moderate (0.01% compute to minds, Llama-2-7B baseline): ~4.4×10^7 in 2030 → ~2.32×10^9 in 2050.
    • Optimistic (0.1% allocation, optimistic compute growth): ~5.08×10^8 in 2030 → ~2.84×10^11 in 2050.
• Composition:
  • Median-case dominated by consumer-facing personable virtual AIs (virtual friends, personal secretaries, NPCs).
  • In expectation (value-weighted by large but unlikely scenarios), simulation participants and white-collar worker replacements can dominate total counts.
  • Embodied robots (physical) likely remain a minority of total minds.
• Important drivers / cruxes:
  • Consumer comfort and demand for person-like agentic AIs strongly shape adoption, especially for social roles.
  • Whether digital minds are used for social vs. non-social roles influences scaling (social roles tie mind counts more directly to number of humans).
  • Availability of cheap compute makes many low-value agents affordable; but availability alone doesn’t guarantee deployment.
  • AGI arrival could produce discontinuities, making long-run projections (>2035) increasingly speculative.
• Uncertainty: wide ranges; estimates sensitive to allocation share of compute, compute growth rates, adoption rates, and normative/consumer attitudes.

Data & Methods

• Conceptual framing:
  • Focus on counting distinct individuals (with caveats about cloning, forking, multi-use models). Also discusses other possible metrics (total cognitive work, welfare significance, social impact) and explains the choice to emphasize individual counts occupying roles.
  • Time horizon: 2025 → 2050, with increasing uncertainty farther out.
• Operationalization of “mindedness”:
  • Five traits scored 1–3 (low, moderate, high). Total score maps to a “mindedness” metric using an n^2/225 scaling (table provided in the report).
  • Degree of mindedness allows weighting between systems that differ qualitatively.
• Approach 1 (use-case/demand):
  • Enumerates candidate use-cases and builds adoption models per-use-case based on historical analogues, expected needs, and projected market growth.
  • Converts adoption into counts of digital individuals, adjusting for degree-of-mindedness and utilization patterns.
• Approach 2 (compute/supply):
  • Projects aggregate AI-relevant compute growth under multiple scenarios (baseline/moderate/optimistic).
  • Assumes fractions of that compute are allocated to running digital minds (example allocations: 0.01%, 0.1%).
  • Calibrates compute-to-individual translation using a Llama-2-7B benchmark as a reference unit.
• Sensitivity & scenarios:
  • Report provides medians, high-tail percentiles, and scenario ranges reflecting variation in compute growth, allocation share to minds, and adoption assumptions.
• Limitations acknowledged:
  • High epistemic uncertainty, hard-to-individuate agents (clones, multi-tenancy), dependence on social attitudes and regulatory responses, potential AGI-driven discontinuities, and ethical ambiguity about which traits truly confer moral status.

Implications for AI Economics

• Compute is a necessary but insufficient determinant of scale: markets and preferences matter more. Economic models should treat compute as an abundant input in many scenarios, with demand-side constraints (willingness to pay, privacy/regulation, social acceptance) as primary levers.
• Low marginal cost per virtual mind (once models and infra exist) implies industries can produce large volumes of low-value agents. This favors:
  • Extensive proliferation of consumer-facing personable AIs (large addressable market).
  • New long-tail markets (many niche virtual agents with small revenue per agent).
• Labor market effects:
  • White-collar replacement scenarios can substantially raise the expected number of digital minds and generate large economic displacement and redistribution questions. Scenario analysis should separate median vs. expectation-weighted outcomes.
  • Value-per-mind and task substitutability will determine sectoral impacts; elasticities of substitution between human labor and digital minds are crucial.
• Welfare and externalities:
  • Economic accounting should incorporate potential welfare-externalities (moral status concerns, regulation costs, psychological/social externalities from interacting with agentic AIs).
  • Degree-of-mindedness weighting is a practical mechanism to incorporate non-pecuniary welfare considerations into economic impact assessments.
• Platform and market structure:
  • Platforms controlling compute or access to personable agent templates may capture significant rents. Network effects (agents trained by or interacting with many users) could favor large incumbents.
  • Pricing strategies: freemium + premium personalization likely, given social demand for person-like agents; subsidies or cheap consumer tiers can drive scale.
• Policy and regulation implications for economists and modelers:
  • Include consumer comfort and social acceptance parameters in adoption models; these have outsized influence on scale.
  • Run multi-scenario analyses with differing assumptions about compute allocation to minds, AGI discontinuities, and regulatory constraints.
  • Track energy and infrastructure costs: while compute may be plentiful, energy/environmental constraints can affect marginal costs and externalities.
  • Consider governance instruments (rights, welfare protections, liability rules) that could create new compliance costs and shape the economics of deploying many digital minds.

Suggested next steps for applied economic modeling: - Build scenario-based models that vary: compute growth, compute-allocation-to-minds, adoption elasticities tied to consumer comfort, and AGI arrival probability. - Calibrate per-mind value estimates across use-cases (consumer virtual friend, assistant, NPC, worker replacement, simulation participant). - Incorporate mindedness-weighted welfare adjustments to cost–benefit analyses of large deployments. - Model platform competition dynamics given low marginal cost and potential informational/interaction advantages.

Reference: Derek Shiller, "Estimating the Scale of Digital Minds" (Rethink Priorities), executive summary and methods (arXiv entry referenced in report).