Training state-of-the-art AI can demand thousands of GPUs and tonnes of toxic materials: training GPT-4 may require 1,174–8,800 Nvidia A100s, equating to up to seven tonnes of heavy metals. Raising model FLOP utilization and extending GPU lifespans together can cut hardware needs — and material extraction — by as much as 93%, making software efficiency and lifecycle policies essential to sustainable AI.

Main Finding

Training large-scale AI models imposes substantial material costs in addition to energy and water: by linking measured elemental composition of a widely used GPU (Nvidia A100 SXM 40GB) to model FLOPs demands, the paper shows that training state-of-the-art models (e.g., GPT‑4 under plausible architecture assumptions) can require thousands of A100s and entail extraction and eventual disposal of up to several tonnes of toxic elements. Hardware- and software-side efficiency improvements (higher Model FLOPs Utilization and longer GPU lifespans) can cut material demand dramatically (up to ≈93% in combined scenarios), but incremental model performance gains can have disproportionately large material footprints.

Key Points

• Elemental composition: ICP-OES analysis of an Nvidia A100 SXM 40GB identified 32 elements; roughly 90% of the GPU mass is heavy metals (dominant by mass: copper, iron, tin, silicon, nickel); precious metals are present only in trace amounts.
• Computational throughput baseline: A100 peak BF16 throughput = 312 TFLOPs; annual theoretical throughput at 100% utilization ≈ 9.8×10^21 FLOPs. Lifespan scenarios considered: 1, 2, and 3 years (yielding 9.8×10^21, 1.9×10^22, 2.9×10^22 FLOPs per GPU, respectively).
• Mapping compute-to-material: For dense transformers the compute budget uses Kaplan et al. heuristic: Compute Budget = 6 × N (parameters) × D (tokens). MoE models (GPT‑4 plausibly MoE) are handled by counting active parameters per forward pass.
• Utilization (MFU) matters: Real-world Model FLOPs Utilization typically ranges ∼20%–60%; MFU is used to scale theoretical throughput. MFU increases from 20%→60% reduces GPU requirements by ≈67%.
• Quantitative illustrative result: Training GPT‑4 (under the paper’s MoE activation scenarios) requires between ≈1,174 and ≈8,800 A100 GPUs, corresponding to up to ~7 tonnes of toxic elements extracted/disposed (depending on MFU and lifespan assumptions).
• Combined interventions: Raising MFU and extending hardware lifespan together produce large material savings (combined up to ≈93% reduction in required GPUs versus a pessimistic baseline).
• Important caveats: analysis uses a sequential-training abstraction (not parallel training), assumes continuous operation at specified MFU, and GPT‑4 architecture and compute are uncertain—estimates are scenario-based rather than definitive.

Data & Methods

• Hardware sample and elemental analysis:
  • Device: Nvidia A100 SXM 40GB GPU disassembled into casing, heatsink, PCB, PoP, and GPU chip (VRAM + die).
  • Sample prep: manual grinding, pyrolysis (500°C, 2 h) to remove plastics, particle size reduction (20–200 µm), random quartering; samples dried at 100°C.
  • Mineralization: three complementary digestion protocols (H2O2 + HNO3; aqua regia + H2O2 then HNO3; tetrafluoroboric acid + HNO3) at 240°C and 60 bar for 1 h.
  • Measurement: Agilent ICP‑OES 5100; IntelliQuant screening (detection error <10%) and quantitative calibration (≥3 wavelengths/element).
  • Outcome: detection and quantification of 32 elements; mass shares dominated by common heavy metals (Cu, Fe, Sn, Si, Ni).
• Compute-to-material mapping:
  • GPU throughput calculation: Peak BF16 throughput × seconds/year to get annual theoretical FLOPs (Equation: Annual = 312×10^12 × 365×24×3600 ≈ 9.8×10^21 FLOPs).
  • Model compute estimates: Dense transformers: Compute Budget = 6 × N × D (Kaplan heuristic). MoE models: same formula but N = active parameters per token.
  • Required GPUs (idealized) = Compute Budget / (Annual throughput × lifespan).
  • MFU adjustment: scale by 1 / MFU (MFU range used: 20%–60%) to get realistic GPU counts: GPU_adjusted = GPU_required × (1 / MFU).
  • Lifespan scenarios: 1, 2, 3 years (reflecting empirical failure/retirement patterns in high-utilization clusters).
• Scenario analysis: combined variations across MFU (20%–60%), GPU lifespan (1–3 years), and GPT‑4 MoE activation assumptions to produce ranges for required GPUs and associated aggregated elemental extraction/waste (derived by multiplying per‑GPU element masses by GPU counts).

Implications for AI Economics

• Hidden material costs should be internalized: Beyond electricity and water, the material footprint (mining, refining, supply-chain bottlenecks, end-of-life toxic waste) is a non-negligible economic and environmental cost that should be considered in model-cost accounting, procurement, and societal cost–benefit analysis.
• Resource constraints & supply risk: Large-scale adoption of bigger models increases demand for specific non-renewable and geopolitically concentrated materials (e.g., components containing copper, rare earths, tantalum, cobalt). This raises the risk of supply shortages, price volatility, and strategic competition—affecting capital allocation and capacity expansion plans by cloud providers and AI firms.
• Investment trade-offs & scaling decisions: Firms and investors should weigh marginal performance gains against potentially large material and environmental costs. The paper’s findings suggest diminishing returns where incremental accuracy/ability gains incur disproportionately higher resource extraction and waste.
• Operational and market incentives:
  • Incentivize higher Model FLOPs Utilization (MFU): improving software stacks, parallelization efficiency, data pipelines, and interconnects to increase MFU yields large reductions in hardware demand per model trained.
  • Extend hardware lifespans: operational practices, maintenance, graceful degradation policies, and secondary markets (used GPUs, refurbishment) can meaningfully reduce material throughput per unit of compute delivered.
  • Promote recycling and circularity: design-for-reuse, systematic take-back programs, and recycling infrastructure mitigate raw-material extraction and toxic waste externalities.
• Policy and regulation:
  • Incorporate material metrics into AI governance and reporting (e.g., extend FLOPs-based regulatory thresholds or reporting to include estimated material footprints).
  • Use procurement standards, taxes/subsidies, or disclosure mandates to align economic incentives with material efficiency (e.g., favor models and providers that demonstrate lower material intensity per useful computation).
• Rebound risk and Jevons paradox: Efficiency gains (better MFU, smaller models) may lower unit costs and thereby increase total demand, possibly offsetting material savings unless coupled with governance or market mechanisms that cap total resource use or internalize externalities.
• Research & accounting: AI economic models and cost-benefit analyses must broaden their metrics beyond operational energy to include hardware material inputs, lifecycle impacts, and end-of-life costs to make more accurate projections of sectoral resource demand and environmental externalities.

Limitations and uncertainty to consider when applying these results: - Sequential-training abstraction (used to map cumulative FLOPs to number of GPUs) simplifies real distributed training topologies and may under- or over-estimate practical GPU counts and utilization patterns. - GPT‑4 architecture, parameter counts, and exact compute budget are not public; the paper relies on MoE scenario assumptions—results should be read as illustrative scenario ranges rather than exact values. - Per-GPU elemental masses were measured on a single A100 sample; manufacturing variation across batches, other GPU models, or future architectures will change the per‑unit material profile. - MFU, failure rates, and operational practices vary across providers and data centers; local conditions will materially affect realized outcomes.

Overall, the paper argues that AI economics should explicitly account for the material dimension of compute: decisions about model size, deployment, and infrastructure investment carry material extraction and waste consequences that materially affect environmental costs, supply risk, and long-run scalability.