Relying on AI as a substitute for human reasoning builds 'cognitive debt' and hidden systemic fragility, leading rational agents to over-adopt AI and trigger boom–bust cycles; even high-skilled users can erode unaided cognition over time.
We develop a formal theory of cognitive debt: the stock of unverified reasoning obligations that accumulates when individuals use AI as a substitute rather than a complement for first-principles cognition. The model features two state variables per agent, cognitive capital and cognitive debt, and a multiplicative production technology in which cognitive capital functions as collateral that determines the return to AI adoption. We establish six propositions. Rational agents incur positive cognitive debt because the costs are deferred, partially external, and masked by short-run productivity gains. Tranquil periods lower subjective risk assessments, raise AI substitution intensity, and compound leverage, generating a cognitive Minsky moment in which subjective risk falls while true systemic fragility rises. Expected crisis losses are convex in aggregate leverage. Post-crisis, output-target pressure can produce a false-correction loop in which agents patch AI failures with more AI. The decentralised equilibrium over-adopts substitutive AI relative to the social optimum because of systemic risk, cognitive public goods, and arms-race externalities. In a two-type heterogeneous-agent economy, high-cognitive-capital agents adopt AI more intensively and may eventually erode their unaided cognitive capital below that of initially lower-skilled agents.
Summary
Main Finding
The paper formalises "cognitive debt": a dynamic stock of unverified reasoning obligations that accumulates when agents substitute AI for first-principles cognition. Using a dynamic equilibrium model in which unaided cognitive capital multiplicatively determines AI returns and AI failures are common-mode, the author shows that rational agents optimally incur positive cognitive debt; tranquil periods depress subjective risk and raise AI substitution (a “cognitive Minsky moment”); crisis losses are convex in aggregate leverage; post-crisis responses can ratchet leverage upward; decentralised equilibria over-adopt substitutive AI relative to the social optimum because of three externalities; and heterogeneous agents can experience a reversal of fortunes (high-skill agents adopt more, erode skills faster, and may later hold less unaided capital).
Key Points
- Definition: Cognitive debt (b) = the stock of outputs/obligations produced with AI that an agent could not reproduce, verify, or correct unaided.
- Mechanism: Cognitive capital (k) multiplies AI productivity (y = k · G(a; q)). Thus marginal benefit of AI is proportional to k — cognitive capital is treated as collateral for AI leverage.
- Invisible risk and stress state: Debt is hidden in normal operation and only revealed under stress (AI outages, out-of-distribution tasks, audits). In the stress state, effective AI quality falls and debt is exposed as an output shortfall proportional to b and shock intensity z.
- Debt dynamics: k and b co-evolve. Unaided effort (1−a) builds k via learning-by-doing; deliberate practice x repays debt and rebuilds k. Debt compounds (rb > 0) and new debt issuance d(a) is convex in AI substitution a.
- AI quality & systemic correlation: Aggregate AI use and aggregate leverage reduce future AI quality (model collapse and propagation of unverified content). Crisis probability π depends positively on aggregate leverage Ω = B/K and on market concentration M (HHI).
- Belief updating & Minsky divergence: Agents update subjective crisis probability downward during tranquil periods using adaptive learning from observed crisis frequencies (ˆπ falls). Meanwhile true crisis risk π rises as leverage increases → cognitive Minsky moment: perceived risk down, true fragility up.
- Convex losses & fragility: Expected crisis losses are convex in aggregate leverage; economies with high leverage are disproportionately fragile.
- False-correction loop: After crises, competitive output pressure can make agents rationally patch failures by increasing AI use rather than rebuilding capital, producing ratcheting leverage (worse future crises).
- Externalities and policy: Decentralised equilibrium over-adopts substitutive AI due to (i) systemic risk externality, (ii) cognitive public-good externality (aggregate unaided capacity matters), and (iii) arms-race externality (others’ AI use raises competitive benchmarks). The optimal Pigouvian instrument is an AI-use tax indexed to the aggregate leverage ratio.
- Heterogeneity: High-k agents extract more from AI, adopt more, erode capital faster, and can end up with less unaided capital than initially lower-skilled agents. Heterogeneity amplifies aggregate fragility because crisis losses are convex in leverage.
Data & Methods
- Approach: Formal dynamic equilibrium model (continuum of agents). Two state variables per agent: cognitive capital k and cognitive debt b. Controls: AI substitution intensity a ∈ [0,1] and deliberate-practice x ≥ 0.
- Production:
- Normal state: yN = k · G(a; q), with G increasing and concave in a, Ga → ∞ as a → 0 (Inada).
- Stress state: yS = k · ˜G(a; q, z) − κ z b, where s(z) reduces effective AI quality and κ z b is debt exposure.
- State dynamics:
- k′ = (1−δ)k + ℓ(1−a) + ν x (learning-by-doing + deliberate practice)
- b′ = (1+rb) b + d(a) − ρ x (compounding + new issuance − repayment); b′ ≥ 0 enforced.
- Assumption rb > δ ensures compounding dominates passive depreciation at high a.
- AI quality dynamics: q′ declines with aggregate AI use and leverage: q_{t+1} ∝ (1 − γ Ā_t) · (1 + η Ω_t)^{-1} capturing model collapse and weaker verification.
- Crisis probability: πt = Π(Ωt, Mt) increasing and convex in leverage Ω, increasing in market concentration M; parametric form used for proofs (e.g., 1−e^{-λπ M Ω^γ}).
- Information: Agents observe personal outcomes and crises but not aggregate Ω; they update subjective stress probability with adaptive rule ˆπ_{t+1} = (1−λ)ˆπ_t + λ·1{crisis}.
- Solution strategy:
- Characterise individual first-order conditions (two-period analytic tractable case shown): marginal benefit of a equals discounted marginal cost (forgone learning + debt issuance). Deliberate practice equates marginal cost c′(x) to discounted future value of k and b changes.
- Derive six propositions (existence of interior a > 0 and positive debt; Minsky divergence; convex crisis losses; false-correction dynamics; social planner optimum and Pigouvian tax; heterogeneous-agent reversal of fortune).
- Empirical anchors: Experimental/field evidence cited (Noy & Zhang 2023; Dell’Acqua et al. 2023) showing short-run productivity gains but worse out-of-distribution performance for high-AI-reliance workers; model collapse literature (Shumailov et al. 2024) motivates aggregate degradation mechanism.
- No calibration or empirical estimation reported in paper (theory-first, proofs in Appendix). Two-period analytical model used for closed-form comparative statics; infinite-horizon treatment asserted to be qualitatively equivalent (appendix).
Implications for AI Economics
Policy and regulation - Internalise externalities: A Pigouvian tax on substitutive AI use indexed to aggregate leverage is the theoretically optimal instrument to correct systemic risk, public-good erosion, and arms-race pressures. - Reduce concentration: Lowering AI market concentration (diversifying model families, open evaluation datasets) reduces correlated failures and systemic fragility. - Support cognitive public goods: Subsidise or mandate investments that preserve unaided verification capacity (training, auditing, certification, public verification infrastructure). - Monitor leverage metrics: Policymakers and firms should track aggregate cognitive leverage Ω = B/K (or proxies) as a leading indicator of systemic fragility. Firm and labour-market design - Encourage complementarities: Design AI deployment and incentives to emphasise AI as a complement (tutoring, verification) rather than pure substitution to preserve k. - Incentivise deliberate practice: Firms should subsidise/mandate deliberate-practice activities and rotate tasks to prevent atrophy. - Performance benchmarks: Avoid competitive pressure structures that make agents/units adopt more AI to match peers (arms-race effect). Consider output evaluation that recognises unaided-capacity maintenance. Research and measurement - Empirical tests: Measure the Minsky divergence by tracking subjective risk assessments vs. objective proxies of fragility (crisis probability proxies, model failure rates) across tranquil and stressed periods. - Operationalise cognitive debt/leverage: Develop metrics for unaided skill stocks and AI-enabled obligations (e.g., pre/post task unaided tests, proportion of task steps automated, run-rate of unverifiable outputs). - Heterogeneity tests: Longitudinal studies to test the reversal-of-fortune prediction: do initially high-skill workers adopt more AI and later show larger declines in unaided skill? - Calibrate model: Use workplace experiments, platform logs (fraction of steps done by AI), model evaluation metrics, concentration (HHI for models), and skill assessment panels to estimate key functions (d(a), ℓ(.), Π(·), s(z), q dynamics). Welfare and macro considerations - Systemic fragility: Short-run productivity gains can mask growing systemic risk; macro policies should address endogenous risk accumulation from decentralised incentives. - Distributional effects: AI adoption can widen output inequality initially but compress the distribution of unaided cognitive capital over time, with potential adverse long-run welfare and resilience implications. Limitations and cautions - Adaptive learning specification: Results rely on agents using adaptive updating of perceived crisis risk (not full-information Bayesian filtering). Alternative learning rules could modulate the Minsky divergence magnitude and timing. - Modelling simplifications: The model abstracts from organizational strategies (insurance, inter-firm verification), AI heterogeneity beyond market concentration, and richer network structures for contagion. - Empirical identification: Measuring cognitive debt and aggregate leverage in real-world settings is nontrivial and will require careful operational definitions and longitudinal data.
Overall, the paper provides a parsimonious formal framework linking micro-level substitution of AI for unaided cognition to endogenous systemic fragility, and points to targeted policies (leverage-indexed instruments, concentration mitigation, and investment in verification capacity) to manage the aggregate risks of pervasive substitutive AI.
Assessment
Claims (8)
| Claim | Direction | Outcome | Confidence & Evidence | Details |
|---|---|---|---|---|
| The model features two state variables per agent, cognitive capital and cognitive debt. Other | null_result | model_structure (cognitive capital and cognitive debt as state variables) |
Reading fidelity
high
Study strength
medium
|
not reported
|
| The production technology is multiplicative and cognitive capital functions as collateral that determines the return to AI adoption. Other | null_result | return to AI adoption (determined by cognitive capital collateral) |
Reading fidelity
high
Study strength
medium
|
not reported
|
| Rational agents incur positive cognitive debt because the costs are deferred, partially external, and masked by short-run productivity gains. Automation Exposure | positive | cognitive debt (stock of unverified reasoning obligations) |
Reading fidelity
high
Study strength
medium
|
not reported
|
| Tranquil periods lower subjective risk assessments, raise AI substitution intensity, and compound leverage, generating a cognitive Minsky moment in which subjective risk falls while true systemic fragility rises. Adoption Rate | mixed | subjective risk assessments; AI substitution intensity; systemic fragility |
Reading fidelity
high
Study strength
medium
|
not reported
|
| Expected crisis losses are convex in aggregate leverage. Fiscal And Macroeconomic | negative | expected crisis losses |
Reading fidelity
high
Study strength
medium
|
not reported
|
| Post-crisis, output-target pressure can produce a false-correction loop in which agents patch AI failures with more AI. Adoption Rate | positive | AI adoption intensity (post-crisis increase) |
Reading fidelity
high
Study strength
medium
|
not reported
|
| The decentralised equilibrium over-adopts substitutive AI relative to the social optimum because of systemic risk, cognitive public goods, and arms-race externalities. Adoption Rate | negative | level of substitutive AI adoption relative to social optimum |
Reading fidelity
high
Study strength
medium
|
not reported
|
| In a two-type heterogeneous-agent economy, high-cognitive-capital agents adopt AI more intensively and may eventually erode their unaided cognitive capital below that of initially lower-skilled agents. Skill Obsolescence | negative | unaided cognitive capital (erosion) and AI adoption intensity across agent types |
Reading fidelity
high
Study strength
medium
|
not reported
|