AI widens firms' reach into distant knowledge but can hollow out radical discovery once automation is pervasive; beyond a threshold of AI automation firms shift from riskier, radical recombinations to safer incremental tweaks, and full automation risks eliminating originality altogether.
We study how artificial intelligence (AI) affects firms' incentives to pursue incremental versus radical knowledge recombinations. We develop a model of recombinant innovation embedded in a Schumpeterian quality-ladder framework, in which innovation arises from recombining ideas across varying distances in a knowledge space. R&D consists of multiple tasks, a fraction of which can be performed by AI. AI facilitates access to distant knowledge domains, but at the same time it also increases the aggregate rate of creative destruction, shortening the monopoly duration that rewards radical innovations. Moreover, excessive reliance on AI may reduce the originality of research and lead to duplication of research efforts. We obtain three main results. First, higher AI productivity encourages more distant recombinations, if the direct facilitation effect is stronger than the indirect effect due to intensified competition from rivals. Second, the effect of increasing the share of AI-automated R&D tasks is non-monotonic: firms initially target more radical innovations, but beyond a threshold of human-AI complementarity, they shift the focus toward incremental innovations. Third, in the limiting case of full automation, the model predicts that optimal recombination distance collapses to zero, suggesting that fully AI-driven research would undermine the very knowledge creation that it seeks to accelerate.
Summary
Main Finding
AI has ambiguous effects on the radicalness of firm-level R&D. Higher AI productivity tends to push firms toward more distant (radical) knowledge recombinations, but the share of R&D tasks automated by AI affects novelty non‑monotonically: at low-to-moderate automation firms target more radical recombinations, while beyond a human–AI complementarity threshold they shift toward incremental work. In the extreme of full automation the model predicts the optimal recombination distance collapses to zero — i.e., fully AI‑driven research can undermine the production of novel knowledge. These outcomes reflect four competing channels through which AI operates: two positive (direct facilitation of distant recombinations; GPT‑type diffusion that opens new shorter paths) and two negative (accelerated creative destruction that shortens monopoly rents; erosion of human–AI complementarity producing streetlight and stepping‑on‑toes effects).
Key Points
- Framework: recombinant innovation embedded in a Schumpeterian quality‑ladder (creative destruction) setting. Ideas sit in a graph knowledge space; distance captures cognitive dissimilarity and difficulty of combining ideas.
- Trade‑off for firms: farther (larger‑distance) recombinations are harder (lower success probability) but — if successful — yield higher payoff (more radical innovations); nearer recombinations are easier but pay off less.
- R&D is task‑based: a fraction α of tasks can be automated by AI (productivity m > 1); remaining tasks require human labor. Total research effort is held fixed for tractability.
- AI power (λAI) is modeled as a composite index: λAI = m · φ · α^κ · (1 − α)^{1−κ}, where φ and κ ∈ (0,1) capture returns and human–AI complementarity. This functional form embeds a potential non‑monotonicity: increasing α raises λAI up to a threshold (α ≤ κ) then reduces it when over‑reliance erodes complementarity (streetlight + stepping‑on‑toes).
- Four channels of AI:
- Direct facilitation: AI raises success probability of distant recombinations (positive).
- GPT/ diffusion effect: successful distant recombinations generate intermediate nodes/links, opening many subsequent incremental opportunities (positive).
- Competitive/destructive effect: AI raises aggregate innovation arrival rates, accelerating creative destruction and shortening monopoly durations (negative for risky long‑distance bets).
- Loss of originality/duplication: excessive automation concentrates search in data‑rich domains and induces convergence across actors (negative).
- Representative analytical result (under chosen functional forms p(d,λAI)=exp[−β d/λAI] and payoff γ(d)=d^η, η∈(0,1)):
Optimal target distance
d* = η / (β · [m φ α^κ (1 − α)^{1−κ}]).
Comparative statics:
- ∂d*/∂m < 0? (Note: because λAI enters denominator, higher m increases λAI and thus reduces exponent denominator; in the paper’s sign convention they report higher m encourages larger distance — see interpretation below.) The paper’s main interpretation: higher AI productivity encourages more distant recombinations when direct facilitation dominates competitive shortening of rents.
- Effect of α is non‑monotone due to α^κ(1−α)^{1−κ} term: initially raising α increases λAI (more radical choices), but beyond α=κ the product declines, shifting firms toward incremental targets.
- Important boundary: full automation (α → 1) can destroy human–AI complementarity and, combined with intensified competition, leads to d* → 0 (collapse to incrementalism).
- The model highlights that accounting for competitive dynamics (creative destruction) materially alters predictions relative to models that consider only individual researcher/firm productivity effects of AI.
Data & Methods
- Type: theoretical, analytical model with comparative statics and equilibrium analysis.
- Core model ingredients:
- Knowledge space: graph G = (I, D) with distances dij capturing cognitive dissimilarity.
- R&D production: task continuum ω ∈ [0,1], fraction α automatable; research effort R is a multiplicative aggregator of task outputs (Cobb–Douglas like across AI and labor blocks). For tractability total effort R is normalized.
- Costs: firms minimize input costs (wages and AI price μ) subject to required research effort; AI price μt modeled as increasing in knowledge stock (μt = μ̄ A_t) to allow balanced growth path.
- Innovation arrival: innovations result from recombinant attempts; empirical success probability p(d, λAI) decreasing in distance and increasing in AI power. In the full Schumpeterian extension, innovations arrive as Poisson processes and grant temporary monopoly rents until displaced.
- AI power λAI as above captures productivity m, task share α, and complementarity parameter κ.
- Functional forms used for key comparative statics:
- Success probability: p(d, λAI) = exp(−β d / λAI).
- Payoff of success: γ(d) = d^η, η ∈ (0,1).
- From first‑order condition the closed‑form d* is obtained and second‑order conditions verified.
- Analysis: derivation of optimal firm choice of recombination distance, embedding into quality‑ladder equilibrium to capture displacement and aggregate effects, proofs of balanced growth path existence/uniqueness and comparative statics with respect to m and α.
- Empirical operationalization suggested (not implemented): patent citation networks and semantic similarity measures to measure knowledge distances; firm‑level AI adoption measures and task automation shares to test model predictions.
Implications for AI Economics
- Direction of innovation depends on both AI capability and the extent of automation: policy and firm decisions that only maximize AI adoption can inadvertently reduce novelty if they erode human–AI complementarity.
- Creative destruction matters: aggregate populating of AI across firms raises the speed of displacement and reduces the expected payoff from radical, risky bets — an economy‑level externality that can bias firms toward safe, incremental research even when AI individually makes distant recombinations easier.
- Non‑monotonic adoption story: moderate AI adoption/augmentation can increase radical innovation (by enabling distant recombinations), but beyond a threshold it encourages consolidation into data‑rich domains and duplication — producing an inverted‑U relation between automation share and novelty.
- Full automation risk: extreme automation may collapse exploratory recombination and limit long‑run novelty and the GPT‑style diffusion that generates broad gains; maintaining some human involvement appears important for sustaining frontier‑pushing research.
- Policy levers and practical implications:
- Support human–AI complementarities (training, incentives for exploratory research, evaluation capabilities to filter AI suggestions).
- Monitor and mitigate duplication/stepping‑on‑toes effects (funding diversification, coordination mechanisms, data‑sharing rules).
- Consider AI pricing/subsidies and investments into AI capabilities that preserve exploratory potential rather than concentrate on data‑rich, incremental domains.
- Empirical work: measure recombination distances (citations/semantics), AI task coverage, and creative destruction rates to validate the model and identify the α threshold in practice.
- Broader growth implication: AI as an “invention in the methods of inventing” can be a double‑edged GPT — accelerating both the creation of new combinatorial links and the pace at which rents vanish. Accounting for competitive dynamics and human–AI complementarity is essential when forecasting long‑run innovation and growth impacts.
References in the paper: integrates and contrasts with recent theoretical work by Gans (2025a,b), Aghion & Howitt, and empirical studies on AI in science (Wang et al., Tranchero et al., Toner‑Rodgers, Lou & Wu), and positions the GPT/diffusion mechanism within the literature on general purpose technologies.
Assessment
Claims (6)
| Claim | Direction | Confidence | Outcome | Details |
|---|---|---|---|---|
| AI facilitates access to distant knowledge domains. Research Productivity | positive | high | access to distant knowledge domains (distance of recombinations) |
0.12
|
| AI increases the aggregate rate of creative destruction, shortening the monopoly duration that rewards radical innovations. Market Structure | negative | high | aggregate rate of creative destruction and monopoly duration (rents for radical innovations) |
0.12
|
| Excessive reliance on AI may reduce the originality of research and lead to duplication of research efforts. Creativity | negative | high | originality of research; duplication of research efforts |
0.12
|
| Higher AI productivity encourages more distant recombinations, if the direct facilitation effect is stronger than the indirect effect due to intensified competition from rivals. Creativity | mixed | high | recombination distance (degree of distance in knowledge-space targeted by firms) |
0.12
|
| The effect of increasing the share of AI-automated R&D tasks is non-monotonic: firms initially target more radical innovations, but beyond a threshold of human-AI complementarity, they shift the focus toward incremental innovations. Creativity | mixed | high | targeted recombination distance / radicalness of innovations as a function of AI-automation share |
0.12
|
| In the limiting case of full automation, the model predicts that optimal recombination distance collapses to zero, suggesting that fully AI-driven research would undermine the very knowledge creation that it seeks to accelerate. Creativity | negative | high | optimal recombination distance (approaches zero under full automation) |
0.12
|