Group-level selection of prompts drives cooperation among simulated LLM agents, while individual-level selection causes collective defection; a matching analytic model and robustness checks reveal a critical threshold for prosociality and model-specific anticipatory responses (notably in GPT-5.4).

Main Finding

Group-level selection on natural-language strategy prompts causes populations of LLM agents to evolve prosocial prompts and sustain cooperation in repeated social-dilemma interactions, whereas individual-level selection drives populations to collapse into collective defection. A matching replicator–mutator model parameterized by empirically observed mutation/transmission behavior reproduces this result and predicts a phase transition: above a critical weight on group fitness (and/or sufficient selection strength) cooperation becomes the stable equilibrium.

Key Points

• Experimental result: In multi-generational simulations (50 generations) of agents playing a donor game, populations with selection operating at the group level (α = 1) develop and stabilize at substantially higher average donation rates than populations selected by individual fitness only (α = 0). The cooperation gap is robust across selection strengths (replacement rates β), prompt ablations, alternative framings, and model swaps.
• Selection strength matters: Higher replacement rates (larger β) amplify the group-selection effect; at β = 0 (no selective filter) both regimes converge, confirming the effect is selection-driven rather than drift.
• Emergent cultural transmission: Agents transmit only a natural-language strategy string (prompt) across generations; LLM-mediated copying is imperfect (high mutation), but group selection still generates between-group variation sufficient for cooperation to spread.
• Theoretical match: A multi-level replicator–mutator model using the empirically extracted mutation kernel Q and initial distribution p(0) reproduces the two-regime dynamics and the dependence on α and β, and predicts a reversible phase transition at a critical threshold of the selection parameters.
• Model heterogeneity & anticipation: Outcomes are model-dependent but qualitatively consistent. Notably, when some models (GPT-5.4) were given explicit information about the selection mechanism, they showed anticipatory adjustment—preemptively shifting first-generation donations—an effect not seen in other tested models.
• Strategy diversity: Phylogenetic analyses show divergence into distinct lineages: cooperative branches dominate under group selection, while defecting branches dominate under individual selection, with mutation producing ongoing variation but not eliminating the regime separation.

Data & Methods

• Simulation architecture:
  • Agents: Stateless LLM-driven actors whose only heritable element is a free-form natural-language strategy string s_i. LLM calls were used to (i) generate generation-0 prompts, (ii) make donation decisions, and (iii) mediate transmission (parent → offspring) with imperfect copying.
  • Game: Repeated donor game. Donors choose donation percentages p ∈ {0, 5, 10, …, 100}; transferred amount d = (p/100) · e_t; receiver receives a · d. Parameter example used in main experiments: multiplier a = 1.5, group size g = 4. Pairing: either unrestricted (individual mode) or restricted to within-group (group mode).
  • Decision & transmission protocol: Two-step LLM calls—(1) free-text deliberation, (2) numeric commitment—so actions are interpretable. Transmission likewise used a reasoning step and strategy-formulation step to produce offspring prompts.
• Evolutionary parameters:
  • Multi-level fitness: f_i = (1 − α) · individual payoff + α · group mean payoff, with α ∈ [0, 1] controlling weight on group vs individual selection.
  • Replacement/selection strength: truncated selection removes the bottom β fraction each generation; offspring allocation among survivors is by individual rank. β ∈ {0, 0.2, 0.4, 0.6, 0.8} tested.
  • Population structure: N agents partitioned into M groups (example experiments used g = 4). 50 generations per run; multiple replications (see paper for replication counts).
• Models and calibration:
  • Baseline LLM: Qwen3-30B-A3B-Instruct-2507 used across initialization, decision, and social learning for main runs; additional model families tested for robustness.
  • Empirical mutation kernel Q and initial distribution p(0) were extracted from baseline runs and used to parameterize a discrete replicator–mutator model (x'_j = Σ_k x_k (f_k,β / f̄) Q_kj).
• Robustness checks: prompt ablations, alternative game framings, model swaps; statistical tests confirm regime differences (Holm-corrected p < .001 for reported contrasts).

Implications for AI Economics

• Selection/regime design matters for multi-agent systems: Whether incentives operate at the individual agent level or at some higher-level (group, firm, platform) can qualitatively change emergent behavior. Systems that optimize agents solely for individual, verifiable outcomes risk producing large-scale coordination failures and wasted effort when agents share environments or resources.
• Mechanism design & organizational structure:
  • To foster cooperative outcomes in deployed LLM-agent ecosystems (e.g., software engineering teams, distributed agent markets, automated workflows), designers and platforms should consider selection mechanisms that reward group-level performance (team-level metrics, shared bonuses, platform-level KPIs) or otherwise create meaningful between-group variation.
  • Simple per-agent reward engineering (outcome-based training) may be insufficient or counterproductive for social efficiency; population-level/market-level incentives or governance interventions may be necessary.
• Policy and governance implications:
  • Regulators and platform operators should account for population dynamics and cultural transmission via prompts/conditioning. Policies that unintentionally strengthen individual-level returns (e.g., billing or ranking by individual task throughput) can erode cooperation across deployments.
  • Anticipatory behavior (models that adjust when told about selection rules) suggests agents could be strategically responsive to meta-level cues—raising the need for careful disclosure, auditing, and robustness testing of incentive signals.
• Economic externalities and efficiency:
  • Cooperation failures translate into duplicated work, compute waste, and reduced aggregate surplus in multi-agent deployments. Group-level incentives can reduce these negative externalities and improve total surplus if designed to preserve between-group variance and penalize exploitative strategies.
• Cautions & risks:
  • Group-selection mechanisms can be weaponized: group-level incentives could induce collusion or exclusionary behaviors across firms or agents if not constrained.
  • Results depend on LLM priors and mutation fidelity; real-world deployments will face richer environments, more diverse objectives, and different channels of transmission (not just prompt copying). High mutation rates in prompt transmission may limit or alter the speed of convergence in practice.
• Practical next steps for practitioners and economists:
  • When designing multi-agent systems, explicitly model selection-levels (individual vs group vs hybrid) and run population-level simulations before deployment.
  • Consider hybrid mechanisms (interpolated α) and tune selection strength (β) to balance innovation and cooperative stability.
  • Monitor for anticipatory strategic behavior in advanced models and design audit and disclosure regimes that prevent gaming of meta-incentives.
  • Investigate institution-level interventions (platform rules, team-level compensation, enforced interaction structures) that create the between-group variance necessary for beneficial group-selection effects to operate.

Limitations to keep in mind: the experiments use stateless LLM calls with prompts as the only heritable trait, focus on a single canonical donor game, operate at high LLM-induced mutation rates, and show model-family dependence. Translating these dynamics to real-world multi-agent economic systems requires further modeling of richer environments, longer memory, and heterogeneous objectives.