Generative coding agents lift output and speed in open-source communities, but benefits concentrate among already-active contributors and much work moves into private agent loops, leaving public documentation far less useful for later contributors.

Main Finding

Introducing generative coding agents (CAs) into an open-source developer community raises short-term productivity and reduces task completion time, but adoption is limited and gains concentrate among already-active, well-connected developers. Crucially, much work shifts from public human collaboration into private human–agent loops, producing public records that are substantially less useful as reusable community knowledge — revealing a productivity vs. public-knowledge trade-off.

Key Points

• Productivity and speed
  • Planned tasks ↑ 34.0% (3,151 → 4,221); completed tasks ↑ 39.0% (2,969 → 4,128).
  • Median task completion time falls from ≈45 min to ≈20 min; 75th percentile drops 90 → 45 min.
• Adoption and concentration
  • CA awareness rises 16.0% → 36.3%; CA adoption reaches 26.0% by simulation end.
  • CA-assisted commits grow from 25.6% → 65.0% of commits, but only a minority of developers adopt CAs.
  • Productivity gains concentrate among developers already more active / well connected (a “participation amplifier”).
• Interaction-mode reconfiguration
  • Tasks classified into four modes: HHI (human–human interaction), HSA (human self-loop), AHI (agent-assisted human-to-human), ASA (agent-assisted self-loop).
  • Direct human–human interaction (HHI) falls from 32.4% → 11.6% of completed tasks under CA.
  • CA-involved modes account for 57.3% of completed tasks; ASA (developer–agent self-loops) alone = 40.3%.
• Public knowledge and retrievability
  • On a standardized retrieval benchmark, real-human public corpus: 81.1% knowledge coverage; CA corpus (size-matched): 22.3%.
  • Average retrieval steps increase 2.63 → 8.02; retrieval success drops from 82.3% → 22.3%.
  • Result: more code is produced but public artifacts are less informative/useful for later contributors.
• Overall interpretation
  • CAs boost technical throughput but reduce observable collaboration and weaken public knowledge spillovers that sustain OSS communities.

Data & Methods

• Data and sample
  • Source: public GitHub Developer dataset; snapshot anchored to activity Jan–Mar 2018.
  • Selected 1,084 developers with sustained activity (criteria: weekly commits, ≥50 historical commits, ≥3 non-fork repos, etc.).
  • Constructed repo-based collaboration graph (edges connect developers who contributed to same repo).
• Agent construction
  • Each developer modeled as an LLM-driven agent with: quantitative activity history, LLM-generated biographical profile, and an Innovation Diffusion Theory (IDT) adoption category.
  • Warmup: 4 weeks of real commits (Jan 21–Feb 18, 2018) injected as few-shot in-context examples to build recent state and behavior.
  • Daily agent workflow: Query (inspect repo & tasks) → Act (perform tasks; in CA branch CA can act on developer's behalf) → Reflect (update memory/preferences).
• Intervention / simulation design
  • Two parallel 4-week counterfactual branches (Feb 19–Mar 18, 2018): No-CA (agents told CA unavailable) vs CA (coding agent available).
  • CA diffusion seeded by developers with broad language exposure (≥7 languages) and activity (≥15 commits) during warmup; further adoption governed by IDT class and exposure.
  • Models used: primary DeepSeek V4; robustness checks with GLM-5.1 and Qwen3. Three independent runs per condition; prompts provided in supplement.
• Validation and metrics
  • Simulation preserves aggregate activity: MAE = 1.86, RMSE = 3.80; mean activities per developer close to empirical (31.0 vs 32.2).
  • Preserves developer heterogeneity (Gini comparisons), with slight amplification of concentration.
  • Mode classification (HHI/HSA/AHI/ASA) used to quantify shifts in interaction pathways.
  • Knowledge retrievability benchmark: standardized queries to measure coverage, retrieval steps, and success rate on corpora constructed from public artifacts under each condition.
• Limitations (acknowledged)
  • Simulation-based, short-term (4-week intervention) counterfactual; not a field experiment.
  • Snapshot from 2018; generalization to present/future ecosystems and different LLM families remains to be validated.
  • Modeling choices (seed adoption rules, CA behavior, visibility assumptions) affect outcomes; private human–agent interactions are approximated, not observed directly.

Implications for AI Economics

• Productivity vs. public-good externalities
  • CAs raise private productivity but reduce public knowledge spillovers (lower retrievability and utility of public artifacts). This represents a negative externality on the community’s knowledge capital — increased output quantity but reduced reusable public information.
• Distributional and market impacts
  • Concentration of CA adoption and gains among already-active contributors can exacerbate inequality of contribution and influence within OSS ecosystems, potentially reallocating reputation and economic returns toward network-central actors.
  • This “participation amplifier” suggests complementarities between CAs and existing human capital: high-skill/connected developers capture most benefits, while others may see fewer gains or even face higher coordination costs.
• Incentives, governance, and platform design
  • Platforms and projects may need incentives or rules to preserve public value (e.g., canonical summaries of agent-assisted reasoning, mandatory provenance/metadata for CA-assisted commits, or standardized logs of intermediate steps) to maintain knowledge spillovers.
  • Economic policy and platform governance could consider subsidizing documentation or mandating transparency for agent-mediated work to internalize the negative externality.
• Measurement and evaluation
  • Standard productivity metrics (commits, tasks, time-to-complete) can overstate social welfare when public-knowledge effects are ignored. Empirical evaluation of AI tools should incorporate metrics for knowledge retrievability and collaborative visibility.
• Labor and long-run dynamics
  • Short-term efficiency gains may change task allocation and skill requirements: routine or self-contained tasks may shift to agent-mediated workflows, while more collaborative, boundary-spanning, or discovery-oriented tasks may retain human–human coordination needs.
  • Over time, diminished public documentation could raise onboarding and coordination costs, harming long-term project sustainability and possibly reducing cumulative returns to OSS as a public good.
• Policy levers and research directions
  • Design interventions: require/encourage public summaries of agent reasoning; provide tool support that records structured provenance; reward public knowledge contributions.
  • Empirical work: field experiments and longitudinal studies to measure real-world adoption dynamics, welfare impacts, and whether platform-level interventions mitigate the productivity–public-knowledge trade-off.
  • Economic modeling: quantify social welfare losses from reduced spillovers, estimate optimal policy (subsidies, standards, liability), and analyze distributional consequences for contributors and firms relying on OSS.

Summary takeaway: CAs can substantially raise developer throughput, but their private, agent-mediated workflows risk undermining the public-knowledge infrastructure that makes open-source communities resilient and scalable. Evaluations of agentic tools should therefore go beyond individual productivity to include public-good and distributional effects — and platform/policy responses may be needed to preserve community-level knowledge capital.