Open-source AI-infrastructure projects experienced order-of-magnitude rises in pull-request volume and contributor counts since agentic tools emerged—driven almost entirely by humans—while review comments surged even as PR size stayed constant, signaling changing human–AI collaboration rather than automated takeover.

Main Finding

Across 33,228 merged pull requests (PRs) from two high-velocity AI-infrastructure repositories (vLLM and SGLang) spanning Feb 2023–Jun 2026, the authors document large, human-driven increases in development velocity and changing human–AI collaboration signals as agentic coding tools emerge. PR throughput and contributor counts rose dramatically, comment density rose sharply, cycle-time medians remained low while review-tail latency widened, and PR scope (lines/files changed) remained stable. Bot-authored PRs are negligible (<0.2%), so the surge is overwhelmingly human-driven rather than automated PR generation.

Key Points

• Data scope: full merged-PR populations — vLLM: 18,290 merged PRs (Feb 2023–Jun 2026); SGLang: 14,938 merged PRs (Jan 2024–Jun 2026).
• Era segmentation: four development eras aligned to AI-tooling milestones (Pre-Agentic → Early AI expansion → AI mainstream → Agentic emergence).
• PR throughput:
  • vLLM increased 21× from Era 0 → Era 3 (38 → 797 merged PRs/month); peak 1,156 merged PRs/month (Jun 2026).
  • SGLang increased 17.9× from Era 1 → Era 3 (42 → 743 merged PRs/month); peak 1,413 merged PRs/month (Jun 2026).
• Bot contribution:
  • Bot-authored merged PRs negligible: vLLM 31/18,213 (0.17%), SGLang 1/14,830 (0.01%).
  • Bot PRs contribute ≈0.0–0.17% of throughput growth — surge is human-driven.
• Cycle time:
  • Era-3 median: vLLM 1.04 days, SGLang 0.62 days.
  • Era-3 P90: vLLM 16.8 days, SGLang 14.3 days — large tail indicates heterogeneity; median alone hides long-review cases.
• Contributor dynamics:
  • Unique authors/month grew monotonically: vLLM +10.1 authors/month (r2=0.94), SGLang +11.2/month (r2=0.93); Era‑3 averages ~274 (vLLM) and 186 (SGLang).
  • New-author share in Era 3 ≈ 40% (per-month fraction of authors who are first-time contributors).
• Comment density:
  • Increased 4.2× (vLLM) and 3.8× (SGLang) across eras (issue comments per merged PR).
  • Estimated bot comments account for ~15–20% of this increase (era-specific estimates: 0%, 5%, 10%, 15%).
  • Note: comment counts exclude inline review comments and formal review events.
• PR size:
  • Median lines added in Era 3: vLLM 19, SGLang 22; median files changed ~2 — PR scope remained stable even as comment density rose.
• Methods highlights:
  • Data via GitHub Search API (opened/merged PR queries by month) and git log --shortstat from full clones.
  • Bot detection: GitHub user.type metadata + username substring checks; comment bot-share estimated via stratified and targeted sampling.
  • Statistical analysis: OLS for unique-author trends; era-level means; full-population metrics (no sampling for merged PRs).

Data & Methods (concise)

• Repositories: vllm-project/vllm (Feb 2023–Jun 2026), sgl-project/sglang (Jan 2024–Jun 2026).
• Full merged-PR populations analyzed (no sampling): 18,290 (vLLM) and 14,938 (SGLang).
• Metrics: monthly merged PR count, cycle time (median & P90), unique authors/month, PR comment density (issue comments only), monthly merge-rate (merged/opened flows), new-author share, PR size (lines/files changed).
• Era definitions anchored to public rollout dates of major AI coding/agent tools.
• Bot/human decomposition: user.type metadata + username pattern matching; comment bot-share validated with a 60-PR stratified baseline and a 10-PR targeted recent sample; era-specific bot comment-share percentages used to estimate human-only comment density.
• Limitations called out by authors: descriptive case analysis (no causal claims), comment-count measure excludes inline/review events, bot detection imperfect, the merged/ opened flow ratio can exceed 1 (different cohorts).

Implications for AI Economics

• Augmentation, not displacement (in these repos): The throughput surge is human-driven and accompanied by an expanding contributor base, contradicting a simple “concentration of contributions among a few AI-empowered engineers” hypothesis. Agentic tools appear to augment productive capacity and broaden participation in these high-adoption projects.
• Labor demand and task composition:
  • Rapid increases in merged PRs and comment density imply greater demand for review, coordination, and quality-control labor (human oversight tasks), not merely raw coding output.
  • Stable PR size with rising comment density suggests more coordination per unit of change — potentially raising non-coding labor intensity (reviewing, discussion, specification).
• Productivity measurement and compensation:
  • Standard productivity signals (median cycle time, PR count) understate tail risks; long P90 tails imply bottlenecks that can limit safe scaling. Economic models and incentives should monitor tail metrics (e.g., P90 review latency) and not only medians.
  • Firms/maintainers adopting agentic tools may capture faster throughput but must invest in reviewer capacity and governance to avoid quality/coordination failures.
• Returns to organizational capital:
  • Value may shift toward integration, review infrastructure, documentation, and onboarding mechanisms that convert broader contributor pools into sustained productivity—favoring investments in coordination technology and reputation/maintainer capacity.
• Market structure and platform competition:
  • Rapid adoption of agentic workflows will expand demand for complementary goods: reviewer tooling, provenance/audit utilities, and contributor-onboarding investments. This creates new markets and firms specializing in collaboration governance and safety for agentic workflows.
• Open-source sustainability and newcomer dynamics:
  • A ~40% new-author share and rising unique-author counts suggest agentic-era projects can attract more newcomers, but sustaining contributions likely requires deliberate onboarding and oversight investments (important for public-good software).
• Specific to biomedical AI agents and bioinformatics pipelines:
  • The combination of fast throughput and substantial review tails underscores a crucial point for life-sciences applications: automation can accelerate pipeline construction but cannot replace domain-expert validation. For biomedical agents and pipelines, silent errors have high risk; maintaining contextual continuity and strong human-in-the-loop review is essential.
  • Rising comment density (coordination) implies higher cognitive/coordination costs when integrating AI-produced or AI-assisted code into complex scientific workflows; economic value derives not just from automated execution but from human judgment and verification.
  • Policy and procurement in biomedical settings should prioritize auditability, provenance, and reviewer incentives when adopting agentic tools; markets that provide verifiable chain-of-evidence for analyses will be commercially valuable.

Practical recommendations (policy/managerial): - Track multidimensional metrics (throughput, median & P90 cycle time, unique contributors, comment density, PR-size) to capture both speed and review stress. - Audit and tag agentic contributions explicitly to enable causal evaluation and risk management. - Invest in reviewer capacity, onboarding, and provenance tools—especially critical in regulated or safety-sensitive domains like biomedicine. - Encourage reproducible, auditable PRs and toolchains to reduce downstream verification costs in scientific pipelines.

Caveats - Case-study design: two highly AI-adopting infrastructure repos — results may not generalize to other project types or ecosystems. - Some measurements (comment authorship, inline comments, exact AI authorship) are imperfectly observed; estimates rely on metadata and sampling. - Analysis is descriptive and correlational; causal links between tooling milestones and metric changes are not established here.