Coding agents increase development velocity by roughly 28–38% across repositories, but repositories that did not commit AI configuration suffer far larger quality declines—about a twofold rise in cognitive complexity (≈+53% vs +27%) and a 1.7× increase in static-analysis warnings—while repositories with committed AI configuration show attenuated quality costs.

Main Finding

Adopting autonomous coding agents increases development velocity across repositories, but repositories that commit AI configuration artifacts (higher RAMP maturity) experience substantially smaller quality degradations. Using a new, version-control–grounded maturity scale (RAMP), the authors find agents yield 28–38% more commits on average, while increases in cognitive complexity and static-analysis warnings are roughly twice as large in repositories without committed AI configuration (e.g., +53% vs +27% complexity; ~1.7× more warnings).

Key Points

• RAMP (Repository AI Maturity Profile): a four-level, cumulative maturity model based on committed repository artifacts:
  • L1 — Unconfigured: no AI-related files committed.
  • L2 — Grounded: behavioral rules, configs, architecture, coding-style docs (gives project context).
  • L3 — Agent-Augmented: named agents, reusable commands, skill guides (reusable capabilities).
  • L4 — Orchestration: multi-agent workflows, pipelines, session logs (coordination).
    (L4 is defined but rare in the development sample.)
• Classification pipeline:
  • Artifact discovery via 43 filename/path patterns covering 12 AI coding tools (e.g., Claude, Cursor, Copilot, Gemini CLI, JetBrains AI, etc.), plus cross-tool and markdown sweeps.
  • Semantic classification into 9 categories using an ensemble: deterministic tool-pattern match (highest priority), path-token embedding similarity, and content-text embedding similarity. Embeddings used: nomic-ai/nomic-embed-text-v1.5.
  • Repository maturity = highest level with ≥1 artifact (cumulative).
• Validation and scale:
  • Development dataset: 441 private corporate repositories (27 orgs); ~4,300 candidate artifacts; 1,046 validated AI artifacts across 217 repos.
  • Guttman scalogram analysis confirms cumulative hierarchy of observed levels.
  • Human annotation reproduces classifier labels on a held-out sample: 97% agreement (34/35 repos). Reported classifier reliability CR ≈ .997.
• Adoption dynamics (Study 1):
  • Adoption is cumulative (higher levels typically include lower-level artifacts), forward-only, and predominantly set-and-forget: 73.8% of artifacts are committed once and never modified.
  • Maturity is therefore a stable, observable repository property usable for stratification.
• Outcomes stratified by RAMP (Study 2):
  • Re-analyzing an agent-adoption panel (Agarwal et al.) stratified by RAMP shows:
    • Velocity gains from agents are robust across maturity strata (roughly +28–38% commits).
    • Quality costs concentrate in lower-maturity repos: in the agent-first stratum (where contrast is identified), Level 1 repos without committed AI configuration show ~2× larger increases in cognitive complexity (+53% vs +27%) and ~1.7× larger increases in static-analysis warnings compared to Level 2+ repos.
• Causal caveat: RAMP is observational. Correlated factors (engineering discipline, developer skill, model capability, prior processes) may explain part of the heterogeneity; findings are presented as hypothesis-generating.

Data & Methods

• Datasets:
  • Development sample: 441 private GitHub repositories from 27 commercial organizations; initial sweep returned 30,216 candidate artifacts across 1,931 repos, filtered down to ~4,300 candidate files and 1,046 validated artifacts in 217 repos.
  • Study 1 temporal subset: 196 repositories with reconstructed git histories used to characterize transitions.
  • Study 2 (outcomes): applied RAMP to the open-source agent-adoption panel from Agarwal et al.; of 518 agent-adopting repos, 9 lacked accessible snapshots; remainder classified (≈509 treated repos).
• Artifact discovery:
  • Hierarchical search: tool-specific patterns (43 patterns across 12 tools), cross-tool patterns at tool directories and repo root, then non-standard markdown sweep for discovery stats.
  • Filters removed single-artifact repos, boilerplate project files, outlier template repos, and near-duplicates.
• Semantic classification:
  • Nine category templates (rules, configuration, architecture, code-style, agents, commands, skills, flows, session-logs, plus a general-documentation fallback).
  • Text embedded via nomic-ai/nomic-embed-text-v1.5 (768-d vectors; long-window support).
  • Priority ensemble: tool-pattern → path-embedding cosine similarity → content-embedding cosine similarity. Content used when path absent or signals disagree.
• Level assignment: cumulative max-level with ≥1 artifact.
• Validation:
  • Guttman scalogram and other reliability checks on development set.
  • Human annotation of held-out repos: classifier reproduced labels for 34/35 repos (97%).
• Statistical analysis (Study 2):
  • Re-estimation of existing staggered difference-in-differences agent-adoption panel, stratified by RAMP level, to estimate heterogenous treatment effects on velocity (commits, LOC) and quality (cognitive complexity, static-analysis warnings, duplication).

Implications for AI Economics

• Heterogeneous returns to AI tooling: The productivity gains from coding agents are broadly positive but accompanied by heterogeneous quality costs that depend on observable repository practices. This implies nontrivial dispersion in economic returns to AI adoption across teams/firms.
• Investment in configuration as economic capital: Committing behavioral rules, configuration, and reusable agent artifacts appears to moderate downstream quality costs. These artifacts function like a low-cost governance/coordination investment that reduces technical-debt externalities from agent-generated work.
• Persistent, path-dependent heterogeneity: Adoption is “set-and-forget” and forward-only for most artifacts, implying that early choices about AI configuration can create persistent differences in realized productivity-quality trade-offs across teams—relevant for firms optimizing AI deployment strategies.
• Measurement and causal inference: RAMP provides a concrete, version-control–based instrument to measure practice maturity, enabling stratified analyses of AI adoption ROI, cost of technical debt, and labor-productivity trade-offs. However, the current findings are correlational; causal claims about the protective effect of maturity require randomized or quasi-experimental validation (e.g., instrumenting for configuration investments or running controlled rollouts).
• Management and policy takeaways:
  • Firms and teams should consider investing in minimal committed AI configuration (rules, configs) as a low-friction governance mechanism to capture velocity gains without incurring as much quality degradation.
  • Tool vendors and platform designers could lower adoption frictions by making project-aware configuration easier to create, test, and version.
  • For economic modeling of AI adoption, incorporate heterogeneity in practices (RAMP-type measures) when estimating benefits, technical-debt costs, and labor reallocation effects.
• Future research directions relevant to AI economics:
  • Causal evaluation of whether deploying committed AI configuration reduces long-run maintenance costs and total cost of ownership.
  • Cost–benefit modeling of the upfront labor and coordination required to create RAMP artifacts versus expected savings in review, rework, and maintenance.
  • Firm-level studies connecting RAMP maturity to hiring, compensation, and team structure decisions shaped by agent adoption.

Limitations: observational maturity measurement — confounding by unobserved team capabilities and model/tool differences remains possible. RAMP is released as a reusable instrument to enable further causal and economic studies.