Autonomous coding agents speed some development tasks but do not replace engineering discipline; firms need stricter process controls, verification, and human gates. The paper proposes Agentic Agile-V and a SCOPE-V task loop to convert conversational prompts into verifiable engineering artifacts.

Main Finding

Agentic AI (coding agents that read repos, plan, run tools, and propose changes) can accelerate some engineering tasks but does not automatically improve outcomes. The primary bottleneck has shifted from prompts to process control: converting conversational intent into verifiable engineering artifacts and acceptance evidence. The paper proposes Agentic Agile-V (Agile-V lifecycle + SCOPE-V task loop) and an evidence-bundle acceptance model to close this gap.

Key Points

• Empirical pattern: adoption is already large-scale (AIDev reports 932,791 agent-authored PRs across 116,211 repos and 72,189 developers), but productivity effects are heterogeneous.
  • Google RCT: ~21% reduction in time on a complex enterprise task with AI assistance.
  • METR RCT: ~19% increase in completion time for mature open-source tasks.
  • 2026 meta-analysis: statistically significant but moderate average productivity effect with high heterogeneity.
• Main thesis: conversational discovery (chat) is useful for eliciting intent; structured artifacts, constraints, and evidence are required for safe, auditable implementation and acceptance.
• Proposed framework: Agentic Agile-V
  • Macro: Agile-V lifecycle (Agile iteration + V-model verification / traceability).
  • Micro: SCOPE-V task loop — Specify, Constrain, Orchestrate, Prove, Evolve, Verify.
• Concrete contributions:
• Taxonomy of minimum input artifacts (intent/scope, acceptance criteria, architecture context, constraints, execution context, evidence requirements, risk class) for software, firmware, and hardware tasks.
• Conversation-to-contract gate: convert exploratory chat into a reviewed execution brief before implementation.
• Risk-adaptive workflows and acceptance gates (R0 exploratory → R3 high-assurance), with required evidence bundles for higher-risk tasks.
• Practical task workflows for features, bug fixing, tests, firmware, embedded, and hardware/RTL work.
• Hardware/firmware limitations: benchmarks show weak system-level performance (e.g., RealBench low pass rates; some system Verilog tasks pass@1 = 0%), highlighting need for simulation, formal checks, HIL tests and strong traceability.
• Process and tooling recommendations: keep minimal, decision-relevant repository instructions (e.g., concise AGENTS.md), require planning and tests inside agent loops, separate exploratory agents from implementation/verification agents, build tooling for evidence generation and auditability.

Data & Methods

• Method: bounded evidence synthesis (qualitative synthesis across heterogeneous sources), not a pooled meta-analysis.
• Four evidence streams included:
• Agentic software-engineering surveys and tool papers (OpenHands, GitHub agent workflows, etc.).
• Empirical studies of developer productivity and agent-authored pull requests (Google RCT, METR RCT, AIDev, Claude Code analyses).
• Repository-configuration and execution-environment studies (AGENTS.md and repo config empirical studies, RepoMaster, Git-TaskBench).
• Hardware/firmware and verification benchmarks (RealBench, FIXME, EDA/hardware surveys).
• Inclusion criteria: source must address agentic code generation, repository-aware execution, productivity, configuration/state gating, hardware generation/verification, traceability, or acceptance evidence.
• Representative empirical findings cited in the synthesis:
  • AIDev: 932,791 agent-authored PRs (116k repos, 72k developers).
  • Google RCT: ~21% faster on an enterprise task.
  • METR RCT: ~19% slower on mature open-source tasks.
  • OpenHands + Claude 3.7: solved ~48.15% of repository tasks in Git-TaskBench.
  • Configuration-file studies: mixed effects—can reduce runtime/token use but can also worsen success if mismatched.
  • Hardware benchmarks (RealBench/FIXME): very low pass rates on real-world Verilog/system-level tasks.

Implications for AI Economics

• Heterogeneous productivity effects → uncertain macro gains:
  • Empirical heterogeneity (enterprise vs. mature open-source) implies that aggregate productivity/AI-driven GDP effects are likely context-dependent and may be smaller than optimistic forecasts that ignore process frictions.
• Shifted bottleneck raises new economic margins:
  • Value shifts from raw code synthesis to process design, verification capacity, and evidence generation. Firms that invest in these capabilities (test infrastructure, traceability, environment provisioning) capture more of the agentic productivity potential.
• Labor demand and skill composition:
  • Increased demand for verification, test-engineering, devops, and process engineers who can design acceptance gates, CI/HIL pipelines, and evidence bundles.
  • Possible reallocation rather than pure substitution: junior/rote coding tasks may be automated in some contexts, but experienced engineers’ time may be reallocated to higher-complexity verification and architecture.
• Transaction and coordination costs:
  • Agentic workflows raise coordination costs (review load, verification debt). If verification capacity does not scale with generated output, maintenance and rework can erode gains—reducing net productivity improvement and increasing organizational frictions.
• Risk and tail-costs affect adoption economics:
  • Hardware/firmware domains have high tail-risk and regulatory exposure; expected benefits require larger investments in formal verification and HIL, increasing upfront costs and lengthening payback periods.
• Product and tool-market implications:
  • Market opportunity for tools that produce auditable evidence bundles, structured-brief editors, repository environment capture, and risk-classification/permission gating. Pricing can reflect value from reducing verification cost and audit risk.
• ROI and adoption strategy:
  • Firms should treat agentic tool adoption as a process-change investment (not plug-and-play). High ROI likely where tasks are well-scoped, reproducible, and low to medium risk; lower or negative ROI in mature, tightly-coupled codebases or safety-critical hardware without commensurate verification investment.
• Policy and regulation:
  • Traceability and audit artifacts become economically important for regulated industries; compliance costs may increase if tools do not natively produce verifiable evidence.

Overall: Agentic AI can shift productivity frontiers, but realizing sustained economic gains requires investments in process control, verification capacity, and tooling that generates traceable evidence. Failure to make those investments risks verification debt, rework, and lower-than-expected returns.