AI coding assistants speed up code production but increase the volume and complexity of code needing review; the authors propose a five-stage, agent-driven review workflow that keeps humans at key quality gates to preserve judgment and accountability while aiming to boost review throughput and safety.

Main Finding

AI-assisted coding accelerates code production but amplifies and reshapes the bottleneck of pull-request (PR) based code review. Stage-level AI tools (comment generation, reviewer recommendation, PR description generation) are helpful but insufficient: effective review requires an end-to-end, context-preserving workflow. The authors propose a vision for "agentic code review"—a coordinated multi-agent + human workflow spanning five stages (PR Creation, PR Augmentation, Reviewer Selection, AI-Assisted Code Review, PR Retrospective)—where specialized AI agents carry context across stages while humans retain decision authority at key quality gates. They also identify core technical and socio-technical risks (reliability, bias, privacy, automation bias, transparency, evaluation) and outline a research agenda for responsible adoption.

Key Points

• Historical synthesis: code review evolved through five eras (Ad hoc → Formal inspections → Lightweight peer review → Integrated PR-based review → Automation-assisted review). Each era shifted trade-offs between rigor, velocity, and coordination.
• AI changes the economics of review: coding assistants increase output velocity (cited >50% productivity gains) but increase volume and complexity of changes requiring review; AI-generated code often needs more review iterations and can shift reviewer attention toward low‑severity issues.
• Limitation of stage-specific tools: isolated AI tools improve parts of the workflow but fail to propagate rationale, behavioral context, and learned lessons across stages; effective review quality is a lifecycle outcome, not a per-stage artifact.
• Proposed five-stage agentic workflow:
• PR Creation — capture rationale, intents, high-level constraints (seed human-AI context).
• PR Augmentation — synthesize tests, change impact maps, summarized diffs, safety/risk tags.
• Reviewer Selection — recommend reviewers using richer behavioral/context signals and predicted expertise.
• AI-Assisted Code Review — specialized agents (static analyzers, LLM-based reviewers, risk analysers) produce structured findings; human reviewers act as quality gates.
• PR Retrospective — store causal evidence, lessons, and meta-data to inform future reviews and reviewer models.
• Human-in-the-loop design principle: keep humans at authority/approval points to preserve accountability, team understanding, and mitigate automation bias.
• Major adoption challenges: model reliability and brittleness, distributional bias, privacy/leakage of proprietary code, automation bias and over-reliance, lack of transparency/explainability, unclear benchmarks and evaluation frameworks for end-to-end review systems.
• Research agenda highlights: lifecycle evaluation metrics (error detection rates, downstream defect costs, review throughput, knowledge transfer), longitudinal studies of human-AI authority, reproducible benchmarks, risk-aware reviewer matching, and methods for auditing/traceability.

Data & Methods

• Paper type: conceptual vision + literature review. No primary empirical dataset or experimental results.
• Methods used:
  • Historical review of code-review practices across eras, synthesizing empirical and theoretical prior work.
  • Survey of recent AI/ML contributions relevant to individual review stages (e.g., comment generation, reviewer recommendation, PR description generation, agentic multi‑agent review prototypes).
  • Conceptual design of a coordinated, multi-agent workflow (the five-stage framework) grounded in cited literature and identified pain points.
  • Identification of open technical and socio-technical challenges and formulation of a research agenda and evaluation recommendations (proposed metrics, study designs, and authority questions).
• Evidence base: prior empirical studies and tool descriptions from software-engineering literature; no new quantitative experiments.

Implications for AI Economics

• Productivity vs. Coordination: LLMs raise coder-level productivity but create a downstream coordination and review bottleneck. Aggregate productivity gains from AI are constrained by review capacity—implying diminishing returns unless review processes scale or are re-designed. Measuring the true productivity gains of AI requires accounting for review/coordination costs and iteration overheads.
• Task reallocation and skill premium: Agentic review will shift labor from low-level, repetitive review tasks toward higher-level judgment, risk assessment, and orchestration roles. Demand for reviewers with expertise in auditing AI outputs, model-risk management, and systems-level reasoning may increase, raising skill premia for those abilities.
• Labor complementarities and substitution: Specialized review agents can substitute for routine checks (static analysis, trivial style issues), while complementing human reviewers on complex architectural and socio-technical judgments. This creates heterogeneous effects across occupations and firms depending on how much of review can be automated reliably.
• Quality externalities and liability: If AI accelerates code production but reviewers over-rely on AI agents or automated gates miss high-severity defects, firms incur external costs (downstream failures, outages, security breaches). This raises demand for monitoring, audit trails, insurance mechanisms, and potentially new liability models—affecting contracting and pricing in software markets.
• Capital vs. labor decisions: Investing in agentic review infrastructure (multi-agent platforms, provenance/retrospective storage) is a capital expenditure that can generate scale economies (lower marginal cost of review per PR) but requires upfront investment and governance. Firms must weigh these investments against hiring/training reviewers and the risk of model failures.
• Market for review services and reputation signaling: As review becomes partly agentic, markets may emerge for certified reviewer models, audit services, or “review-as-a-service” providers offering reliability guarantees. Reputation systems and verifiable retrospective logs become economic assets.
• Measurement and valuation challenges: Standard productivity metrics (lines of code, commits) become misleading. Economic analysis needs new metrics that internalize review quality, defect rates, review iteration costs, and risk-adjusted outputs. Empirical work should quantify how much of AI-driven coding output is economically usable after review and the equilibrium price of review capacity.
• Policy and regulatory implications: Elevated systemic risk (e.g., widely deployed buggy/biased code) may justify industry standards for auditability, provenance, and minimum review requirements, with economic consequences for compliance costs and competitive dynamics.

Suggested empirical questions for AI economists arising from the paper: - How do per-developer output gains from AI translate into net firm-level productivity after accounting for incremental review costs? - What are the price elasticities and wage effects for reviewer roles with increasing automation? - Under what conditions do investments in agentic review infrastructure dominate hiring more human reviewers? - How large are the externalities (security incidents, outages) from under-reviewed AI-produced code, and what insurance/contract models mitigate them?

Overall, the paper reframes code review from a localized quality task into a lifecycle, coordination-intensive economic bottleneck in AI-augmented software production—one that determines how much value AI coding assistants can realize in practice.