AI-only sprint planning cuts time and cost but increases missed risks and rework; hybrid AI–human planning preserves efficiency while keeping humans responsible for risk assessment and ambiguity resolution.

Main Finding

AI-only sprint planning reduces time and apparent per-point cost but substantially degrades risk capture and increases rework from unstated/context-specific assumptions. A hybrid model — AI for estimation/formatting plus mandated human-led risk deliberation — recovers robustness at a negligible total-cost premium and produces a superadditive improvement in risk identification and overall planning quality.

Key Points

• Primary comparison: three-condition controlled experiment (AI-only, human-only, hybrid) at a mid-sized digital agency on a standardized 47-point web deliverable across three two-week sprints.
• Quantitative highlights (best performer):
  • Planning time: AI-only 0.38 hrs (best)
  • Total completion time: AI-only 78.5 hrs (best)
  • Cost per story point: AI-only $78.50 (best)
  • Forecast error: Hybrid 3.8% (best)
  • Rework rate (overall): Hybrid 8.6% (best)
  • Documented risks: Hybrid 13 (best)
  • Risk capture rate: AI-only 36.4%, Human-only 78.6%, Hybrid 86.7% (hybrid best)
  • Scope-change recovery time: Hybrid 3.2 hrs (best)
  • Blind client preference: Hybrid
• Economic reframing (Total Cost of Delivery, TCD):
  • AI-only total: $4,229.06
  • Human-only total: $4,878.60
  • Hybrid total: $4,272.30
  • Hybrid is only 1.0% ($43.24) more than AI-only while delivering much higher robustness (138.2% improvement in risk capture rate).
• Key failure mode: AI-only condition captured 0% of novel/context-specific risks; several materialized problems were outside the AI’s training distribution and thus not flagged.
• Synergy effect: hybrid condition identified more risks than either AI or human alone (13 vs. 4 and 11), attributed to cognitive scaffolding — AI structure mitigates availability bias while mandated human review elicits contextual knowledge.
• Statistical notes: paired t-tests show meaningful effects (e.g., risk capture and rework differences) but sample size is small (N = 3 sprints per condition), so inference is preliminary.

Data & Methods

• Context: Vierra Digital, Agile Scrum teams; three matched teams (PO, SM, 4 developers), no cross-condition participation; blended rate $47/hr; IRB-exempt.
• Deliverable: semi-complex landing page (47 story points) across three sprints; identical scope and specs across conditions.
• Conditions:
  • AI-only: all planning delegated to Claude Sonnet 4.6; human team executed the output without planning input.
  • Human-only: conventional Planning Poker, human-led risk discussions.
  • Hybrid: AI generated backlog/forecast/risk log; humans validated estimates and ran a mandatory structured risk-identification/assumption session.
• Controlled perturbation: standardized scope change introduced at 40% of Sprint 2 (replace third-party animation library with custom build) to measure adaptive capacity.
• Metrics (8): planning time, total completion time, cost per story point (efficiency cluster); backlog revision count, rework rate, documented risk count, risk capture rate, scope change recovery time (robustness cluster). Blind client evaluation at end.
• Statistical testing: paired-samples t-tests on sprint-level data (3 sprints/condition); p-values reported but limited by small N.
• Limitations acknowledged: single organization/project type, small N, potential changes in labor-cost composition in real deployments, and short horizon (no long-term deskilling measurement).

Implications for AI Economics

• Evaluation metrics matter: industry reliance on planning speed and per-point cost underweights execution risks. Total Cost of Delivery (TCD) yields a different economic calculus favoring hybrid governance.
• Marginal trade-off: small additional human cost (~1% TCD) buys large reductions in risk exposure and faster recovery from scope changes, improving expected value in realistic project portfolios where undocumented risks can be costly.
• Governance design: apply the Hybrid Planning Governance Framework (HPGF)
  • Tasks with low contextual ambiguity and high computational complexity → AI delegation with human review (e.g., velocity forecasting).
  • Tasks with high contextual ambiguity (esp. low computation) → human-led deliberation with AI scaffolding (e.g., risk identification, assumption articulation).
  • Mandate human interrogation of AI-identified outputs in high-ambiguity quadrants to prevent automation bias and cognitive offloading beyond the threshold.
• Organizational adoption: firms should replace narrow per-task cost benchmarks with TCD-style analyses that include rework and recovery costs; doing so strengthens the economic case for human-in-the-loop processes on borderline tasks.
• Risk management and insurance implications: measurable increases in undocumented risk (AI-only) imply a higher risk-premium for projects using fully automated planning; insurers and procurement teams should consider governance requirements as part of risk controls.
• Long-term labor market considerations: potential deskilling risks for junior engineers if routine estimation and risk-sensing are persistently offloaded; this has implications for human capital accumulation and long-run productivity — arguing for mandated human participation in key learning tasks.
• Research & policy directions: scale and replicate across industries, project types, and longer horizons to quantify expected loss from rare but high-impact undocumented risks and to calibrate governance costs vs. benefits.