LLM-powered agents turn enduring code into disposable tools, recasting software engineering as 'Agentic Engineering' and enabling an Agent-as-a-Service model; promising large productivity shifts, the paradigm still faces current reliability and coordination constraints.

Main Finding

The paper argues that LLM-driven AI agents constitute a fundamental paradigm shift in software production: code ceases to be the primary, persistent carrier of decision logic and becomes ephemeral tooling used by agents that reason, plan, generate, execute, and self-improve. This Agent-as-a-Service (AaaS) model rearranges who bears complexity, changes revenue and pricing models toward outcome-based delivery, and creates a distinct discipline — Agentic Engineering — with new human roles (intent architects, orchestrators, auditors). The shift promises large productivity gains but faces concrete technical limits today (context drift, error propagation, verification gaps) that delay fully autonomous software development.

Key Points

• Paradigm distinction
  • Traditional software: static decision logic encoded in source code; human engineers control design/maintenance.
  • Agentic systems: an LLM is the runtime reasoning core that generates/transforms ephemeral code and calls tools; the persistent asset is the agent capability, not generated artifacts.
• First-principles argument
  • Software complexity scales combinatorially with system components, producing an essential complexity ceiling that human cognition cannot overcome; agentic systems decouple solution capacity from human cognitive limits because model capacity grows with training compute.
• Historical framing
  • Three delivery generations: Software 1.0 (local, licensed), Software 2.0 (SaaS, vendor-hosted), Software 3.0 (AaaS, agent-driven outcome delivery). Each transfer shifts complexity to the party best able to absorb it.
• New discipline: Agentic Engineering
  • Core artifact: dynamic agent systems; development cycle: autonomous iterative loops; human role: specifying intent, orchestrating agents, auditing outcomes, and governing ethics.
• Empirical evidence (representative)
  • SWE-bench Verified: an open process-oriented model resolved ~30.2% of GitHub issues vs GPT-4o 31.8%; even small models (7B) showed nontrivial automated engineering capability (~18.2%).
  • Multi-agent pilots: coordinated agent swarms cut root-cause identification time by ~93% in an enterprise pilot, saving substantial engineering hours via orchestration.
  • Hermes Agent: production framework showing closed-loop self-evolution (agents create and patch reusable Skills; large cross-session memory use).
  • EvoClaw benchmark: exposes a sharp drop from >80% success on isolated tasks to ≤38% in continuous-evolution scenarios — highlighting limits in long-term maintenance, context, and error accumulation.
• Roadmap (four stages)
  • I: Tool-augmented (code completion, 2023–2025)
  • II: Single-task autonomous (2025–2027)
  • III: Multi-agent teams (2026–2029)
  • IV: Self-evolving ecosystems (2028+)
• Limitations identified
  • Context-window and memory management, verification fidelity, technical-debt reasoning, error propagation across commits — all constrain immediate full autonomy.

Data & Methods

• Formal modeling
  • Classical software: defined as tuple S = (C, D, E) where D is static decision logic.
  • Agentic system: defined as A = (M, T, M_mem, Π) where M is an LLM, T is tools, M_mem is memory, and Π is planning; runtime loop: at ← M(st, M_mem); st+1 ← exec(at).
  • Complexity argument: essential complexity grows combinatorially with interacting components; agentic systems mitigate the human-cognition bottleneck because model capacity CM scales with training compute.
• Historical and conceptual analysis
  • Comparative taxonomy of delivery generations and of engineering paradigms (tables contrasting artifacts, control center, decision mechanism, human roles, outputs).
• Empirical evidence and benchmarks surveyed
  • SWE-bench Verified (Ma et al.) — automated issue resolution rates across model sizes.
  • Multi-agent enterprise pilot (Kumar & Ramagopal) — coordination gains and time savings.
  • Hermes Agent (Nous Research) — open-source production framework demonstrating self-evolution.
  • EvoClaw (Deng et al.) — continuous-evolution benchmark exposing degradation in sustained development performance.
• Sources are a mix of benchmark studies, system descriptions (open-source frameworks), and pilots; the paper synthesizes theoretical modeling with cited empirical results rather than introducing new primary datasets.

Implications for AI Economics

• Productivity and output valuation
  • Potentially large productivity multipliers as agents shift work from manual code production to intent specification and auditing. Economic output may be measured more directly by delivered outcomes rather than lines of code or developer-hours.
  • However, measured gains will depend on domain: large gains in well-scoped, short-horizon tasks; persistent gaps in continuous maintenance and long-lived systems imply uneven productivity across industries.
• Labor and skill composition
  • Demand shifts from coders to higher-level roles: intent architects, agent orchestrators, outcome auditors, and governance specialists. This implies re-skilling needs and a changing wage premium (potentially high for orchestration/governance skills).
  • Commoditization of routine coding reduces returns to many traditional programming tasks; specialized engineering that integrates domain knowledge and governance may retain premium.
• Market structure and concentration
  • AaaS favors parties that control the models, shared memory, orchestration infra, and large-scale data/compute — increasing scope for winner-take-most dynamics and platform monopolies unless checked by regulation or interoperable standards.
  • Network effects: shared memory, Skills, and agent-experiential data create stickiness and switching costs. Outcome-based contracts will further lock buyers to vendors that reliably deliver results.
• Pricing and revenue model shifts
  • Movement from per-seat licenses or subscriptions toward outcome-based pricing (pay-per-result, value-share) and possibly performance guarantees. This shifts risk profiles and incentives across vendors and buyers.
  • New markets for verification, testing, and audit-as-a-service likely to emerge, as buyers pay for assurance that agent-delivered outcomes meet safety/quality standards.
• Capital intensity and returns to scale
  • Agentic capabilities scale with model size, training compute, and high-quality process/experience data — favoring capital-rich actors. Returns to scale in compute and data may amplify concentration tendencies.
  • However, open-source models and specialized process-trained models (e.g., SWE-GPT variants) show that smaller models can be competitive in particular niches, potentially enabling a two-tier market (large platform incumbents + niche specialized providers).
• Externalities and regulatory economics
  • Increased compute usage raises energy and environmental externalities; regulation or carbon pricing could affect the comparative costs of agentic development.
  • Liability, safety, and compliance regimes will shape adoption: firms may prefer hybrid human-in-loop arrangements until verification and continuous-maintenance deficits narrow.
• Transition dynamics and investment priorities
  • Near-term value lies in augmentation (Stage I–II): operational efficiencies, faster time-to-feature, and reduced debugging time in isolated tasks.
  • Investments that economists and firms should track: memory/context infrastructure, verification & formal-validation markets, orchestration platforms (multi-agent management), and agent audit/ethics services. These are complementary assets that enable higher-level adoption and reduce the EvoClaw-style reliability gap.
• Policy and competition considerations
  • Antitrust/regulatory attention likely as AaaS vendors bundle models, memory stores, and enterprise processes; interoperability, data portability, and standards for agent traceability may be required to prevent lock-in.
  • Public-good investments (benchmarks for continuous evolution, open verification datasets) would accelerate reliable adoption and mitigate concentration risks.

Practical recommendations for economists and policymakers - Measure outcomes not just units of code: develop metrics for agent-delivered outcome quality, long-term maintenance cost, and incidence of error propagation. - Monitor market concentration around model providers, memory/skill repositories, and orchestration platforms; encourage interoperability standards and data portability. - Fund research and public benchmarks (continuous-evolution settings like EvoClaw) and invest in open verification tooling to lower barriers for smaller providers and improve safety. - Prepare workforce policies to accelerate re-skilling toward orchestration, intent engineering, and auditing roles; model likely heterogeneous labor impacts across skill levels and sectors. - Account for compute/externality costs in cost–benefit analyses of adopting agentic systems and consider incentives for energy-efficient model development.

Limitations of the paper (economically relevant) - The argument is partly theoretical and synthesizes a small set of benchmarks/pilots; empirical generalizability across industries, codebase scales, and regulatory environments remains to be proven. - Key economic parameters (cost curves for compute, model training, verification, and human auditing) are not quantified; those are crucial to forecast diffusion and market structure.

Overall, the paper provides a clear conceptual and early empirical case that agentic systems will reshape the economics of software: lowering marginal costs of many development tasks, raising capital and platform concentration pressures, and shifting labor demand toward higher-level coordination, evaluation, and governance — with important transitional frictions driven by verification and long-term maintenance challenges.