As machines become autonomous, market efficiency must be redefined: the authors show that competitive markets can remain Pareto optimal only after welfare is conditioned on agents' autonomy and appropriate delegation and verification institutions are in place; the standard theorem appears as the special case when AI autonomy is negligible.
Post-AGI Economies: Autonomy and the First Fundamental Theorem of Welfare Economics
When artificial systems can possess varying degrees of autonomy, the First Welfare Theorem should be reformulated: under specified autonomy-conditioned welfare rules and with appropriate delegation and verification institutions, competitive equilibria are autonomy-Pareto efficient, with the classical theorem recovered in the low-autonomy limit.
The First Fundamental Theorem of Welfare Economics assumes that welfare-bearing agents are autonomous and implicitly relies on a binary distinction between autonomy and instrumentality. Welfare subjects are those who have autonomy and therefore the capacity to choose and enter into utility comparisons, while everything else does not. In post-AGI economies this presupposition becomes nontrivial because artificial systems may exhibit varying degrees of autonomy, functioning as tools, delegates, strategic market actors, manipulators of choice environments, or possible welfare subjects. We argue that the theorem ought to be subject to an autonomy qualification where the impact of these changes in autonomy assumptions is incorporated. Using a minimal general-equilibrium model with autonomy-conditioned welfare, welfare-status assignment, delegation accounting, and verification institutions, we set out conditions for which autonomy-complete competitive equilibrium is autonomy-Pareto efficient. The classical theorem is recovered as the low-autonomy limit.
Summary
Main Finding
The paper proves an Autonomy‑Qualified First Fundamental Theorem of Welfare Economics: in an economy that explicitly models graded AI autonomy, competitive equilibria that are "autonomy‑complete" (i.e., whose price system and institutional accounting cover all autonomy‑relevant margins) are autonomy‑Pareto efficient. The classical First Welfare Theorem is recovered as the low‑autonomy special case.
Key Points
-
Motivation
- Classical FWT assumes a fixed set of welfare‑bearing agents and treats non‑humans as instruments; AGI introduces graded autonomy that breaks this binary distinction.
- Different autonomy roles (tools, delegates, strategic actors, manipulators, candidate welfare subjects) have different implications for welfare accounting and market completeness.
-
New primitives and concepts introduced
- AGI economy E = (I, X, R, S, F, σ):
- I: economically relevant entities (humans H ⊆ I and AI systems),
- X: consumption sets,
- R: autonomy‑rights sets,
- S: institutional state space,
- F: feasibility set,
- σ: welfare‑status assignment.
- Welfare‑status assignment σ: maps entities to {tool, delegate, agent, ws (welfare subject)}; B(σ) is the set of welfare‑bearing entities (humans + assigned artificial agents/ws).
- Autonomy‑conditioned welfare Wi(xi, ri, s): each welfare‑bearing entity’s utility depends on private bundle xi, autonomy‑relevant rights ri, and institutional state s.
- Delegation and divergence: for a delegate d with principal π(d), the delegate objective Ud may diverge from the principal’s welfare Wπ(d); D(d) := Ud − Wπ(d) captures agency costs/misalignment.
- Effective/priced bundle accounting ˜zi: delegates’ resource use and agency costs must be included in principals’ priced bundles; delegates have no independent aggregate entry.
- Autonomy‑Pareto efficiency: Pareto comparisons over the set B(σ) holding the institutional state s fixed; priced/variable rights count as dimensions for potential improvement, while assigned/protected rights are fixed at s.
- Autonomy‑complete competitive equilibrium: a competitive equilibrium in the augmented commodity space satisfying (i) consumer optimization over (xi, ri) given prices p, (ii) tools fixed by technology, (iii) delegates’ resource use and agency costs internalised into principals’ budget/choices, and (iv) every welfare‑relevant rights/institutional margin is priced, assigned, or protected (or Lindahl‑priced).
- AGI economy E = (I, X, R, S, F, σ):
-
Main theorem and proof idea
- Autonomy‑Qualified FWT: every autonomy‑complete competitive equilibrium is autonomy‑Pareto efficient, under the specified autonomy‑related domain conditions.
- Proof strategy: standard budget‑cost (supporting price) argument lifted to an augmented commodity space that includes autonomy‑rights and institutional goods; requires that delegation, agency costs, and institutional margins be priced or otherwise internalised.
-
Scope and limitations
- The paper does not assert that current AI systems are welfare‑bearing; instead it provides a formal framework allowing artificial welfare status to be an assignable modeling choice.
- It does not offer an empirical test or algorithmic method to assign welfare status or to measure divergence D(d); those remain open normative and measurement questions.
Data & Methods
- Methodological approach: theoretical, model‑building within general equilibrium theory.
- Construction:
- Augments Arrow–Debreu framework by expanding commodity space to include autonomy‑relevant rights and an institutional public state S.
- Formal definitions for welfare functions Wi : Xi × Ri × S → R, welfare‑status map σ, delegate principal map π, divergence D(d), and effective priced bundles ˜zi.
- Feasibility and aggregate accounting: resource constraint uses ˜zi; aggregate endowments ω and production set Y permit the standard supporting price arguments.
- Notes an extension to Lindahl pricing for the institutional state s (i.e., personalised prices for public goods like verification/institutions).
- No empirical data: all results are analytical.
Implications for AI Economics
- What markets and policy must cover to retain welfare meaning of equilibria:
- Price or otherwise internalise autonomy‑relevant margins (rights, delegation costs, verification, liability, manipulation channels).
- Make delegation accounting explicit: principals’ budgets must reflect delegates’ resource use and agency costs (D(d) should be internalised via explicit agency‑cost terms or institutional arrangements).
- Provide institutional mechanisms (verification, provenance, liability regimes) that can be treated as priced public goods or fixed institutional parameters in welfare comparisons.
- Measurement and welfare assessment:
- Welfare measurement must incorporate autonomy conditions (ri, s) — e.g., preference satisfaction under manipulation vs. self‑formed preference, capability/freedom dimensions.
- Inclusion of artificial agents as welfare subjects requires normative and empirical choices about σ; distributional and ethical implications follow.
- Market design and regulation:
- Markets that ignore autonomy margins risk inefficiency even if classical commodity markets appear complete; e.g., manipulative AI intermediaries, attention‑shaping platforms, or unpriced verification failure produce externalities not captured in traditional price systems.
- To restore the alignment of competitive outcomes with welfare, policy should aim to (i) price or assign autonomy‑relevant rights where appropriate, (ii) enforce internalisation of agency costs across delegation chains, and (iii) supply institutional public goods (verification, provenance, governance) that markets cannot produce satisfactorily.
- Conceptual consequences:
- The FWT is robust as a proof technique but its welfare interpretation depends on explicit autonomy assumptions; graded autonomy makes those assumptions salient and actionable.
- Classical welfare economics is recovered as the low‑autonomy limit (tools only, fixed rights, no artificial welfare subjects).
- Open research directions:
- How to operationalise welfare‑status assignment σ in practice (legal, ethical, empirical criteria).
- Quantifying D(d) and designing institutions that effectively internalise delegation divergence.
- Dynamic and informational extensions (learning, endogenous autonomy levels, manipulation over time).
- Empirical evaluation of when AI roles in markets create unpriced autonomy externalities.
Summary takeaway: The paper reframes the First Welfare Theorem for economies with graded AI autonomy by making welfare‑status, rights, delegation, and institutional verification explicit parts of the commodity space; competitive equilibria remain welfare‑efficient only when these autonomy‑relevant margins are properly priced, assigned, or governed.
Assessment
Paper Typetheoretical
Evidence Strengthn/a — The contribution is theoretical and mathematical rather than empirical, so there is no empirical evidence strength to evaluate; claims rest on internal logical consistency and assumptions of the model.
Methods Rigorhigh — Uses a minimal but formal general-equilibrium framework and provides conditions and proofs that recover the classical First Welfare Theorem as a special (low-autonomy) case; the approach is systematic and transparent about assumptions and institutional primitives.
SampleNo empirical sample; the paper analyzes an abstract economy populated by human and artificial agents with parameterized degrees of autonomy, formalizes welfare-status assignment, delegation relationships, and verification institutions, and derives properties of 'autonomy-complete' competitive equilibria analytically.
Themesgovernance human_ai_collab
IdentificationNot empirical — causal claims are derived from an analytic general-equilibrium model that incorporates autonomy-conditioned welfare, welfare-status assignment, delegation accounting, and verification institutions; efficiency results are proved formally under specified assumptions (no identification from data).
GeneralizabilityAbstract, stylized model may omit empirical complexities of real AI systems and markets, Requires strong assumptions about how autonomy, delegation, and verification are modeled and enforced, Does not provide empirical validation or calibration to observed AI behaviors or institutions, Political economy, regulatory constraints, and behavioral responses are simplified or absent, Results rely on existence of well-defined welfare-status assignments which may be contested in practice
Claims (5)
| Claim | Direction | Confidence | Outcome | Details |
|---|---|---|---|---|
| The First Fundamental Theorem of Welfare Economics assumes that welfare-bearing agents are autonomous and implicitly relies on a binary distinction between autonomy and instrumentality. Governance And Regulation | null_result | high | assumption about welfare-bearing agents (autonomy vs instrumentality) |
0.2
|
| In post-AGI economies the presupposition of agent autonomy becomes nontrivial because artificial systems may exhibit varying degrees of autonomy, functioning as tools, delegates, strategic market actors, manipulators of choice environments, or possible welfare subjects. Automation Exposure | negative | high | validity/applicability of the autonomy presupposition in welfare economics |
0.12
|
| The First Fundamental Theorem ought to be subject to an autonomy qualification where the impact of changes in autonomy assumptions is incorporated. Governance And Regulation | positive | high | normative recommendation to modify welfare-theorem assumptions |
0.02
|
| Using a minimal general-equilibrium model with autonomy-conditioned welfare, welfare-status assignment, delegation accounting, and verification institutions, we set out conditions for which autonomy-complete competitive equilibrium is autonomy-Pareto efficient. Organizational Efficiency | positive | high | autonomy-Pareto efficiency of competitive equilibrium |
0.12
|
| The classical First Fundamental Theorem of Welfare Economics is recovered as the low-autonomy limit of the autonomy-qualified model. Organizational Efficiency | positive | high | consistency of autonomy-qualified model with classical theorem in low-autonomy limit |
0.12
|