Recasting alignment in an 'impact space' turns the social-choice problem of AI alignment into a linear optimization over agents' welfare impacts, making strategyproof aggregation rules such as voting-by-issues and random dictatorships directly implementable; the framework also yields welfare-maximizing protocols subject to harm or group-constraint bounds.

Main Finding

When agents’ utilities over AI actions are linearly representable in a common feature space, the alignment problem—choosing a model parameter to aggregate heterogeneous preferences—can be rewritten in “impact space” as a linear optimization over a convex polytope (the impact set). Under this reformulation, individual welfare is linear in a model’s impact vector, the feasible impact set is a zonotope generated by deployment queries, and classical social-choice / mechanism-design tools (option-set mechanisms, voting-by-issues, random dictatorship) apply cleanly. The paper uses this geometry to (i) characterize strategyproof and unanimous alignment mechanisms, (ii) show how random dictatorship and per-query voting arise naturally and can be implemented, and (iii) derive families of alignment protocols that maximize utilitarian welfare subject to constraints (e.g., bounds on individual/group harm). Empirical illustrations use human preference datasets (kidney allocation, food distribution, LLM responses, trolley problems) to compare welfare outcomes under different protocols.

Key Points

• Impact representation
  • Define impact ψ(θ) = E_{z∼q_dep}[α_z (σ(α_z^T θ) − 1/2)] where α_z = ϕ(x,y) − ϕ(x,y′).
  • Agent n’s deployed welfare Un(θ) = θ_n^T ψ(θ). Utilitarian welfare is linear: U(ψ) = (Σ w_n θ_n)^T ψ.
  • The feasible impact set ¯Ψ = closure{ψ(θ)} is an origin-symmetric zonotope (convex, centrally symmetric) spanned by deployment query feature differences.
• Geometry & optimization
  • Maximizing utilitarian welfare reduces to maximizing a linear functional over the convex zonotope ¯Ψ — a linear program whose optimal point lies on the zonotope boundary in the direction of the weighted-average preference ¯θ_w.
  • ψ is a diffeomorphism (on the deployment-query subspace) from parameters to interior impacts; deterministic boundary points (vertices) correspond to extreme impacts attainable as θ→∞ in some direction.
• Strategyproof alignment
  • Strategyproof mechanisms correspond to option-set (menu) mechanisms: each agent is effectively offered a menu of feasible impacts they can induce by varying their report and the mechanism picks each agent’s favorite from that menu.
  • A useful structured class is voting-by-issues: for each deployment query z, agents cast sign votes s_{z,n} = sign(α_z^T θ_n), and a monotone aggregator f_z({±1}^N) ∈ [−1,1] produces a per-query coefficient; expected impact is 1/2 E_z[f_z(...) α_z]. Voting-by-issues rules are strategyproof and unanimous.
  • Random dictatorship (pick an agent n with weight λ_n and use their ideal impact) is impact-equivalent to a voting-by-issues rule with aggregator equal to the weighted average of vote signs; hence random dictatorship is strategyproof and unanimous. Random dictatorship’s expected impact can be implemented by a single model parameter (in expectation or as a limit).
• Constrained welfare maximization
  • Working in impact space makes it straightforward to pose and solve constrained social objectives (maximize Σ w_n θ_n^T ψ subject to linear constraints on ψ), e.g., individual harm bounds, group-harm caps, or public-spirited trade-offs between private loss and public gain. These are linear programs over ¯Ψ.
• Empirical illustrations
  • The paper evaluates welfare outcomes of these protocols on real preference data across four domains (kidney allocation, charitable food distribution, LLM responses, trolley problems) to show how different aggregation choices change distributional welfare and trade-offs vs. pooled-RLHF–style methods.

Data & Methods

• Theoretical model & assumptions
  • Finite contexts X and actions Y, finite set of deployment queries Z = X×Y×Y.
  • Each agent n has linear utilities in a shared feature embedding: u_n(y|x) = ϕ(x,y)^T θ_n for θ_n ∈ R^k.
  • Pairwise stochastic choice follows a Bradley–Terry–Luce (logistic) model: P_n(y ≻ y′ | x) = σ(u_n(y|x) − u_n(y′|x)).
  • Training distribution q_train over (agent, query) pairs and deployment distribution q_dep over queries; impact defined using q_dep.
  • Work focuses on welfare consequences (deployments) rather than the learning/estimation error of preference elicitation.
• Main technical results
  • Theorem 1: characterization of ¯Ψ as the zonotope {E_z[t_z α_z] : t_z ∈[−1/2, 1/2]}; diffeomorphism properties; boundary vertices correspond to deterministic limits.
  • Lemma 1: mechanism utility depends only on expected impact, reducing stochastic mechanisms to deterministic expected-impact maps for welfare/strategyproofness analysis.
  • Lemma 2 (option-set): strategyproof mechanisms ⇔ menu mechanisms picking each agent’s top menu item.
  • Theorem 2: voting-by-issues rules (monotone per-query aggregators) are strategyproof and unanimous.
  • Proposition 2: random dictatorship is a special voting-by-issues mechanism (aggregator is weighted vote average).
  • Theorem 4 (paper): characterization of mechanisms maximizing utilitarian welfare subject to linear constraints on ψ (useful for harm bounds etc.).
• Empirical methods (broad)
  • Use real elicited human preferences across domains to compute agent θ_n (or derive sign votes), construct ¯Ψ from deployment queries, and simulate welfare outcomes under different aggregation mechanisms (pooled RLHF proxy vs. utilitarian optima vs. strategyproof mechanisms vs. constrained optima). (Code is provided in the authors’ repo.)
• Limitations & caveats in methods
  • Linear utility assumption: u_n linear in shared features ϕ(x,y) — simplifies analysis but may not hold in all settings.
  • Requires specification/estimation of deployment query distribution q_dep and features α_z; results conditional on those modeling choices.
  • The framework abstracts away from statistical estimation noise, finite-sample learning error, and dynamics of iterative RLHF training — these can affect realized impacts in practice.
  • Generic-position assumptions (no zero α_z^T θ_n) simplify uniqueness/tie-breaking; measure-zero ties can be handled but complicate edge cases.

Implications for AI Economics

• Makes welfare trade-offs explicit and tractable
  • Casting alignment as linear programming over impact space turns high-dimensional model choice into transparent welfare trade-offs (objective coefficients are social-weighted θs; constraints encode harm limits or equity goals). This facilitates cost–benefit and distributional analysis familiar to economists and policymakers.
• Enables mechanism-design informed alignment
  • Mechanisms with formal incentive guarantees (strategyproofness, unanimity) become implementable alignment protocols. This reduces incentives for manipulative reporting by stakeholders and aligns institutional design (who votes, how) with welfare outcomes.
• Practical policy levers
  • Social weights (w_n), group constraints, and harm limits can be formalized as linear constraints on ψ and thus used to operationalize normative choices (e.g., protecting vulnerable subgroups, bounding maximum individual harm).
  • Regulators or platform designers can select aggregation rules (utilitarian, constrained utilitarian, random dictatorship, per-query voting) with known welfare consequences and incentive properties.
• Market and institutional effects
  • The choice between pooled optimization (current RLHF practice) and individualized or strategyproof aggregation affects distributional outcomes and externalities; platforms choosing pooling strategies bear distributional risk (e.g., systematic minority down-weighting).
  • Alignment choices influence incentives for preference reporting and participation of stakeholders (e.g., if strategyproofness is absent, agents may invest in manipulative reporting or exit), which alters equilibrium behavior in markets for labeling/alignment services.
• Computational and implementation considerations
  • The reduction to a linear program over ¯Ψ is computationally attractive if α_z and q_dep are known or estimable, but building ¯Ψ may be challenging with large or continuous query spaces (zonotope dimensionality and sampling of queries matter).
  • Translating an optimal impact back into an implementable model parameter θ may require solving the inverse mapping; the paper shows diffeomorphism on the relevant subspace and constructively maps solutions back (sometimes via limits), but finite-sample estimation and function approximation error remain concerns.
• Limits and open economic questions
  • The linear-utility assumption restricts the domain of applicability: when preferences are nonlinear, menu/strategyproof characterizations change and impossibility results may apply.
  • Statistical estimation of θ_n, measurement error in α_z, and endogenous q_dep (deployment distribution responding to model behavior) introduce second-order welfare effects that require integration of econometric learning models with the impact-space framework.
  • There are normative questions about who sets social weights and constraints; the framework makes trade-offs explicit but does not resolve democratic or political choice problems about those parameters.
• Overall: this work provides a clear, economically interpretable toolkit to compare and design alignment protocols with explicit distributional and incentive properties, enabling AI economists and policymakers to move from ad-hoc aggregation (pooled RLHF) toward principled, constrained-welfare alignment.