Planners should treat system design choices as decision variables, not fixed constraints: investing in prediction, capacity, or treatment quality can materially change welfare and should be optimized jointly with targeting rules. The paper formalizes this meta-design space and offers empirical tools, demonstrated on German employment services and Ethiopian cash transfers.

Main Finding

The paper formalizes the “meta-design” problem for data-driven resource allocation: planners should treat upstream design choices — what data to collect, how many people to serve (capacity), and treatment quality/quantity — as optimization variables, not fixed constraints. The authors introduce the welfare surface, a practical object mapping design configurations to the downstream welfare achieved by the optimal targeting rule, and show how its geometry (gradients, contours, expansion paths) provides actionable guidance for prioritizing investments and testing cost-optimality. They provide empirical tools (including open-source software) and demonstrate the approach on real-world case studies (German employment services and poverty targeting in Ethiopia).

Key Points

• Meta-design perspective: Allocation performance depends not only on the targeting rule but also on design parameters (distribution of features/outcomes, utility specification, capacity). Planners should optimize over these parameters.
• Welfare surface: V*(D, u, α) — mapping from design parameters to the welfare achieved by the optimal policy — is the central analytical object. It is a landscape where gradients and contours reveal marginal trade-offs across design axes.
• Local improvements (Q1): Partial derivatives of the welfare surface give marginal values of investments (e.g., ∂V/∂α = marginal value of capacity; ∂V/∂(prediction quality) = marginal value of prediction). Ratios of partials generalize the Prediction-Access Ratio into a Marginal Rate of Substitution (MRS) between any pair of levers.
• Inspecting optimality (Q2): Combining the welfare surface with a cost function c(θ) allows local optimality checks via KKT-like conditions — at optimum, marginal benefit ratios equal marginal cost ratios. If not equal, reallocate budget.
• Choosing optimal parameters (Q3): By overlaying a feasible region {c(θ) ≤ B} on the welfare surface, the planner selects the point on the highest iso-welfare contour. Tracing this as B changes yields an expansion path showing how optimal investment mixes evolve with scale.
• Generalization of prior work: Extends earlier analytical results (e.g., PAR under Gaussian models) to arbitrary design axes and to empirical computation on real datasets.
• Practical software: The authors supply tools to compute welfare surfaces and run the diagnostic analyses for realistic design universes.

Data & Methods

• Formalization:
  • Define allocation problem and optimal welfare V*(D, u, α) for a planner who assigns a scarce binary resource subject to capacity α and utility u.
  • Parameterize the design universe U by θ ∈ Θ (e.g., axes for capacity, prediction quality, data coverage, transfer size).
• Analytical tools:
  • Compute gradients ∇V*(θ) to obtain marginal values and MRS between axes.
  • Use KKT first-order optimality conditions to compare marginal welfare gradients to marginal cost gradients ∇c(θ).
  • Identify optimal configurations under budget constraints by maximizing V*(θ) over feasible set {c(θ) ≤ B}; compute expansion paths as B varies.
• Empirical implementation:
  • Compute the welfare surface from observed data S = {(x_i, y_i)} by (i) learning/estimating the optimal targeting rule for each (D, u, α) configuration and (ii) evaluating resulting welfare (simulating expanded α, alternate feature sets, or different treatment sizes).
  • Use standard policy-learning and prediction/causal estimation subroutines (e.g., risk scores, CATE estimators, empirical welfare maximization) as black-box components.
• Case studies:
  • Poverty targeting in Ethiopia: welfare surface over data coverage, eligibility share, and cash transfer size using household survey data and PMT-like predictors.
  • German employment services: welfare surface over institutional capacity and feature collection using administrative labor-market records.
• Tools: Open-source code provided to compute welfare surfaces and to allow planners to input cost functions and budgets.

Implications for AI Economics

• Reframe cost-benefit of ML improvements: The value of improving predictive models must be compared to alternative investments (expanding capacity or increasing treatment quality) within the planner’s context; marginal returns are context-dependent and can be computed directly.
• Empirical, domain-specific decision-making: Rather than relying on stylized models (e.g., Gaussian PAR results), practitioners should compute welfare surfaces on their own data to prioritize investments and to justify budget allocations.
• Operational guidance for scaling: Expansion paths clarify at what budgets/scale it becomes optimal to shift investments (e.g., prioritize data collection at some scales, capacity at others), informing staging and rollout strategies.
• Policy evaluation and transparency: The approach delivers interpretable diagnostics (gradients, iso-welfare contours, MRS) that can be reported to stakeholders to justify why certain investments are preferred, and to show when current resource mixes are locally suboptimal.
• Interaction with fairness and constraints: Because the framework separates welfare (a function of allocation primitives) from costs, it can be extended to alternative welfare notions (e.g., equity-weighted utilities) or to incorporate operational/fairness constraints, enabling richer trade-off analysis.
• Limits and caveats:
  • Results are inherently context-dependent; welfare surfaces reflect the chosen utility specification, available data, and assumed causal relationships.
  • Reliable conclusions require sufficient data and credible estimation of downstream effects (especially when treatment effects are heterogeneous or causal inference is needed).
  • Non-differentiabilities, high-dimensional design spaces, or discrete levers may complicate analysis; local optimality checks rely on differentiability/KKT conditions.
• Research and policy directions:
  • Broader adoption of welfare-surface diagnostics could change how agencies budget for AI and operational investments.
  • Future work can integrate uncertainty quantification on the welfare surface, dynamic/learning-aware meta-design (investment that changes future data), and multi-objective (efficiency-equity) meta-design.