Combine human screening with algorithmic targeting: screen cases near the model's cutoff and directly serve the highest predicted-risk individuals; screening becomes more valuable the greater the irreducible uncertainty about vulnerability.

Main Finding

The paper characterizes how to optimally combine costly physical screening with algorithmic (risk-score) targeting under irreducible aleatoric uncertainty. In a two-stage model with a screening budget α and an allocation budget β, the optimal screening policy is to verify an interval of units whose risk scores sit at the margin of pure algorithmic allocation: screen units in [qα, qβ], directly allocate to unscreened units with µ(X) > qβ, and never screen the highest- or lowest-risk tails. Screening always improves allocation efficiency, but marginal gains are positive and strictly decreasing (concave in α). Closed-form conditions and a fixed-point algorithm determine the thresholds qα and qβ; the marginal improvement in expected correct allocations is dV*/dα = qα(1−qβ)/(1−qβ+qα).

Key Points

• Problem setup
  • Units have covariates X and binary vulnerability Y ∼ Bernoulli(µ(X)) where µ(X)=P(Y=1|X) is assumed Bayes-optimal.
  • Decision-maker has screening budget α (fraction of population to observe Y) and allocation budget β (fraction of population that can receive resource), with α < β.
  • Objective: maximize probability of allocating to vulnerable units E[T(X)Y] under these budgets.
• Optimal pure algorithmic allocation
  • Without screening (α = 0), allocate to units with the top µ(X) values until budget β is exhausted; threshold at the (1−β)-quantile eqβ of µ.
• Main theoretical result (two-stage optimal policy)
  • The optimal screening set is an interval S*(X) = 1{µ(X) ∈ [qα, qβ]}.
  • Direct allocation rule is T*(X) = 1{µ(X) > qβ}.
  • Thresholds satisfy:
    • F(qβ) − F(qα) = α (screening mass)
    • ∫_{qα}^{qβ} µ dF(µ) + 1 − F(qβ) = β (total allocation mass, accounting for screened positives)
  • The pure algorithmic threshold eqβ lies inside the screening band: qα < eqβ < qβ.
  • As the screening budget α increases, qβ increases and qα decreases (screening band widens toward both tails).
• Value and marginal returns of screening
  • Screening strictly increases allocation efficiency for any feasible α.
  • The value function V*(α) is concave: diminishing marginal returns to additional screening.
  • Marginal value formula: dV*/dα = qα(1−qβ)/(1−qβ+qα) > 0 (depends only on thresholds).
• Intuition
  • Screening highest-risk units is wasteful because they are likely to be allocated without screening; screening lowest-risk units is unlikely to produce positives. The optimal gain occurs by resolving uncertainty at the allocation margin.
• Computation
  • Closed-form solution for uniform-risk case; general case solved via a fixed-point algorithm provided by the authors.
• Empirical characterization & robustness
  • The authors empirically show (simulations and two real-world case studies) that screening yields larger relative gains when population-level aleatoric uncertainty is higher.
  • Case studies: humanitarian demining (Colombia) and income-based social protection programs; results indicate substantial gains over pure algorithmic targeting across budget regimes and risk estimation methods.
• Code release
  • Implementation available: https://github.com/cmpatino/optimal-screening

Data & Methods

• Analytical methods
  • Formal two-stage model combining screening and allocation decisions with budget constraints; proofs establishing structure of optimal policies (Proposition 1, Theorem 1, Theorem 2).
  • Quantile-based characterization using the distribution F of µ(X) and integral budget constraints.
  • Distribution-free properties: structure of optimal screening band and concavity of V*(α) do not rely on specific F beyond technical support assumptions.
  • Fixed-point algorithm to numerically solve for qα and qβ when closed-form solutions are unavailable.
• Empirical methods
  • Simulation experiments to vary levels of aleatoric uncertainty and measure screening value and complementarity with algorithmic targeting.
  • Two applied demonstrations using real-world risk scores:
    • Humanitarian demining operations (Colombia): applying the two-stage rule to demining risk scores and screening budgets to compare allocation efficiency.
    • Income-based social protection programs: applying framework to poverty/risk scores and realistic screening/allocation budgets.
  • Comparative evaluation vs. purely algorithmic allocation under multiple budget regimes and alternative risk estimation procedures.
• Data
  • The paper refers to real-world datasets used in the demining and social protection case studies. (Specific dataset names and preprocessing details are in the full manuscript/code; practitioner readers should consult the repository for replication.)
• Assumptions & scope
  • µ(X) is Bayes-optimal (no epistemic error modeled).
  • Aleatoric uncertainty is the only source of imperfect prediction.
  • Budgets α and β are fixed and exogenous; model is static (single-stage screening then allocation).
  • Technical assumptions include full support of µ on [0,1] and α + β < 1 for some proofs.

Implications for AI Economics

• Quantifying the limits of prediction-driven allocation
  • The paper formalizes a hard limit: even perfect predictive models cannot eliminate misallocation because of aleatoric uncertainty. This reframes the policy debate: beyond model improvements, verification (screening) is an essential policy lever.
• Cost-effectiveness and resource prioritization
  • Policymakers should allocate scarce verification resources not uniformly nor to highest-risk cases, but to the marginal population around algorithmic cutoffs. This yields higher marginal returns per screening dollar.
  • Diminishing returns imply that small targeted screening programs can capture most gains; beyond some point, additional screening has lower incremental value and resources may be better used elsewhere.
• Trade-offs between investing in models versus screening
  • Because the analysis holds with Bayes-optimal µ, further model improvements (reducing epistemic error) will matter only to the extent they change µ; when aleatoric uncertainty dominates, investing in screening may be more productive than incremental model gains.
• Designing hybrid allocation systems
  • The interval screening policy gives clear operational guidelines for two-stage systems: set screening eligibility around the model’s allocation threshold, and allocate directly above it. This is implementable with existing risk-score pipelines across domains (welfare, health, humanitarian aid).
• Implications for measurement markets and institutions
  • The framework gives value signals for building markets of verification/inspection services: payment schemes could be tied to marginal improvements in allocation efficiency (e.g., prioritize inspections near model cutoffs).
• Equity and robustness considerations
  • Because the optimal screening rule depends on the distribution of µ, different subpopulations with different aleatoric profiles may require tailored screening budgets to avoid disparate impacts. The authors’ framework could be extended to incorporate fairness constraints or subgroup-specific budgets.
• Policy evaluation and pilot design
  • Use the marginal value formula and concavity to design pilot screening programs: estimate µ and its distribution, compute qα/qβ numerically, and forecast expected gains to justify screening budgets.
• Limitations and extensions relevant to AI economics
  • Static and Bayes-optimal assumptions: in many real deployments, models are imperfect and learning continues; dynamic allocation and learning interactions could change optimal screening investments.
  • Costs and behavioral responses: the model treats screening cost as a budget share but does not model monetary/operational costs or strategic behavior by agents; integrating cost structures and strategic response is a natural extension for policy analyses.
  • Multi-objective settings: when objectives include fairness, political acceptability, or long-term outcomes, the screening/allocation tradeoffs will shift; the current results provide a benchmark for efficiency-maximizing policies.

Practical takeaway for economists and policymakers: estimate or bound the population-level aleatoric uncertainty of your risk score; if irreducible uncertainty is substantial, implement a modest screening program targeted at the model’s allocation margin (the [qα, qβ] band). Use the authors’ fixed-point algorithm (code provided) to compute thresholds and to quantify expected marginal gains and where diminishing returns set in.