Model-based evaluations routinely overstate the benefits of data-driven policies. A formal proof and a calibrated refugee-matching simulation show model-based methods can report large, stable improvements (around 60%) even when the true policy yields no benefit, calling into question much published evidence.

Main Finding

Model-based policy evaluation—estimating counterfactual outcomes from an estimated model and using those to both learn and evaluate policies—is systematically susceptible to a winner’s curse that produces optimistically biased, spurious estimates of policy improvement. This optimistic bias can be large (indeed arbitrarily large in constructed examples) even when common defenses (high predictive accuracy, randomized historical assignment, rich model class, and sample splitting) appear to hold. A realistic simulation (refugee matching calibrated to prior work) demonstrates ~60% spurious estimated gains when the true effect is null, comparable to the 22–75% gains reported in the literature.

Key Points

• Prevalence in practice

  • Survey of Management Science (2015–2024): 55 “estimate-then-optimize” papers identified; 53 (96%) rely on model-based evaluation.
  • 35/53 (66%) evaluate with the exact same estimated model used to generate the policy—strongest channel for the winner’s curse.
  • Justifications offered: predictive accuracy (47%), stability (36%), calibration (13%), sample splitting (8%).
  • Only 9/53 (17%) report confidence intervals for estimated gains; none account for the optimization/selection step in CIs.

• Why model-based evaluation fails

  • Winner’s curse intuition: optimization exploits estimation errors; evaluating with the same model fails to correct for that selection, producing optimistic bias.
  • Two mechanisms shown to drive large optimistic bias even when the usual defenses hold:
  • Misspecification: A biased model family (even if highly accurate on observed data) can lead the optimizer to exploit biased regions (especially sparsely sampled covariate regions), producing arbitrarily large spurious estimated gains—even with randomized historical treatments and sample splitting.
  • Regularization / finite-sample bias: Well-specified nonparametric estimators require regularization. Regularization induces bias that is small on the training distribution but can be amplified under the shifted distribution induced by an optimized policy; this again yields large spurious gains, even when model class is rich, models are stable/accurate, and sample splitting is used.

• Empirical demonstration

  • Refugee matching simulation calibrated to Bansak et al. (2018): data constructed so no policy can outperform random assignment.
  • Applying the published model-based optimization and evaluation pipeline produced ~60% estimated employment gains (spurious by design).
  • A bootstrap-based variant (Ahani et al. 2021 style) also produced large, stable estimated improvements despite the ground truth being null.

• Related/alternative work

  • Recent research directions addressed by the authors include selection-aware inference and debiasing (Andrews et al., Zrnic & Fithian, Gupta et al., Xu et al.), variance reduction via pooling or auxiliary data (Banerjee et al., Mandyam et al.), and learning policies that trade off expected gain versus statistical significance/pessimism (Swaminathan & Joachims; Chernozhukov et al.; Bastani et al. 2025).

Data & Methods

• Literature survey

  • Search: Management Science articles (2015–2024) using keyword query (data OR estim) AND (optim OR policy), yielding 875 hits.
  • Two-stage screening: GPT-5.2 assisted title/abstract pre-screening, then manual full-text review → 55 confirmed estimate-then-optimize empirical papers; 53 of these used model-based evaluation.
  • Extraction of evaluation practices, justifications, model classes, and reporting of uncertainty.

• Theoretical analysis

  • Constructed stylized examples showing winner’s curse under:
    • Misspecification: simple parametric regression where bias is exploited in sparse regions—sample splitting, randomized assignment, and apparent model accuracy do not prevent arbitrarily large spurious gains.
    • Regularized well-specified models: toy ridge regression demonstrating that finite-sample regularization bias can be amplified out-of-distribution by the learned policy, causing large optimistic evaluation bias even with sample splitting and stable performance on the training distribution.

• Simulation experiment

  • Context: data-driven refugee-to-city matching problem (capacity-constrained assignment, objective = aggregate employment).
  • Synthetic dataset calibrated to resemble empirical settings in prior literature but engineered so that no assignment policy improves expected employment over random assignment.
  • Applied published model-based optimization and evaluation approaches (including bootstrap variants). Measured estimated gains and compared to the known ground truth (null improvement).
  • Result: model-based evaluation reported large positive gains (~60%), mirroring magnitudes reported in prior empirical papers.

Implications for AI Economics

• For empirical economic work that uses estimate-then-optimize pipelines, model-based evaluation cannot be taken at face value:

  • Reported welfare, revenue, or social outcome improvements that rely on model-based counterfactuals may be severely overstated.
  • Policy recommendations, cost–benefit calculations, and deployment decisions founded on such evaluations risk being based on spurious gains—potentially leading to costly or harmful real-world actions (e.g., misplacing refugees, inefficient targeting in health/marketing).

• Practical guidance for researchers and policymakers

  • Prefer model-free evaluation (IPW / doubly robust methods) when randomized treatment probabilities are known and support is adequate, since these provide valid (if high-variance) confidence intervals.
  • Recognize that predictive accuracy, calibration, stability, sample splitting, or rich model classes do NOT guarantee valid evaluation when optimization and evaluation re-use model-implied counterfactuals.
  • When model-free methods are infeasible:
    • Use selection-aware inference or debiasing techniques that account for the optimization/selection step.
    • Restrict the policy class (reduce complexity) or adopt pessimistic/offline-RL-style objectives that penalize deviation from supported actions.
    • Incorporate auxiliary datasets or pooled treatments to reduce variance and improve identification.
    • Report uncertainty that reflects the optimization process (not just standard CIs ignoring selection).
    • Pre-register evaluation procedures, and where possible validate with randomized holdout deployments or A/B tests before large-scale rollout.

• Research directions relevant to AI economics

  • Develop practical, low-variance, valid policy-evaluation methods that scale to large action/covariate spaces (e.g., targeted significance testing, debiasing combined with variance reduction).
  • Characterize trade-offs between policy class complexity, variance, and bias from regularization/misspecification in economic settings.
  • Integrate offline policy learning with experimental follow-ups to validate gains before policy adoption.

Summary takeaway: Model-based policy evaluation is broadly used but fundamentally fragile to the winner’s curse; economists and policy-makers should not accept estimated gains from such pipelines without rigorous, selection-aware inference or model-free validation.