Summing up individualized ML treatment-effect predictions can misstate group causal effects even with randomized data; a simple statistical test and closed-form shrinkage fix both detect and correct the bias, and applying the correction to platform A/B tests changes targeting choices and firm profits.

Main Finding

Even when individual-level conditional average treatment effects (CATEs) are point-identified, correctly specified, and consistently estimated from randomized experiments, aggregating those CATE predictions to ex-post-defined subgroups can produce systematic group-level bias: the model-implied group average treatment effect (GATE) need not equal the experimentally identified GATE. The paper (1) formalizes this group bias, (2) gives a general, asymptotically normal estimator and a statistical test for detection, and (3) proposes a shrinkage-based closed-form bias-mitigation that trades off debiasing against estimation noise. It shows when bias correction changes profit‑maximizing targeting decisions and documents empirical performance on large-scale platform experiments and uplift datasets.

Key Points

• Definition of group bias: the discrepancy between the group-average of predicted CATEs and the causally identified GATE from the experiment (i.e., E[bτ(X) | G = g] − E[Y(1) − Y(0) | G = g]).
• Group bias can arise even under randomized treatment, correct model specification, and consistent CATE estimation. Causes include non-collapsibility of effect measures, models optimized for global objectives, and regularization that shrinks heterogeneity unevenly across groups.
• Common remedies are not generally sufficient: including group indicators, retraining separate models per group, or adding more data need not eliminate bias and can be impractical (privacy, stakeholders define groups ex post, small-group noise).
• Detection: the authors derive a general, model-agnostic estimator for group bias that is asymptotically normal and depends only on sample moments; they provide a simple hypothesis test applicable to binary/continuous outcomes and to additive or relative effect scales.
• Mitigation: naive subtractive bias correction (subtract estimated bias per group) can over-correct in finite samples, increasing variance across groups. They pose mitigation as minimizing expected loss of residual group bias and derive:
  • The oracle (risk-minimizing) shrinkage factor in closed form.
  • A feasible estimator that uses sample moments and signal-to-noise estimates; both automatically shrink more for noisy/smaller groups.
  • The solution is simple to implement (closed-form, moment-based) and agnostic to the particular CATE learner.
• Decision implications: correcting group bias improves group-level causal inference (reporting, audits) but can change the ranking of individuals for profit-maximizing targeting and thus alter expected profits. The paper characterizes when bias correction will change optimal targeting and the profit trade-offs involved.
• Practical guidance: test for group bias before correcting; when correcting, use shrinkage tuned to group signal-to-noise; weigh the benefits for causal reporting against possible losses in decision-making utility.

Data & Methods

• Theoretical framework: starts from standard potential-outcome setup with randomized treatment; defines CATE τ(x) and GATE τg = E[τ(X) | G = g]. Group bias is formalized as difference between aggregated model prediction and identified GATE.
• Estimation & testing:
  • Proposes an estimator for group bias that is asymptotically normal under regularity conditions; inference uses only sample moments (no parametric modeling of the CATE learner).
  • Test is nonparametric, model-agnostic, and works for additive and relative effect scales and for binary or continuous outcomes.
• Mitigation:
  • Formulates debiasing as choosing a shrinkage weight α ∈ [0,1] to apply to the naive correction, minimizing expected squared residual bias (risk).
  • Derives closed-form oracle α* and feasible plug-in estimator that accounts for group sample sizes and noise variances (James–Stein–style intuition).
• Empirical work:
  • Simulation illustrating phenomenon across standard causal ML methods (causal forests, S/T/X-learners, DR-learner): models trained on randomized data still show group bias when aggregated.
  • Validation on large-scale A/B tests from a major online travel platform and off-policy counterfactual evaluation on the Criteo Uplift Prediction Dataset—showing the test detects bias and shrinkage mitigation improves group-level accuracy while controlling variance.
• Assumptions: randomized treatment (so experiments identify GATEs nonparametrically), SUTVA (no interference), finite variances; minimal further structural assumptions because methods depend only on sample moments.

Implications for AI Economics

• Measurement and reporting: platform and firm practice of summarizing personalized CATEs into subgroup effects (markets, demographics, risk strata) can produce misleading causal summaries. Regulators, auditors, and managers should test for group bias before relying on aggregated ML-treated effects for reporting or policy.
• Targeting and profitability: bias correction that improves subgroup causal estimates can alter individualized targeting rules derived from the same CATE predictions. That may (a) reduce profit if corrections change the ordering of users by predicted uplift, or (b) increase long-run reliability of decisions if group-level constraints or reporting mandates require correct subgroup estimates. The paper characterizes when these trade-offs bind (signal-to-noise, group sizes, heterogeneity magnitude).
• Design of experiments and models: because the group bias problem persists even under randomized assignment and correct model specification, experimental design and model objectives should account for the intended level of reporting. If subgroup inference is required ex post, designs with adequate group sample sizes and explicit objectives that weight subgroup accuracy can help—but when groups are unknown ex ante (stakeholders define them later), post hoc detection and shrinkage correction are pragmatic.
• Policy and fairness considerations: while the core issue is causal identifiability rather than fairness per se, the phenomenon interacts with fairness/audit workflows. Correcting group bias is important for equitable policy evaluation and compliance, but practitioners must be aware that such correction can affect allocation outcomes and economic efficiency.
• Practical recommendation for AI economists and managers:
  • Use randomized experiments as the benchmark for subgroup causal effects and run the proposed group-bias test when aggregating CATEs.
  • If bias is detected, apply the shrinkage-based bias correction (plug-in closed form) rather than naive subtraction to avoid overcorrection in small/noisy groups.
  • Evaluate the economic impact of correction via off-policy or counterfactual evaluation to quantify profit trade-offs and to decide whether to prioritize group-accurate inference or raw personalization performance.

Summary takeaway: Aggregating personalized CATE predictions to report subgroup causal effects is not automatically valid even under ideal identification. The paper gives a practical, lightweight inferential test and a closed-form, noise-aware shrinkage correction that are directly applicable in platform experimentation and decision-making workflows, together with a framework to weigh the economic trade-offs of performing such corrections.