Graph rules that guarantee optimal covariate adjustment for the ATE do not generalise to the treated-population effect: there is no graph-only covariate set that is ATT-optimal under every compatible distribution, and adding outcome-side predictors can raise variance (especially when treatment is rare). The paper gives exact formulas, counterexamples, and practical guidance — including symmetric thresholds for overlap weights — plus simulations and a LaLonde illustration.

Main Finding

Graphical optimality of covariate adjustment (a single graph-computable adjustment set that is optimal for every compatible distribution) is a special property of the population average treatment effect (ATE) and its inverse-prevalence weights. It fails for the average treatment effect on the treated (ATT) and for general weighted average treatment effects (WATEs). For the ATT (and many WATEs) (i) whether supplementing a valid adjustment set with additional covariates raises or lowers the semiparametric variance depends on the data-generating law (not just the DAG), (ii) covariates that predict only the treated-arm outcome are neutral for ATT efficiency, while control-arm-only predictors can strictly harm ATT precision under low treatment prevalence, and (iii) there exist DAGs with two faithful laws for which the ATT-optimal valid set differs, so no graph-to-set rule can be ATT-optimal uniformly. The ATE-optimal set remains optimal for ATT among graphically valid sets under no effect modification. The paper extends these results to a parametric family of WATEs (including overlap weights) and gives thresholds and phenomena (e.g., estimand drift under instrument adjustment) that guide practice.

Key Points

• Definitions and scope

  • Valid adjustment set S: suffices for unconfoundedness and positivity (standard definition). The paper contrasts sets valid at a law P versus graphically valid sets A(G).
  • Estimands considered: ATE (h ≡ 1), ATT (h(e)=e), ATC, ATO (overlap; h(e)=e(1−e)), and general WATEs with smooth h(e).
  • Efficiency comparisons are between adjustment estimators that do not impose additional restrictions (no propensity-exclusion restrictions).

• Semiparametric bounds (closed forms)

  • ATT bound (for a valid set S): V_att(S) = (1/p^2) E[ e_S σ1^2(S) + e_S^2/(1−e_S) σ0^2(S) + e_S (τ_S − ψ)^2 ]. (Here e_S = P(A=1 | S), μ_a(S), σ_a^2(S), τ_S = μ1(S) − μ0(S), p = P(A=1), ψ = ATT.)
  • General WATE bound (normalizing D_S = E[h(e_S)]): V_h(S) = D_S^{−2} E[ h(e_S)^2/e_S σ1^2 + h(e_S)^2/(1−e_S) σ0^2 + (τ_S − ψ_h)^2 { h(e_S)^2 + h'(e_S)^2 e_S (1−e_S) } ].
  • The derivative term h'(e)^2 e(1−e) is the price of estimating propensity-dependent weights (vanishes for ATE).

• Supplementation identities and consequences

  • Treatment-side supplementation (adding covariates unrelated to outcome given the current set) mirrors the ATE result: instruments are variance loads.
  • Outcome-side supplementation (adding covariates unrelated to treatment given the current set) behaves differently:
  • For ATE, adding a covariate that predicts only one arm cannot increase variance (supplementation lemma); arithmetic–geometric-mean inequality in ATE weights enforces this.
  • For ATT, adding a covariate that predicts only the treated-arm outcome is exactly efficiency-neutral.
  • For ATT, adding a covariate that predicts only the control-arm outcome can strictly increase the variance when treatment prevalence is low and effect modification is arm-asymmetric (reversal of the supplementation lemma).
  • These sign decisions are given in exact conditional-moment identities (the paper provides the closed-form difference of bounds when extending S by W subject to W ⫫ A | S or W ⫫ Y | (A,S)).

• Graphical (im)possibility results

  • Theorem: There exists a DAG and two strictly positive distributions both Markov and faithful to the DAG such that their ATT-optimal graphically valid sets differ. Therefore, no rule mapping a DAG to a single adjustment set can be ATT-optimal across all compatible laws.
  • Corollary: The ATE-optimal set O(G) can be strictly suboptimal for ATT; the paper gives closed-form variance penalties.
  • Rescue: If there is no effect modification (so ATT = ATE numerically), the ATE-optimal set O(G) is ATT-optimal among graphically valid sets; an exact advantage expression is provided.

• Extensions to WATE and overlap weights

  • The analysis extends to smooth h(e). For overlap weights h(e)=e(1−e) the paper derives symmetric pointwise thresholds:
  • A control-arm-only predictor harms ATO efficiency when e < 1/3.
  • A treated-arm-only predictor harms ATO efficiency when e > 2/3.
  • Constant weights (ATE) are characterized as the only smooth positive weights for which outcome-side supplementation never increases the bound.
  • Novel phenomenon: for overlap-type weights, adjusting for an instrument can change the estimand itself (estimand drift), so deleting instruments is not even a well-posed efficiency comparison for ATO without fixing a canonical weight.

• Finite-sample and empirical illustrations

  • Simulations: in the designs studied, bound orderings predict finite-sample RMSE and influence-based SEs are well calibrated.
  • Random-structure scan: among 49 random four-covariate DAGs with arm-asymmetric modification, ATE- and ATT-optimal graphically valid sets differed in 10 cases; ATT penalties for using the ATE-optimal set ranged 2.9–25.9%.
  • LaLonde (Dehejia–Wahba subsample) example: rare-treatment regime (p ≈ 1.1%); leave-one-out deletions left estimates nearly unchanged; SE reductions up to 1.6% observed — the example illustrates the regime in which ATT-vs-ATE differences matter.

• Practical takeaway emphasized in paper: substantive validity should dominate covariate choice for ATT; precision-based rules that rely only on the DAG can be misleading.

Data & Methods

• Theoretical framework

  • Nonparametric structural equation model with a causal DAG; work distinguishes graphically valid sets A(G) and sets valid at a particular law A(P).
  • Semiparametric efficiency theory: pathwise differentiability, efficient influence functions, and nonparametric efficiency bounds for functionals χ_S (ATT) and ψ_h(S) (WATE).
  • Derived closed-form influence functions and bounds (see Lemmas 1–2 and Table 1 in paper).
  • Algebraic identities for how bounds change when adding covariates on treatment or outcome side; uses conditional variance decompositions and weight arithmetic (source of the ATE/ATT difference is an arithmetic–geometric-mean inequality that holds for ATE weights but not ATT weights).

• Proof strategy and constructions

  • Constructive counterexample: a DAG and two faithful laws with differing ATT-optimal sets to prove nonexistence of universal graph-based optimality for ATT.
  • Rescue proofs use supplement-then-delete architecture (in parallel to Rotnitzky & Smucler 2020) but with ATT/WATE increments.

• Estimators and attainment

  • Augmented inverse probability weighting (AIPW) with cross-fitted nuisance estimates and targeted maximum likelihood estimation (TMLE) are used to attain the derived bounds under standard regularity (overlap, bounded moments, L2 consistency of nuisances, product-rate conditions).
  • Estimators in simulations and application are cross-fitted AIPW/TMLE variants to align with the asymptotic theory.

• Simulations and empirical data

  • Simulations calibrated to show finite-sample implications of bound orderings.
  • Random-structure scan across DAGs with four covariates.
  • Application to LaLonde training program (Dehejia–Wahba subsample): 185 treated vs 15,992 CPS controls; replication materials provided.

• Reproducibility

  • Replication code and data: https://github.com/sokubo/paper-estimand-adjustment-replication
  • Proofs in Appendix A and numerical verification in Appendix B.

Implications for AI Economics

• Estimand-aware covariate selection

  • When policy evaluation or program-effect targets focus on the treated (ATT) or other non-ATE WATEs, analysts cannot rely on a single DAG-derived adjustment set to be uniformly optimal. Variable selection and adjustment should be estimand-specific and may need distributional evidence (e.g., variance and arm-specific predictive power).
  • In practice, automated covariate-selection tools or ML pipelines that aim to minimize variance should be configured with the target estimand in mind (ATE vs ATT vs ATO) — the same covariate can help ATE but harm ATT.

• Rare-treatment regimes

  • Many policy and pharmacoepidemiology applications have rare treatments. The paper shows that when p is small, control-arm-only predictors are particularly likely to harm ATT efficiency; therefore, in AI-economics workflows that use ML models for propensity or outcome modeling, careful assessment of control-arm predictors’ role is important.

• Use of overlap weights and targeted weighting

  • Overlap-type weights (ATO) are attractive under limited overlap, but the paper warns that for these weights:
  • There are sharp symmetric thresholds (e < 1/3, e > 2/3) where single-arm predictors can harm efficiency.
  • Instruments (variables unrelated to the outcome but predictive of treatment) can change the estimand under overlap weights (estimand drift). Analysts should fix a canonical weighting scheme before treating instrument deletion as a variance-only decision.

• Graphical analyses and ML pipelines

  • DAG-based adjustment rules remain valuable as conservative validity checks (they guarantee unconfoundedness under the graph), but practitioners should not assume they also deliver uniform efficiency for estimands beyond ATE.
  • For ATT-targeted analyses, complement graphical selection with distributional diagnostics (e.g., conditional variances, arm-specific predictive power), sensitivity analyses, and simulation-based checks.

• Recommendations for applied AI-economics practice

  • Explicitly state the estimand (ATE vs ATT vs ATO) before variable-selection and modeling.
  • Use semiparametric estimators known to attain the bounds (AIPW/TMLE with cross-fitting) to avoid estimator suboptimality masking the bound-level effects.
  • Run sensitivity checks or small-scale simulations that vary the covariate set to see how estimated SEs and RMSE behave in finite samples; do not treat DAG-derived optimality as sufficient for ATT.
  • When using overlap weights or other propensity-dependent weights, be aware that including instruments can change what you’re estimating; fix the weight function before variable deletion.
  • When substantive arguments for inclusion/exclusion are weak, prefer reporting sensitivity to covariate choices rather than selecting a single “optimal” set.

In short: for ATE the graphical theory gives a distribution-free optimal adjustment set; for ATT and many WATEs it does not. Applied AI-economics workflows that use ML for causal estimation must be estimand-aware and combine DAG-based validity with distributional diagnostics and semiparametric estimators that attain the theoretical bounds.