A new nonparametric method lets randomized trials recover comparable treatment effects on latent outcomes by estimating 'bridge functions' that link imperfect indicators to a common scale. The approach also delivers debiased estimators robust to weak identification and provides practical guidance on measurement design to support identification and efficiency.

Main Finding

The paper develops a general nonparametric, design-based framework for identifying and estimating average treatment effects on latent outcomes (ALTEs) in randomized experiments. It shows latent-outcome causal inference faces two distinct noncomparability problems — across studies and across measures within a study — and proposes “measurement bridge functions” anchored to a benchmark measurement to make different indicators commensurable. The bridge functions are identified via a nonparametric instrumental-variables logic using experimental design features (treatment, covariates, other measurements) as instruments; estimation uses sieve/regularization with a debiasing step to permit valid inference even under weak identification. Simulations show standard dimension-reduction methods (PCA, ICW) can produce spurious cross-study differences, whereas the proposed Nonparametric Scaled Index (NSI) recovers comparable latent treatment effects. The paper also gives practical measurement-design guidance (include a shared benchmark, ensure informative indicators).

Key Points

• Object of interest

  • ALTE: τ = E[η1 − η0], where ηz are latent potential outcomes under treatment z.
  • Latent outcome η is not observed; researchers observe multiple noisy indicators Yj ∼ Pj(·|η).

• Two noncomparability challenges

• Study noncomparability: different studies using different indicator sets (or measurement devices) may estimate different empirical quantities even if the true latent causal effect is identical — measurement choices change the metric of η.

• Measurement noncomparability (within-study): different indicators relate to η in different (possibly nonlinear) ways, so raw indicators are not directly commensurable.

• Solution concept: measurement bridge functions

  • Choose a benchmark measurement Y1 shared/anchored across studies.
  • For each other measurement Yj, find a (nonparametric) bridge φj such that E[Y1 | η] = E[φj(Yj) | η]. That is, φj transforms Yj so it conveys the same information about η in expectation as the benchmark.
  • After mapping indicators to the benchmark scale, combine them to estimate ALTE — producing comparable causal estimands across measures and studies.

• Identification strategy

  • Bridge functions are characterized and identified via a nonparametric instrumental variables framework. In randomized experiments, treatment assignment, covariates, and auxiliary measurements can serve as instruments — no external instruments required.
  • The NPIV problem is ill-posed; identification of the bridge function is possible under standard completeness-type conditions and measurement informativeness.

• Estimation and inference

  • Estimation uses sieve/regularization for the NPIV and then a debiasing procedure (building on recent work) that allows valid inference even if bridge functions are weakly identified.
  • The target ALTE is a linear functional of the bridge-transformed measurements, which eases estimation relative to full nonparametric recovery.
  • Simulations show PCA and ICW can yield misleading cross-study differences; NSI recovers comparable ALTEs.

• Practical recommendations

  • Design experiments to include at least one shared benchmark measurement across studies.
  • Ensure measurements are informative about the latent variable (supporting identification).
  • Share measurement protocols to enable cross-study comparability.
  • Prefer the NSI/bridge approach over ad hoc dimension reduction when the causal estimand is the ALTE.

Data & Methods

• Setting

  • Randomized experiments with n units; treatment Zi binary; latent outcome ηi; multiple observed indicators Yij drawn from distributions Pj(·|ηi).
  • SUTVA assumed; no specific parametric measurement model required.

• Formal objects

  • Latent individual treatment effect τi = η1 i − η0 i; average τ = E[τi].
  • Measurement bridge function φj: nonparametric map satisfying E[Y1 | η] = E[φj(Yj) | η].

• Identification

  • Uses nonparametric IV identification: conditional expectations linking Y1 and Yj through η create an inverse problem.
  • In an experimental design, available instruments include treatment assignment, covariates, and other indicators, permitting identification of φj under completeness and informativeness assumptions.

• Estimation

  • Sieve-based approximation/regularization for the NPIV ill-posed problem.
  • Debiasing/orthogonalization step to obtain asymptotically normal estimates of the ALTE and enable valid confidence intervals even under weak identification of the bridge.
  • Simulation experiments to compare NSI to PCA/ICW and to assess finite-sample performance.

• Software

  • Preliminary R package available on GitHub (authors’ note).

Implications for AI Economics

Many outcomes of interest in AI economics are latent (e.g., model capability constructs, human trust in AI, fairness perceptions, “alignment quality”, human-AI complementarities) and are measured imperfectly via multiple proxies (task scores, benchmarks, surveys, behavioral traces). The paper’s framework and findings have several concrete implications:

• Be explicit that the causal estimand is defined with respect to a measurement system

  • In AI economics, what you call “capability”, “robustness”, or “trust” depends on measurement choices. Researchers should treat measurement design as part of the estimand, not merely a nuisance.

• Include a shared benchmark/anchor across studies and labs

  • When comparing interventions (e.g., training regimes, incentives, UI designs) across experiments, include at least one common benchmark measurement (standard task, canonical survey item, or shared evaluation protocol). This enables bridge-based alignment and makes ALTEs comparable across settings and over time.

• Use bridge-function-style alignment when combining heterogeneous indicators

  • When different labs or datasets use distinct proxies (different benchmarks, metrics, or survey batteries), map those proxies to a common benchmark via nonparametric bridge functions before estimating causal effects. This reduces the risk that apparent cross-study differences are measurement artifacts.

• Avoid naive aggregation (PCA, ICW) for causal comparisons across studies

  • PCA/ICW optimize variance-explaining or efficiency criteria, not comparability of causal estimands across differing measurement systems. For cross-study meta-analysis of treatments on latent constructs, these methods can produce misleading conclusions.

• Practical design advice for experiments in AI economics

  • Pre-register measurement plans and include one or more shared anchor variables across replications.
  • Collect multiple complementary indicators (behavioral, survey, performance) to improve informativeness for the latent construct.
  • Assess identification informativeness (e.g., whether indicators vary with latent construct sufficiently) and plan sample sizes accordingly given NPIV ill-posedness.
  • When possible, exploit randomized variation (treatment assignment) and orthogonal covariates as instruments to identify bridge maps.

• Methodological tradeoffs and caveats

  • The approach requires at least one shared benchmark and measurement informativeness/completeness conditions — if these fail, identifiability is compromised.
  • NPIV estimation can be sensitive to regularization choices and sample size; the debiasing step mitigates but does not eliminate finite-sample fragility.
  • Computational complexity is higher than naive PCA; investigators should weigh the costs and consider simulations tailored to their setting.

• Use cases in AI economics

  • Cross-model comparisons: aligning different benchmark metrics (e.g., task suites, human evaluation scores) to compare treatment effects of training interventions on a latent “capability” variable.
  • Human-AI interaction: estimating effects of interface/treatment on latent trust or perceived usefulness measured with diverse surveys and behavioral traces.
  • Policy evaluation: comparing intervention effects on latent outcomes like “technology adoption propensity” across populations with different measurement instruments.

In short: when causal claims in AI economics concern latent constructs measured by heterogeneous proxies, explicitly design for comparability (shared benchmarks), and use bridge-function-based nonparametric alignment and debiased estimation to recover comparable ALTEs across studies.