Geographic differences—both in feature distributions and spatial autocorrelation—predict where mobility-generation models will fail or succeed: mutual-information and Moran’s I shifts explain substantial variation in cross-region transfer performance across US counties, highlighting the need to account for intrinsic domain differences when transferring GeoAI models.

Main Finding

The paper defines and quantifies "geographic domain shift"—the intrinsic differences between source (training) and target (testing) regions in both feature distributions and spatial structure—and shows these shifts systematically explain variation in geospatial transferability of human mobility OD-flow generation models. Two model-agnostic metrics (mutual information shift and Moran spatial shift) provide complementary, statistically significant predictive power for how well models transfer across U.S. counties; transfer performance exhibits substantial spatial heterogeneity and asymmetry that depends on both model design and intrinsic geographic differences.

Key Points

• Problem: Human mobility data are scarce; synthetic generation is used widely, but geospatial transferability (performance when applied to new regions) is poorly understood and often evaluated without quantifying how different source and target geographies actually are.
• Geographic domain shift: decomposed into
  • MI shift — a covariate (distributional) shift measure computed as the mutual information between input features and a binary domain label (source vs target); higher MI shift implies stronger feature-domain dependence (larger distributional differences).
  • Moran spatial shift — a spatial-structure shift measured as the difference in multivariate Moran’s I (Itar − Isrc) between target and source, capturing changes in spatial autocorrelation/clustering of covariates.
• Empirical findings:
  • Both MI shift and Moran shift are statistically significant and complementary predictors of transfer performance.
  • Transferability varies substantially across target counties and is asymmetric (training A → B differs from B → A).
  • Geographic domain shift can be quantified before model training because the metrics are based solely on input geographic features.
• Practical upshot: these metrics enable adaptive selection of training regions, better reporting of transfer settings, and can guide model optimization or targeted data collection to improve fairness and robustness of synthetic mobility data.

Data & Methods

• Dataset: CommutingODGen benchmark (Rong et al. 2025) of census-tract level within-county commuting OD flows across 2,265 counties (48 contiguous U.S. states). Input covariates: 97 demographic variables + 36 POI categories aligned to tracts.
• Models evaluated: representative OD-flow generators including DeepGravity (primary focus), GBRT, Random Forest, and GMEL. DeepGravity is used in a leave-one-state-out transfer design: train on one state (70% counties train / 30% validation within state) and evaluate transfer to counties in all other states.
• Geographic domain shift metrics:
  • MI shift: average mutual information across feature dimensions between features X and domain label Y (source vs target); measures covariate distributional discrepancy.
  • Moran shift: difference in multivariate Moran’s I (Itar − Isrc) computed from spatially weighted covariate matrices; measures change in spatial autocorrelation (clustering vs dispersion).
• Evaluation & analysis:
  • Transfer performance measured using OD-flow similarity and error metrics (common part of commuters, Jensen–Shannon divergence, RMSE, etc.; the paper uses standard OD measures).
  • Associations between domain shifts and transferability analyzed with linear mixed-effects regression, accounting for spatial heterogeneity and nested data structure.
• Key methodological point: both shift metrics are model-agnostic and computable from input covariates prior to training.

Implications for AI Economics

• For economic analyses using synthetic mobility flows (labor market matching, commuting-cost estimates, regional economic modeling, spatial inequality studies), unrecognized geographic domain shift can introduce systematic bias:
  • If a generator is trained in regions with different feature distributions or spatial structures than the target, synthesized flows may misrepresent commuting patterns, yielding biased estimates of commuting times, accessibility, segregation measures, or local labor supply/demand.
• Practical actions for economists and policymakers:
  • Pre-deployment diagnostics: compute MI and Moran shift between available training data and target region(s) to gauge expected transfer difficulty and to quantify uncertainty in downstream economic estimates.
  • Training-data selection: prioritize training regions with low domain shift relative to target areas, or combine multiple source regions weighted by domain-similarity scores to reduce bias in synthesized mobility used in economic models.
  • Targeted data collection: use domain-shift metrics to identify high-shift regions where collecting even small amounts of ground-truth mobility data will yield the largest improvements in synthetic-data quality per cost.
  • Reporting and inference: require papers and reports that use synthesized mobility data to disclose geographic domain-shift diagnostics and to propagate transfer-related uncertainty into economic inference and policy recommendations.
• Model & market implications:
  • Developers of GeoAI models and providers of synthetic mobility data can use these metrics to certify or price product applicability by region (a quantified “transferability rating”), improving transparency in data markets.
  • Regulators and funders should consider domain-shift–based fairness checks: synthetic-data pipelines that underperform systematically in certain (often underserved) regions can exacerbate inequities in resource allocation and policy decisions.
• Research and methodological extensions:
  • Incorporate domain-shift metrics directly in model selection, ensemble weighting, or domain-adaptive training objectives to improve economic validity of downstream analyses.
  • Use shifts to prioritize which economic outcomes are safe to estimate from transferred models (low-shift contexts) versus those needing local data or careful adjustment (high-shift contexts).
  • Integrate domain-shift awareness into cost–benefit calculations for data collection investments: compare marginal gains in inference quality against data-collection costs across regions.

Concluding note: The paper gives economists practical, quantitative tools to assess and mitigate geographic transfer risk when using synthetic mobility data, supporting more credible, fair, and cost-effective economic analyses that rely on GeoAI-generated mobility.