A new intervention-driven audit exposes when a model's behavior is truly unique: passive logs can't identify uniqueness, but adaptive matched queries can detect irreducible behavior efficiently while attribution games miss redundancy.

Main Finding

The paper introduces a principled, intervention-based framework—In-Silico Quasi-Experimental Design (ISQED)—for auditing model uniqueness in heterogeneous AI ecosystems. It defines a quantitative measure, the Peer-Inexpressible Residual (PIER), that captures the portion of a target model’s behavior that cannot be replicated by any stochastic convex combination of peer models. The authors prove that (1) uniqueness cannot be identified from passive observational logs alone, (2) active auditing with matched interventions can detect uniqueness with minimax‑optimal sample complexity (scaling as dσ²γ⁻² log(Nd/δ)), and (3) cooperative game‑theoretic attribution methods (e.g., Shapley values) fundamentally fail to detect redundancy. They implement the DISCO (Design‑Integrated Synthetic Control) estimator and validate the framework across vision, language, and traffic‑forecasting ecosystems.

Key Points

• Problem framed: ecosystems of foundation models + adapters create governance needs to distinguish genuine novelty from redundant behavior that could be substituted by routing to peers.
• ISQED concept: enforce matched interventions (controlled, comparable queries) across models so differences reflect intrinsic model identity rather than input or deployment confounds.
• PIER (Peer‑Inexpressible Residual): the component of a target model’s output strictly irreducible to any stochastic convex combination of other models’ outputs. Vanishing PIER implies the target is substitutable via routing.
• Observational impossibility: without intervention control, uniqueness is mathematically non‑identifiable—passive logs can’t separate intrinsic model differences from selective exposure or input selection.
• Active auditing & sample complexity: an adaptive query protocol achieves minimax‑optimal sample efficiency with complexity proportional to dσ²γ⁻² log(Nd/δ), where d = effective output dimension, σ² = noise variance, γ = uniqueness gap (PIER magnitude threshold), N = number of peers, δ = failure probability.
• Attribution limits: widely used cooperative game‑theoretic explanations like Shapley values can misattribute value and fundamentally cannot detect representational redundancy that ISQED targets.
• Practical implementation: DISCO estimator operationalizes ISQED and is applied to ResNet/ConvNeXt/ViT (vision), BERT/RoBERTa (language), and city‑scale traffic forecasters, demonstrating practical detection of redundancy vs uniqueness.

Data & Methods

• Framework:
  • ISQED enforces matched interventions: identical controlled inputs or perturbation designs are presented to each model to ensure comparability.
  • Uniqueness operationalized as the minimal residual when approximating the target’s responses by stochastic convex combinations of peer responses.
• Theoretical results:
  • Non‑identifiability theorem for passive data: shows observational logs can be consistent with multiple latent substitution explanations.
  • Minimax lower/upper bounds for active auditing: adaptive querying achieves sample complexity O(dσ²γ⁻² log(Nd/δ)), shown to be optimal.
  • Impossibility for certain attribution methods: formal arguments that Shapley‑style marginal contributions do not reveal peer‑inexpressible components.
• Estimator and protocol:
  • DISCO (Design‑Integrated Synthetic Control): integrates design of matched interventions with synthetic control style fitting (stochastic convex weights) and residual testing for PIER.
  • Adaptive query protocol: chooses interventions to efficiently reduce uncertainty about the target’s PIER, leveraging structure in the response space to reach minimax rates.
• Empirical evaluation:
  • Benchmarks span modalities and application domains: image classifiers (ResNet, ConvNeXt, ViT), language encoders (BERT, RoBERTa), and urban traffic forecasting networks.
  • Experiments show capability to detect near‑redundancy (vanishing PIER) and to distinguish genuinely unique behavior from routable substitutes; also show cases where Shapley explanations give misleading impressions of uniqueness.

Implications for AI Economics

• Market differentiation and product substitutability:
  • PIER provides a measurable notion of functional differentiation between models; vanishing PIER signals high substitutability, which matters for competition analysis, platform bundling, and procurement decisions.
  • Economic valuation of models (pricing/licensing) should account for PIER: models with low PIER offer limited marginal value in an ecosystem already containing their substitutes.
• Competition policy and antitrust:
  • Regulators can use intervention‑based audits to detect apparent “choice” that is superficial (many products, little functional diversity), informing merger reviews and assessments of market concentration.
  • PIER-based audits can reveal whether dominant providers are actually offering unique capabilities or merely rebranding routable models.
• Procurement and platform design:
  • Buyers (enterprises, governments) can audit suppliers to avoid paying for redundant models and to design routing strategies that exploit substitutable peers for cost efficiency and fault tolerance.
  • Platform providers can certify model uniqueness claims substantively, shaping standards for “novel model” claims in procurement contracts.
• Incentives for specialization vs redundancy:
  • Measuring uniqueness affects incentives for model providers: clear auditability can promote genuine specialization and discourage superficial variation that adds little value.
  • Conversely, providers may try to game audits by small targeted modifications; governance frameworks must account for strategic responses and update auditing designs.
• Systemic risk and robustness:
  • Ecosystems with low aggregate PIER are more vulnerable to correlated failures but easier to substitute; high aggregate PIER implies diversity that may reduce systemic risk but could reduce short‑term routability and raise switching costs.
  • Audits can inform insurance, liability, and systemic‑risk regulation by quantifying the extent to which services are fungible across providers.
• Measurement and metrics for policy:
  • PIER and ISQED offer actionable metrics for policymakers and market analysts to quantify and monitor model heterogeneity over time, complementing conventional market share and usage statistics.
• Costs, feasibility, and limitations affecting economics:
  • Active auditing requires the ability to issue controlled queries and observe model outputs, which may be limited by access, pricing, or privacy constraints—these transaction costs shape feasibility and cost‑benefit calculations for regulators and buyers.
  • Computational and query costs scale with dimension and desired confidence (per the sample complexity), which influences who can realistically perform audits (large buyers/regulators vs small firms).
  • Strategic behavior and dynamic model updates may require continual re‑auditing; policy design must consider enforcement and update cycles.

Limitations & open questions relevant to economic use: - ISQED presumes the ability to perform matched interventions and observe outputs; constrained access or black‑box APIs limit applicability. - The theoretical model assumes approximation by stochastic convex combinations; richer compositional substitution (nonlinear selectors, conditional routing) needs extension. - Strategic gaming, model updates, and privacy considerations pose practical enforcement and cost challenges for deploying PIER‑based audits in markets.