Partial disclosure rules can markedly raise consumer adoption of high-quality AI and reduce accidental reliance on low-quality systems; however, persistent information asymmetries in AI markets still depress uptake when low-quality products are common.

Main Finding

Information asymmetries in AI marketplaces produce classic "market for lemons" dynamics: when users lack reliable signals about AI system quality, they either under-use helpful systems (when lemons are rare) or over-rely on poor systems (when lemons are common). A simple, partial disclosure (revealing an accuracy score but not data-quality/generalizability) substantially improves the quality of delegated choices and offsets a large increase in lemon density, while full, complete disclosure can still leave users inefficiently under‑adopting even when they can perfectly distinguish good from bad systems.

Key Points

• Experimental setup: a simulated AI product market where participants choose whether to delegate decisions to one of multiple AI systems across repeated rounds. Each AI has two latent quality dimensions: accuracy and data quality (generalizability).
• Design: between-subjects 3 (lemon density: Low / Medium / High) × 2 (disclosure: No Disclosure / Partial Disclosure) plus a Full Disclosure benchmark (High Density with both signals visible).
• No Disclosure results:
  • Participants detect lemon prevalence but fail to calibrate reliance well over time.
  • In Low Density: participants under-utilize AI and miss performance gains.
  • In High Density: participants over-rely on AI and suffer from delegating to poor systems.
  • Learning across rounds is limited.
• Partial Disclosure (only accuracy shown):
  • Strongly improves the selection of high-quality systems and the efficiency of delegated decisions.
  • Yields substantial performance gains in Low and Medium lemon densities; improvements shrink when lemons dominate.
  • Does not significantly alter overall delegation rates—it improves the quality, not quantity, of delegation.
  • Is behaviorally powerful enough to offset roughly a doubling in lemon prevalence.
• Full Disclosure (accuracy + data quality) benchmark:
  • Participants successfully avoid lemons but still adopt AI less than would be optimal.
  • Even fully informed users delegated to the highest-quality systems only a fraction of the time (≈58% of predictions delegated to systems with 90% correctness), producing ~20% average losses versus full delegation—suggesting risk aversion or other behavioral frictions.
• Takeaway: transparency that is actionable and simple can outperform more verbose/full disclosure in terms of realized user outcomes; disclosure alone is necessary but not sufficient due to bounded rationality and risk preferences.

Data & Methods

• Simulated interactive experiment where participants performed three different decision tasks across 10 rounds. On each trial they could 1) act without AI, or 2) delegate to one AI among ten alternatives.
• Each AI system characterized by two scores:
  • Accuracy (probability of correct prediction for the task).
  • Data quality (a proxy for generalizability across instances).
• Disclosure treatments:
  • No Disclosure: users see no quality indicators.
  • Partial Disclosure: users see only the accuracy score.
  • Full Disclosure (benchmark): users see both accuracy and data quality.
• Lemon density manipulated across groups by varying the proportion of low-quality AI systems in the available pool (Low / Medium / High).
• User interface allowed inspection (hover) of available signals where applicable, selection of an AI, and delegation of a decision (illustrated with a deceptive-review detection task).
• Outcome measures: delegation rates, selection of low- vs high-quality AIs, task performance (correct decisions), learning over rounds. Results compared to a rational Bayesian benchmark model to assess deviations from optimal updating.
• Note: the excerpt did not report sample size or participant demographics; full paper likely contains these details.

Implications for AI Economics

• Market efficiency and welfare:
  • Information asymmetry can create inefficient equilibria resembling a market for lemons in AI markets. Without corrective signaling institutions, users either under‑utilize beneficial AI or over‑adopt harmful ones depending on lemon prevalence.
  • Simple, credible disclosure signals (even partial ones) can materially improve market selection and aggregate performance, suggesting a high welfare payoff from lightweight, actionable disclosure policies.
• Regulatory design:
  • Policy instruments (e.g., EU AI Act) should prioritize enforceable, easy-to-interpret disclosure that is strategy‑proof and minimizes opportunities for selective or misleading reporting.
  • Full/complex reports may not increase adoption or improve welfare because of user risk aversion, bounded rationality, or cognitive overload—regulators should focus on actionable signals and salience.
• Market institutions:
  • Complementary interventions (third‑party certification, audited benchmarks, reputational systems) remain important because disclosure alone cannot eliminate behavioral frictions or gaming by suppliers.
  • Disclosure standards should be designed to minimize strategic hiding (selective disclosure) and to be robust to supplier incentives to obfuscate.
• Research and policy priorities:
  • Evaluate which signal formats (e.g., numeric accuracy, simple grades, calibrated risk bands) are most actionable for typical users and how those interact with lemon prevalence.
  • Study dynamic markets with reputational effects, heterogeneous users (experts vs lay), stakes variation, and additional quality dimensions (robustness, fairness, uncertainty) to refine policy prescriptions.
• Practical takeaway for firms and platforms:
  • Present concise, trustworthy, and easily comparable signals of AI performance to users; improving actionability of quality disclosures likely yields greater adoption of genuinely high-quality systems and reduces harm from lemons.