Explanations can help or hurt: adaptive transparency that gauges users' cognitive capacity beats always-on or always-off disclosure, offering information when users have resources to use it and withholding it when cognitive load would erode control.

Main Finding

The paper develops a formal stochastic-control theory explaining the "transparency paradox": AI explanations can either improve or impair human decision-making depending on users' evolving cognitive state. Modeling perceived autonomy as a continuous stochastic process (geometric Brownian motion) whose drift declines with information, the authors derive that optimal transparency is dynamic and threshold-based: provide explanations when autonomy/resources are high, withhold them when resources are depleted. Adaptive (state-dependent) transparency policies outperform fixed maximal or minimal transparency.

Key Points

• Core mechanism — autonomy depletion: Explanations trigger metacognitive processing that consumes working memory and reduces subjective control (autonomy). When load exceeds capacity, users disengage and decision quality falls.
• Formal model:
  • Autonomy At > 0 evolves as dAt = µ(It)At dt + σA At dW A
  • Drift µ(I) = µ0 − βI − γI^2 captures linear and accelerating negative effects of information on autonomy.
  • Information It follows controlled accrual dIt = α(ut) dt + σI dW I with control ut ∈ [0, umax].
  • Disengagement occurs when At hits boundary B(WM) = B0 − βWM·WM, linking working memory (WM) to tolerance.
• Analytical results:
  • Closed-form solution for At under constant I: log-normal dynamics; mean E[At] = A0 exp(µ(I)t); variance grows over time.
  • Expected hitting time (disengagement) derived: higher transparency shortens time to disengagement when µ(I) is sufficiently negative.
• Optimal control:
  • Objective trades decision quality (an inverted-U in I) against autonomy costs and information provision costs.
  • HJB characterization yields threshold/bang-bang optimal policies: supply maximal information when marginal value VI > cost threshold, otherwise withhold (u* ∈ {0, umax}).
  • Threshold properties: higher autonomy raises the information threshold (can tolerate more info); time pressure lowers it (more willingness to accept info near deadlines).
• Testable predictions (five):
• Mean autonomy trajectories follow exponential change with µ(I); high transparency → exponential decay.
• Autonomy variance increases over time (growing between-subject heterogeneity).
• Disengagement time decreases as transparency increases.
• Individuals with higher WM persist longer under high transparency.
• Log-autonomy should be approximately normal under this diffusion specification.
• Computational demonstrations: Monte Carlo simulations (parameters grounded in cognitive literature) show dynamic transparency policies outperform fixed extremes and exhibit threshold structure.
• Practical design principles: implement adaptive transparency (real-time cognitive-state sensing or budgets), cap explanation complexity relative to WM, and personalize thresholds by individual capacity.

Data & Methods

• Approach: theoretical modeling + stochastic control + Monte Carlo simulation. No primary experimental data collected.
• Key model components and assumptions:
  • Autonomy modeled as geometric Brownian motion to ensure positivity and proportional effects.
  • Drift function quadratic in information: µ(I) = µ0 − βI − γI^2 (Lipschitz continuity assumed for existence/uniqueness).
  • Information control enters via acquisition rate α(u) (often linearized) and can be noisy; correlation ρ between autonomy and information shocks allowed (authors focus on ρ ≤ 0).
  • Disengagement modeled as hitting an absorbing boundary B(WM), decreasing in working memory capacity.
  • Reward combines an inverted-U decision quality Q(I) and autonomy cost C(A), leading to an HJB optimal control problem.
• Analytical results: explicit solution for autonomy under constant I, analytical hitting-time expression, HJB formulation, bang-bang solution characterization, threshold comparative statics.
• Computational methods: Monte Carlo simulation to solve/control the SDEs and numerically evaluate policies; parameter choices anchored to prior cognitive-psych literature (e.g., µ0, σA, WM ranges). Sensitivity analyses noted for ρ and other parameters.
• Measurement/operationalization guidance (for empirical tests):
  • Autonomy: repeated self-report scales (e.g., Intrinsic Motivation Inventory subscale) or physiological proxies (HRV, EDA) sampled periodically.
  • Disengagement: behavioral markers (opting out of aid, declining acceptance of recommendations, task abandonment, response latency).
  • Information level: manipulated by explanation complexity (feature count, granularity, local vs global explanations).
  • WM: standard tests (Operation Span, N-back) to capture individual heterogeneity.

Implications for AI Economics

• Transparency is not universally welfare-improving. Mandates or default maximal-transparency designs can reduce user welfare and decision quality by imposing cognitive costs that lead to disengagement, producing negative externalities in high-stakes domains (healthcare, finance, safety-critical systems).
• Dynamic/adaptive transparency is economically valuable. Systems that invest in sensing user cognitive state (or use behavioral proxies) and adapt explanation quantity/timing can increase aggregate decision quality and user engagement—this creates incentives for firms to develop adaptive explainability technologies.
• Personalization and heterogeneity matter for policy and market design:
  • Consumers/workers differ in WM capacity; one-size-fits-all transparency may be inefficient and inequitable. Product differentiation or personalized defaults can yield higher surplus but raises distributional concerns (who gets richer explanations?).
  • Firms could monetize personalization (better UX) or face regulatory pressure to provide adaptive transparency for vulnerable populations.
• Regulatory trade-offs:
  • Transparency-as-legal requirement (e.g., right-to-explanation rules) should consider cognitive capacity constraints and timing: policies could specify adaptive disclosure rules or require explanation “budgets” rather than unconditional full transparency.
  • Auditing and compliance frameworks should incorporate outcome-based metrics (decision quality, disengagement) not only information disclosure.
• Cost–benefit and procurement implications:
  • Procurers (hospitals, governments) should evaluate explanation designs in procurement by estimating marginal benefits of information vs. cognitive costs—dynamic policies may change cost-effectiveness calculus.
  • Training and interface investments (e.g., reducing cognitive cost of explanations via visual design, summarization, sequential disclosure) can be substitutes for reducing information content and may be more cost-effective.
• Labor and productivity:
  • Workplace AI that exposes employees to excessive explanations may reduce productivity through autonomy depletion; conversely, well-timed, concise explanations can increase effective oversight and productivity.
• Empirical agenda for economists:
  • Run RCTs varying explanation complexity and timing; measure decision outcomes, opt-out/disengagement, and heterogeneity by WM proxies.
  • Structural estimation: fit the paper's SDE/hitting-time model to panel autonomy/engagement data to estimate µ0, β, γ, σA and the social value of adaptive disclosure.
  • Policy simulations: compare welfare under fixed-disclosure mandates vs. adaptive disclosure with monitoring costs.
  • Consider strategic firm responses: whether firms will 1) under-provide adaptive transparency to reduce user churn or 2) over-invest to differentiate products.
• Broader market effects: If adaptive transparency improves user outcomes, platforms that adopt it can capture gains via higher retention and better decision outcomes, potentially shifting equilibrium standards for explainability.

Limitations to keep in mind (relevant for economic modeling and policymaking): - Model assumptions (geometric Brownian motion, quadratic drift) are chosen for tractability and may not capture jumps or discrete cognitive events. - Theoretical framework needs empirical validation; behavioral measures of autonomy and real-time sensing introduce measurement costs and noise. - Implementation costs for adaptive transparency (sensor/inference costs, privacy concerns) matter for net welfare comparisons and were not costed in the paper’s simulations.

Bottom line: economic analysis and policy on explainability should move beyond blanket transparency mandates and evaluate adaptive, personalized disclosure that balances the informational benefits against cognitive costs and disengagement risks.