Physiological signals help time AI assistance: in a 32-person experiment, LLM clarifications triggered by electrodermal and mouse-movement cues boosted survey accuracy by 21% and slashed missed-help cases from ~51% to ~23%, while improving users' perceptions of the system.

Main Finding

Personalized, physiologically informed timing of proactive LLM assistance substantially improves survey response quality and user experience. An aligned-adaptive system that used electrodermal activity (EDA) and mouse-movement features to trigger LLM clarifications increased answer accuracy from 41% to 62% (＋21 percentage points), cut missed-assistance (false negative) rates from 50.9% to 22.9%, and yielded higher perceived efficiency, dependability, benevolence, and acceptance compared to misaligned and random timing.

Key Points

• Problem addressed: static, reactive, or rule-based help in self-administered web surveys mis-times assistance; mistimed help can be disruptive, late help fails to prevent cascading errors from early struggles, and users rarely proactively request help.
• Proposed solution: continuous sensing (EDA + mouse dynamics) + personalized classifiers with rule-based threshold adaptation to detect moment-to-moment cognitive struggle and proactively trigger LLM-generated clarifications exactly when needed.
• Core behavioral/physiological indicators: mouse vertical direction changes (ypos_flips), cursor hover duration (hover_time), number of hover events (hovers), and tonic EDA level (tonic_avg). Peak-based EDA features were predictive offline but excluded from real-time use due to latency.
• Intervention: LLM-generated clarifications/explanations delivered when the personalized detector indicates elevated cognitive load; timing is dynamically adapted to each respondent’s baseline and evolving state.
• Experimental results (within-subjects, N=32): aligned-adaptive timing outperformed misaligned-adaptive and random-adaptive controls on objective accuracy, reduced missed-help errors, and subjective measures of system quality and acceptance.
• Design insight: timing alignment with individual cognitive states matters more than a one-size-fits-all content strategy — properly timed support prevents degraded response cascades.

Data & Methods

• Study type: Within-subjects experiment (N = 32) comparing three conditions — aligned-adaptive, misaligned-adaptive (backward-adjusted timing), and random-adaptive.
• Task: Sequential web-based multiple-choice general-knowledge questions designed to create variable item difficulty and potential for cognitive spillover across items.
• Sensors and signals:
  • Physiological: Electrodermal activity (EDA) — tonic EDA used in real time (peaks excluded due to smoothing/latency).
  • Behavioral: Mouse movement dynamics (e.g., vertical direction changes, hover time, count of hover events).
• Feature selection: SelectKBest with f_regression identified top predictive features; chosen features balanced predictive power and real-time computability.
• Models: Personalized classifiers (continuous updating) with rule-based threshold adaptation to align triggers with individual baselines.
• Intervention mechanism: When classifier + adaptive threshold indicated struggle, the system triggered LLM-based clarifications and explanations (proactive, not user-requested).
• Outcomes measured:
  • Objective: response accuracy, false negative rate for assistance opportunities (missed needs).
  • Subjective: perceived efficiency, dependability, benevolence, and intervention acceptance rates.
• Key quantitative results:
  • Accuracy: increased from 41% (baseline/control) to 62% in aligned-adaptive condition.
  • False negatives: reduced from 50.9% to 22.9% with aligned-adaptive timing.
  • Subjective ratings and acceptance: significantly higher for aligned-adaptive.

Implications for AI Economics

• Measurement-quality economics
  • Better-timed LLM assistance materially reduces measurement error in survey-collected data (accuracy +21 pp; fewer missed-help events). Higher-quality survey data improves the value of downstream economic analyses, policy evaluation, and market research that rely on survey inputs.
  • Fewer measurement errors can reduce required sample sizes or increase effective precision for the same sample, lowering marginal data-collection costs. Back-of-envelope: a substantive accuracy gain can reduce variance-driven sample requirements (though precise savings require task-specific power calculations).
• Product and market opportunities
  • Market for "proactive LLM-assisted survey platforms": firms can differentiate on real-time personalization and charge premiums to clients (researchers, pollsters, market-research firms) that value higher data quality.
  • Two-tier offerings: low-cost, scalable behavioral-only versions (mouse dynamics) vs higher-accuracy, higher-cost multimodal versions that use wearables (EDA). The latter targets high-stakes assessments (clinical, educational, national surveys) where accuracy/value justifies hardware costs.
• Technology adoption and labor effects
  • Potential substitution of live interviewers for automated, sensor-driven, LLM-mediated assistance in many tasks. This may reduce labor costs for large-scale self-administered surveys but also change the skill composition of jobs (monitoring, model maintenance, ethical oversight).
  • Risk of “learned helplessness” noted in related work: if LLMs intervene too often or mistime support, respondents may rely excessively on assistance, affecting effort incentives and possibly changing test-taking behavior. Economic models of human–AI complementarity should incorporate temporal alignment as a key parameter.
• Costs, scalability, and externalities
  • Sensor costs and privacy: EDA requires wearables (or alternative physiological capture) which increases per-respondent costs and raises privacy/regulatory concerns. Mouse dynamics alone are cheap and privacy-light but provide weaker signals—trade-offs matter for scaling.
  • Sample selection bias: requiring wearables or explicit consenting to physiological monitoring may skew samples (e.g., wealthier, tech-savvy, privacy-tolerant participants), introducing representativeness issues and potential economic biases in inferred population parameters.
  • Data governance and compliance: collecting physiological signals raises regulatory scrutiny (health-related inferences). Firms must internalize compliance costs and potential reputational risks.
• Welfare and distributional considerations
  • Equity: if high-accuracy, sensor-enabled surveys become the standard for high-value decisions (credit scoring, targeted health interventions), populations less likely to adopt sensors could be underserved or misrepresented.
  • Incentive effects: improved measurement could change payoff structures in markets that rely on surveys (advertising targeting, labor-market signaling), potentially increasing efficiency but also redistributing gains.
• Research and investment priorities
  • Need for cost–benefit analyses comparing improved accuracy against sensor/hardware costs and privacy compliance overheads in different survey contexts.
  • Field trials at scale to measure real-world gains in economic outcomes (e.g., policy targeting accuracy, market segmentation efficiency).
  • Development of privacy-preserving, low-cost sensing alternatives (e.g., richer behavioral features, webcam-derived signals under strict consent) to democratize benefits.
  • Models of adoption dynamics: how timing-sensitive benefits interact with user acceptance, regulation, and market competition.

Summary takeaway: Aligning proactive LLM support with momentary, personalized cognitive states delivers measurable gains in data quality and user experience. For AI economics, this creates value through improved measurement and new product opportunities but raises nontrivial cost, privacy, equity, and adoption trade-offs that should be evaluated with economic models and field experiments.