0 cumulative citations
View corpus contextLLM tutors prod early and often and prefer full solutions to hints, boosting short-term performance but undermining transfer; simulation-based tests show AI assistants prioritize immediate task success over fostering deeper learning.
AI Assistants Overassist
In simulated tutoring episodes across coding, math, and puzzles, LLM 'teachers' intervene earlier and more often than humans and tend to give full solutions instead of targeted hints, improving immediate success but hurting generalization to new problems.
Citation observations
Cumulative provider counts captured on specific dates; providers are never combined.
Large language models (LLMs) are increasingly used as tutors and thought partners, helping users reason through problems. While guidance from AI assistants can scaffold thinking and foster learning, such benefits depend on how they help--for instance, intervening too early or too frequently may hinder true learning and cognitive engagement. Yet how AI systems navigate intervention decisions during problem-solving remains poorly understood. Here, we introduce Int-Bench, a simulation-based benchmark for evaluating LLM interventions during learning. Int-Bench simulates a "student" solving a problem while a "teacher" monitors the student's reasoning and decides whether, when, and how to intervene. Across three domains--code debugging, mathematics, and brain teasers--we evaluate LLM teachers on the frequency and timing of interventions, as well as their impact on both immediate task success and generalization to new problems. We also compare LLMs to humans, finding that LLMs intervene more frequently and earlier than humans. Moreover, in contrast to humans, they tend to provide complete solutions rather than targeted hints. These findings suggest that current LLM assistants often optimize for short-term success rather than supporting the reasoning processes needed for deeper learning and long-term success.
Summary
Main Finding
LLM assistants tend to "overassist": they intervene frequently and early in a learner's reasoning, often providing highly informative (solution-revealing) feedback that boosts short-term task success but fails to support — and can hinder — deeper learning and transfer to new problems. When given full information (an oracle view), models intervene less, later, and more helpfully.
Key Points
- INT-BENCH: The paper introduces INT-BENCH, a simulation benchmark that frames assistance as a sequential intervention game. A teacher model monitors a student reasoning trace and decides whether, when, and how to intervene; effects on immediate accuracy and generalization are measured.
- Experimental scope: 1,500 problems across three domains (500 math, 500 code debugging, 500 brain teasers). Generalization evaluation used 300 validated reference–variant pairs (100 per domain).
- Models: student = Qwen2.5-7B-Instruct (prompted to show step-by-step reasoning). Teachers = GPT-5.2, Gemini 3 Flash, GPT-OSS-120B, DeepSeek-V3.2. Judge = GPT-5.2.
- Intervention regimes:
- Standard: teacher sees incremental chunks of the baseline reasoning trace (increments = 50 characters) and may intervene once.
- Oracle: teacher sees full baseline trace, student answer, and correctness verdict before choosing whether and where to intervene.
- Intervention frequency & timing:
- Standard teachers intervened very frequently (overall ϕ ≈ 0.90) and early (median relative timing τrel ≈ 0.18).
- Oracle teachers intervened less (ϕ ≈ 0.54) and later (τrel ≈ 0.56).
- In Standard mode some models intervened even when the student would have been correct (example: GPT-5.2 and GPT-OSS-120B intervened on 98% and 100% of initially-correct cases in some settings).
- With full information, models almost never intervened when the student would have succeeded (<3%).
- Immediate helpfulness:
- Standard interventions produced moderate net accuracy gains (H ≈ +0.20: ~25.5% of initially-incorrect answers became correct; ~5.4% of initially-correct became incorrect).
- Oracle interventions were more helpful (H ≈ +0.30) and less harmful (only ~1.2% of correct→incorrect).
- Ablations (Stop-and-Answer vs Continue) show domain heterogeneity: in math, allowing students to continue reasoning after intervention mattered; in code, Stop-and-Answer sometimes yielded better immediate gains — consistent with interventions often providing near-complete fixes.
- Generalization / transfer:
- Interventions rarely improved transfer to related (variant) problems beyond the benefit of exposure to the original problem. Intervention-context did not consistently beat problem-context or no-context baselines.
- Interventions tended to be problem-specific (solution leaks) rather than teaching generalizable skills.
- Human comparison (brain teasers):
- Human teachers intervened less often and later than LLMs.
- Humans more often provided hint-like interventions (redirecting or reframing) rather than full solutions. LLMs were more likely to provide solution-leaking feedback.
- Overall interpretation: current LLM teacher policies prioritize immediate task success (reducing visible failure) at the expense of cognitive engagement and transfer.
Data & Methods
- Datasets: DebugEval (code debugging), MATH-500 (mathematics), and 500 brain teasers from Braingle.
- Student baseline performance (unassisted): aggregate ~43% accuracy but domain-skewed (math ~70.4%, code ~45.2%, brain teasers ~14.4%).
- Experiment details:
- Each teacher model run 3× per question; temperature 0.7 for student/teacher, judge temperature 0.
- Standard monitoring: 50-character increments revealed; teacher may intervene once.
- Post-intervention update modes: Standard-Continue (student continues reasoning), Oracle-Continue, Stop-and-Answer (student forced to answer immediately).
- Human study:
- 50 participants (25 Standard, 25 Oracle), 30 brain-teaser problems (reused student traces). Each participant completed 6 trials.
- Metrics:
- Intervention frequency ϕ and conditional frequencies (given baseline correct/incorrect).
- Intervention timing τabs, τrel.
- Immediate helpfulness H (change in correctness for intervened episodes).
- Generalization helpfulness G (change in correctness on variant problems relative to no-context baseline).
- Supplementary analyses: different increment sizes, alternate student models and prompts — qualitative findings robust.
Implications for AI Economics
- Short-run productivity vs human capital accumulation:
- LLMs optimized for immediate correctness create short-term productivity gains (faster task completion, fewer visible errors) but can reduce learning, cognitive engagement, and transfer. Over time this can erode human skill accumulation — a form of human capital depreciation.
- Firms that measure productivity only by immediate outputs (task completion, error rates, response time) will prefer overassisting models, creating a misalignment with long-term labor market health.
- Incentive structures and market failure risk:
- Private incentives (user satisfaction, retention, throughput) favor assistance that maximizes immediate success. This creates an externality: diminished worker skills and lower adaptability, which neither firms nor users fully internalize.
- Without corrective mechanisms, market outcomes may produce widespread dependence on AI for routine reasoning, suppressing demand for training/skill development and potentially lowering wages for high-cognitive-demand tasks.
- Complement vs substitute dynamics:
- Overassistance pushes AI toward substituting for reasoning (solving for the worker) instead of complementing and augmenting human capabilities. This accelerates substitution risk in occupations relying on procedural or analytic tasks.
- Product design and regulation implications:
- Developers should introduce adjustable assistance modes (e.g., scaffolding, hint-first, delayed reveal), reward policies that balance immediate assistance with demonstrable generalization/learning outcomes, and expose controls that let organizations tune the trade-off.
- Evaluation and procurement should include metrics for transfer, learning retention, and task-generalization (e.g., use benchmarks like INT-BENCH), not just immediate accuracy.
- Regulators and educators may need standards/certification for "learning-preserving" AI tools in educational and workplace settings.
- Pricing, compensation, and labor policy:
- Firms enabling long-term skill depreciation create social costs; policy responses could include incentives for training, subsidies for upskilling, or disclosure requirements about how tools affect learning outcomes.
- Labor economists and policymakers should consider dynamic models where AI assistance affects human skill accumulation, job task composition, and wage trajectories; unemployment or wage effects may be delayed and mediated by training availability.
- Research & measurement agenda for AI economics:
- Incorporate learning/transfer metrics into AI system evaluation and cost–benefit analyses.
- Model equilibrium effects where firms choose assistance policies optimizing short-run output under competitive pressure; study long-run human capital and wage consequences.
- Empirical longitudinal studies to quantify skill depreciation from sustained overreliance on AI assistants.
- Mechanism design: design reward structures or regulatory nudges so that deployed assistants trade off immediate accuracy for pedagogically effective scaffolding when appropriate.
- Practical recommendations for firms and institutions:
- Deploy "learning-first" modes for training environments (hint-first, progressive disclosure).
- Allow users/organizations to set assistance conservativeness and track downstream performance (transfer tests).
- Audit assistants for tendency to leak full solutions; prioritize policies that produce targeted hints that encourage user reasoning.
Takeaway: INT-BENCH quantifies a concrete behavioral failure mode — overassistance — that has direct economic consequences: it creates incentives for short-term gains while risking long-term human capital loss. Addressing this requires new evaluation metrics, product choices that preserve learning, and economic policy thinking about externalities from widespread AI deployment.
Assessment
Paper Typedescriptive
Evidence Strengthmedium — The paper provides systematic empirical comparisons (LLM teachers vs. humans) across multiple domains using a simulation-based benchmark and measures both immediate success and generalization; however, the findings rest on simulated students, specific task sets and model prompts rather than real-world randomized interventions with human learners, limiting causal claims about learning in practice.
Methods Rigormedium — The authors construct a clear simulation benchmark (Int-Bench) spanning three domains, define metrics for timing/frequency of interventions and for generalization, and compare multiple LLMs to human behaviour — indicating careful, reproducible evaluation; but rigor is constrained by reliance on simulated ‘student’ behavior models, unspecified sensitivity checks (e.g., different student policies or prompt variants), potential selection of tasks/models, and lack of field validation or randomized experiments with actual learners.
SampleA simulation-based dataset (Int-Bench) of problem-solving episodes in three domains — code debugging, mathematics, and brain teasers — where a simulated 'student' attempts problems and a 'teacher' (various LLMs) decides when/how to intervene; performance evaluated on immediate task success and transfer/generalization to new problems, with a human comparison benchmark (human teacher intervention patterns) used for contrast. (Exact counts of problems, models, and human raters not specified in the summary.)
Themesskills_training human_ai_collab
GeneralizabilitySimulated students may not reflect real human learning dynamics (metacognition, motivation, persistence)., Limited to three domains (code debugging, math, brain teasers); results may not generalize to other skills or complex real-world tasks., Findings depend on the particular LLM architectures, versions, and prompt designs tested., Human comparison sample characteristics and ecological validity (e.g., expert vs. novice teachers) may limit external validity., Short-term simulation outcomes may not predict long-term learning or workplace productivity gains.
Claims (7)
| Claim | Direction | Outcome | Confidence & Evidence | Details |
|---|---|---|---|---|
| We introduce Int-Bench, a simulation-based benchmark for evaluating LLM interventions during learning. Other | positive | availability of a simulation benchmark for intervention evaluation |
Reading fidelity
high
Study strength
medium
|
not reported
|
| Int-Bench simulates a 'student' solving a problem while a 'teacher' monitors the student's reasoning and decides whether, when, and how to intervene. Other | positive | teacher intervention decision behavior (whether, when, how to intervene) |
Reading fidelity
high
Study strength
medium
|
not reported
|
| We evaluate LLM teachers across three domains: code debugging, mathematics, and brain teasers. Other | positive | domain coverage of evaluations |
Reading fidelity
high
Study strength
medium
|
not reported
|
| LLM teachers intervene more frequently and earlier than humans. Decision Quality | negative | frequency and timing of interventions |
Reading fidelity
high
Study strength
medium
|
not reported
|
| In contrast to humans, LLM teachers tend to provide complete solutions rather than targeted hints. Decision Quality | negative | intervention content (complete solutions vs targeted hints) |
Reading fidelity
high
Study strength
medium
|
not reported
|
| We evaluate LLM teachers on the impact of interventions on both immediate task success and generalization to new problems. Output Quality | mixed | immediate task success and generalization to new problems |
Reading fidelity
high
Study strength
medium
|
not reported
|
| Current LLM assistants often optimize for short-term success rather than supporting the reasoning processes needed for deeper learning and long-term success. Skill Acquisition | negative | balance between immediate task success and long-term/deeper learning (generalization) |
Reading fidelity
medium
Study strength
speculative
|
not reported
|