How AI is placed in lessons decides whether it teaches or short-circuits learning — an unguarded AI helper reduced students' unaided exam scores by about 17%, while a constrained assistant removed the harm and a tutor-style system roughly doubled learning. Educators should require a hard initial attempt and an unaided final check, using guarded AI scaffolds in between.

Main Finding

AI can dramatically expand access to high-quality tutoring and practice, but its effect on learning depends entirely on where and how it is placed in the learning process. When AI replaces the student’s necessary productive struggle (the “effortless trap”), it creates an illusion of learning and reduces unaided competence. Conversely, when AI is guarded to withhold answers and used to scale feedback, examples, and practice between two protected no-AI moments, it can eliminate harm or substantially increase learning.

Key Points

• The paper proposes a compact process model for learning a single idea: the six moves — Prime, Probe, Point, Attach, Strengthen, Test.
  • Prime: wake prior knowledge and motivation (low risk for AI).
  • Probe: first hard, unaided attempt (AI-out).
  • Point: guided questioning/hints (guarded AI ok).
  • Attach: worked example shown after struggle (guarded AI ok).
  • Strengthen: varied practice and explanation (guarded AI ok).
  • Test: final unaided check of mastery (AI-out).
• Placement rule (per-skill): secure the Probe and Test as AI-free; allow answer-withholding, hinting, example-generation, and high-density practice from AI in the middle moves. Diagnostic: if AI makes the task feel effortless, it is likely in the wrong place.
• Empirical highlights:
  • Bastani et al. (2025), RCT (~1,000 high-school math students): an unguarded AI chatbot improved in-task performance but caused ~17% worse scores on an unaided exam vs. a no-AI control; rebuilding the same model to withhold answers (“guarded-AI”) erased the harm.
  • Kestin et al. (2025), RCT in undergraduate physics: a carefully engineered AI tutor produced roughly double the learning of a strong active-learning class, in less time.
  • Shen & Tamkin (2026): software engineers using an AI assistant performed tasks well but learned concepts less—showing immediate performance gains can mask reduced conceptual learning.
• The “effortless trap”: AI that reduces the cognitive effort required for the target skill can boost apparent fluency while undermining durable learning and transfer.
• Policy and practice framing: institutions should adopt placement-by-skill governance (not blanket allow/ban), and secure the AI-free assessment point to protect credential validity.

Data & Methods

• Type of paper: conceptual/framework paper grounded in cognitive-science theory and evidence synthesis, and informed by recent randomized controlled trials and lab studies.
• Key empirical sources cited:
  • Randomized controlled trials:
    • Bastani et al. (2025): near-1,000 high-school math students; treatment arms included unguarded-AI, guarded-AI (answer-withholding hints), and no-AI control. Main result: unguarded-AI group scored ≈17% worse on subsequent unaided exam vs. control; guarded-AI erased the harm.
    • Kestin et al. (2025): undergraduate physics RCT comparing an engineered AI tutor to a strong active-learning baseline; reported ~2x learning gain for AI tutor.
  • Experimental/behavioral studies:
    • Shen & Tamkin (2026): coding tasks showing assistants can improve immediate task performance while reducing conceptual learning.
  • Foundational cognitive literature: productive struggle, productive failure, worked-example effect, retrieval practice, expertise-reversal and cognitive-load theories (Kapur; Sweller; Roediger & Karpicke; VanLehn; Bloom).
• Methods synthesize RCT evidence with cognitive theory to derive prescriptive placement recommendations. The model focuses on first-encounter single-pass learning; long-term spacing/retention is noted as an additional layer.
• Limitations acknowledged: AI education evidence is young; heterogeneity across subjects, student prior skill, and exact tool design means empirical generalization requires more trials and longer-term follow-up.

Implications for AI Economics

• Value creation is design-dependent: AI can produce large social returns by cheaply scaling near one-on-one tutoring (high potential complementarities with human tutors), but returns collapse or turn negative if products encourage cognitive offloading of target skills.
• Labor and productivity:
  • Augmentation: well-designed AI tutors can raise effective teacher productivity and expand high-quality instruction supply, potentially increasing human capital accumulation at lower cost.
  • Substitution/misalignment risk: products that shortcut learning may reduce future skill formation, lowering worker productivity and creating downstream negative externalities for labor markets.
• Market failures and incentives:
  • Provider incentives (engagement, short-run performance metrics) can push toward answer-giving features that harm long-run learning—misaligned privately optimal designs vs. socially optimal learning outcomes.
  • Information asymmetries: buyers (schools/students) may not observe unaided mastery or long-run retention; firms may under-disclose harmful placements.
  • Credentialing externalities: if AI can complete most unsupervised work, institutions must secure assessment points (AI-free Test) to maintain credential credibility—creating demand for reliable proctoring and assessment redesign.
• Policy and procurement:
  • Procurement should emphasize per-skill placement constraints, require RCT evidence on unaided competency/transfer, and prioritize tools that implement guarded, answer-withholding regimes for formative use.
  • Subsidies or public procurement could favor vetted, high-effect AI-tutors for under-resourced schools to reduce inequality, but safeguards are essential to avoid harm.
• Measurement and evaluation:
  • Economic evaluation should track unaided competence, transfer, long-term retention, and labor-market outcomes, not just in-task performance or engagement.
  • Cost-effectiveness studies (RCTs with lifetime or at least multi-term follow-up) are critical to assess returns on educational AI investments.
• Firm strategy and R&D priorities:
  • Firms should develop guardrail technologies (answer-withholding modes, timing gates, calibration by prior skill), metrics tied to unaided performance, and tools that support teacher workflow rather than replace the protected struggle.
  • Opportunity for markets for assessment-security, teacher-facing interfaces, and audit/validation services.
• Equity implications:
  • Upside: properly deployed AI could reduce disparities by cheaply delivering tailored practice and feedback.
  • Downside: uneven adoption of well-designed vs. unguarded products could widen gaps if disadvantaged students receive lower-quality deployments.
• Research agenda for economists:
  • Quantify heterogeneity in AI placement effects by prior skill, subject matter, and socio-economic context.
  • Long-run studies linking AI-enabled instruction to labor-market outcomes.
  • Market-structure analysis of incentives that drive harmful vs. helpful product design; evaluation of regulation and procurement interventions.

Summary takeaway: the economic promise of AI in education is large but precarious—real gains depend on placement and design that preserve students’ productive struggle and unaided proof of mastery. Policymakers, purchasers, and firms should reorient incentives, measurement, and procurement toward per-skill placement rules and outcome metrics that reward durable, unaided learning.