The Commonplace
Home Three-study pilot Papers Evidence Explore Trends Syntheses Digests References Docs 🎲 Workforce Futures
← Papers
Direction, evidence grade, and study type are AI-generated labels (gpt-5-mini), not human-verified. Syntheses are LLM-written. "Tensions" are machine-detected candidates, not confirmed contradictions. A research-acceleration tool, not peer review. How this is built →

Randomized evidence shows typical job-training programs yield only modest labor-market gains—about a 1.7 percentage-point employment uptick and ~$800 extra per year—while a few employer-led 'sector' programs produce tenfold earnings gains but rely on heavy selection and close employer relationships that resist rapid scaling.

An evidence review of worker retraining
David Roodman, Maxim Massenkoff · September 07, 2026
arxiv review_meta medium evidence 7/10 relevance Full text usable extracted full text Source PDF

Structured author observations

Linked only from stored provider relations; the raw author line above is never matched by name.

Arxiv

Latest observation:

  1. David Roodman unresolved corpus identity
  2. Maxim Massenkoff unresolved corpus identity
A comprehensive review and meta-analysis of randomized trials finds subsidized job training raises employment modestly (≈1.7 percentage points in years 3–5) and annual earnings by roughly $800 on average, while selective employer-engaged 'sector programs' deliver much larger earnings gains (~$5–10k/year) but depend on intensive screening and employer ties that are hard to scale.

Citation observations

Cumulative provider counts captured on specific dates; providers are never combined.

No provider observation is available for this paper.

Missing data, not a zero citation count.

We review the evidence on subsidized job training programs in industrial countries. We provide critical, narrative summaries of randomized studies of major job training in the US; of two "judge randomization" studies in the US and Denmark; and of previous meta-analyses. We then perform a meta-analysis of 56 randomized trials of job training in the US since 1973, the most exhaustive meta-analysis in this niche. Here, average impacts are positive but modest: employment rises 1.7 percentage points in years 3-5, and annual pre-tax earnings by roughly \$800 per person offered training. At an average cost of \$13,598 per participant, programs roughly break even under (debatable) assumptions about how long benefits persist. They recoup about three-quarters of their cost for government through higher tax revenue and lower benefit use. Evaluations of the largest federal efforts--JTPA, the Workforce Investment Act, and Job Corps--return small or null effects. One cluster of programs stands out: "sector programs," which screen applicants intensively, design curricula with employers, and track local skill demand. They raise earnings roughly ten times as much. They have proven difficult to replicate.

Summary

Main Finding

Across 56 randomized trials in the US (146 impact estimates), subsidized job training has on average small positive impacts: employment rises about 1.7 percentage points in years 3–5 after assignment and annual pre‑tax earnings rise roughly $800 per person offered training. At typical program costs (~$13,600 per participant) these programs are roughly break‑even under plausible (but debatable) assumptions about persistence of effects. A distinct subset—“sector programs” that screen applicants, co‑design curriculum with employers, and directly place trainees—produce much larger, often sustained gains (order $5–10k/year), but they are selective, privately run, and hard to replicate at scale.

Key Points

  • Evidence base
    • Meta‑analysis: 56 randomized US trials (1973–present), 146 outcome estimates; supplemented by a few high‑quality European and judge‑randomization studies.
    • Follow‑up windows are typically short (most studies stop by year 6).
  • Average impacts (training-primary interventions)
    • Employment: +2.8 pp in year 2; +1.7 pp in years 3–5 (per person offered training).
    • Earnings: ~$1,139 (year 2) and ~$791 (years 3–5) in 2025 dollars (per person offered treatment).
  • Costs and benefit accounting
    • Average program cost (67% of interventions that report costs): ~$13,598 per treatment‑group member.
    • Estimated NPV of earnings impact (projecting benefits to retirement): ~$14,146; rises to ~$19,525 including employer‑paid taxes and fringe benefits. Result: modestly better than break‑even under the report’s projection assumptions.
    • From the government’s perspective, higher taxes and lower benefits recoup ~75% of program cost, leaving a long‑run fiscal cost of roughly 24% of upfront spending.
  • Compliance and interpretation
    • Non‑compliance is common: treated individuals are 66 percentage points more likely to receive targeted training; only 28 percentage points more likely to receive any training versus control.
    • Estimates are reported per offer; impacts per actual trainee are ~2–4× larger, but that is an upper‑bound estimate and depends on higher compliance scenarios.
  • Large federal programs
    • JTPA (late 1980s): modest positive impacts (employment +~2.3 pp; earnings +~$1,100).
    • Job Corps: essentially null long‑run impacts (minor transitory effects years 3–5).
    • Workforce Investment Act evaluations: essentially zero impacts for adults and dislocated workers (low uptake differential reduced estimated treatment effects).
  • Sector programs
    • Examples: Year Up, Per Scholas, Wisconsin Regional Training Partnership.
    • Typical traits: intensive applicant screening (often rejecting >80% / accepting ~1-in-5), strong employer engagement in curriculum and placement, short‑to‑medium duration skills training plus soft skills and placement services, privately run.
    • Costs comparable or lower than average training programs ($11,602 vs $13,598 average) but much larger present value earnings impacts (~$60,319), implying high benefit‑cost ratios (report cites ~7× for the sector cluster).
    • Replication and scaling have been difficult; success appears to rest on employer relationships, selectivity, and local labor‑market intelligence.
  • Dislocated workers / trade‑affected groups
    • Evidence is sparser and mixed. Some natural‑experiment / judge‑randomization studies (e.g., Denmark) show classroom training can help occupational change; US TAA evidence suggests positive labor market adjustments but conflates training with extended UI.
  • Limitations and external validity
    • Most trials target low‑income adults and youth and short trainings (weeks–months). The evidence is therefore imperfect for predicting retraining needs of displaced mid‑career or highly skilled white‑collar workers who may need multi‑year reskilling.
    • Persistence of benefits is uncertain; projecting benefits to retirement drives the fiscal break‑even result.

Data & Methods

  • Inclusion criteria
    • High evidentiary standard: randomized controlled trials prioritized; credible natural experiments (regression discontinuity, judge randomization) included.
    • Aggressive literature search including government reports, archive scans, author contacts; code and data published at github.com/droodman/job-training-meta-analysis; web interface at droodman.github.io/job-training-meta-analysis.
  • Meta‑analysis approach
    • 56 randomized US trials form the core of the meta‑analysis (146 outcome observations).
    • Outcomes extracted at the finest temporal resolution available (monthly/quarterly/yearly).
    • Main estimates reported per person offered training (intent‑to‑treat); compliance and take‑up details are recorded and used to compute per‑trainee bounds.
    • Random‑effects means used for average impacts; cost data available for ~67% of training‑primary interventions.
  • Complementary narrative review
    • Deep dives into national scale‑up evaluations (JTPA, WIA, Job Corps), sector program evaluations, and studies of dislocated‑worker supports.
    • Attention to implementation details (screening, employer engagement, placement mechanisms) and scalability challenges.

Implications for AI Economics

  • Realistic expectations for retraining as an AI policy
    • Retraining is popular and plausible as part of an AI disruption response, but the historical evidence suggests modest average returns for the kinds of short‑duration programs that currently dominate policy portfolios.
    • Large, rapid displacement of white‑collar workers would pose different challenges than the evidence base addresses (these workers often require longer, credentialed retraining).
  • Value of sectoral, employer‑engaged models
    • Programs that tightly align with employer demand and screen entrants can yield large returns and positive fiscal payback—important for short‑horizon, high‑demand reallocation following automation in specific sectors.
    • However, these models are selective and not well suited for universal mass retraining unless scalability and equity tradeoffs are addressed.
  • Fiscal and budgetary takeaways
    • Average training programs can be close to fiscally neutral under optimistic persistence assumptions; government recoups a large share of upfront costs via taxes and reduced benefits, lowering long‑run net fiscal burden.
    • Policymakers should be explicit about persistence assumptions when budgeting for mass retraining; short follow‑up windows mask uncertainty about long‑term payback.
  • Design priorities if retraining is scaled for AI shocks
    • Prioritize programs with employer partnerships, fast cycles of curriculum updating, and placement guarantees where possible—these features are correlated with much higher impacts.
    • Build selective pilot expansions (randomized scale‑ups) of promising sectoral programs to test scalability before large unconditional rollouts.
    • For displaced, higher‑skilled workers, invest in evaluating compressed degree or mid‑career credential programs (masters, bootcamps adapted for professionals), since the existing evidence mostly concerns lower‑wage, short‑training cohorts.
    • Account for compliance/take‑up dynamics in planning: per‑offer impacts understate per‑trainee gains; but real‑world take‑up will vary and affects cost‑effectiveness.
  • Research and evaluation agenda for AI preparedness
    • Rapid “fire‑drill” randomized expansions of leading sectoral programs to learn about scalability, cost structures, and employer pipelines in an urgent response context.
    • RCTs and quasi‑experiments focused on retraining for white‑collar occupations (compressed degrees, industry partnerships for professionals).
    • Measurement of persistence: invest in longer follow‑ups and administrative linkages to credibly project lifetime benefits.
    • Investigate complementarities between retraining and other policies (enhanced UI, wage subsidies, job search assistance, relocation support) for displaced workers in different skill strata.
  • Bottom line for AI policy economists
    • Retraining can be part of an AI response toolkit, but past evidence cautions against treating existing mass retraining infrastructure as a turnkey solution for large, rapid labor‑market displacement. High‑impact models (sector programs) exist and merit prioritized, rigorously evaluated scale‑ups; otherwise, expect modest average returns and nontrivial implementation and equity tradeoffs.

Assessment

Paper Typereview_meta Evidence Strengthmedium — The underlying evidence base is dominated by randomized trials, giving strong internal validity for average causal effects within the studied contexts, but strength is tempered by heterogeneous program types, substantial non-compliance, relatively short follow-up in many studies, possible publication/selection issues, and limited external validity to populations likely to be displaced by advanced AI (higher-skilled, white-collar workers). Methods Rigormedium — The authors conduct an exhaustive search and a new meta-analysis, favor randomized and strong quasi-experimental designs, extract many estimates, and use random-effects aggregation; however the review is not fully mechanical or pre-registered, some credible designs (placebo-passed matching) are excluded by design, extraction reportedly used an LLM for trait coding, heterogeneity and non-compliance are handled but require assumptions, and cost-benefit projections depend on debatable persistence assumptions. Sample56 randomized trials conducted in the United States from 1973 to present (146 impact estimates), mostly enrolling low-income adults and youth, training for occupations like nursing aides, IT support, welding; typical program duration ~6 months, average reported cost ~$13,598 per treatment-group member; supplemental evidence includes 7 European randomized/discontinuity studies and two judge-randomization studies (US, Denmark); subset analysis of 'sector programs' (private, employer-engaged) with higher impacts. Themesskills_training labor_markets governance IdentificationAggregates causal evidence from randomized controlled trials (56 US RCTs, 146 impact estimates) and a small set of quasi-experiments (judge-randomization, regression discontinuity) into a random-effects meta-analysis; reports intent-to-treat (offer) estimates and scales to complier/trainee effects; supplements quantitative synthesis with narrative, study-by-study critique and cost-benefit projections that rely on assumed persistence of earnings gains. GeneralizabilityMost trials target low-income or persistently jobless adults and youth; results may not generalize to displaced mid/high-skill white-collar workers., Many studies have short follow-up (most stop by year six), so long-run persistence of earnings effects is uncertain., Sector programs that show large returns are selective and privately run, limiting scalability and transferability to public large-scale deployments., Context is primarily US labor market and policy environment; other countries or future AI-driven disruptions may differ in demand for retraining., Heterogeneity in program content, local labor demand, and historical time periods (1973–present) complicates extrapolation to a future AI shock.

Claims (11)

ClaimDirectionOutcomeConfidence & EvidenceDetails
Across 56 randomized US job-training trials, training-primary programs increased employment by 1.7 percentage points in years 3–5 after assignment. Employment positive Employment rate in years 3–5 after randomized assignment
Reading fidelity high
Study strength high
n=56
1.7 percentage points
0.4
Across randomized US trials, training-primary programs increased annual pre-tax earnings by $791 per person offered training in years 3–5. Wages positive Annual pre-tax earnings in years 3–5 after assignment
Reading fidelity high
Study strength high
n=56
$791 per year in 2025 dollars
0.4
Job-training programs cost an average of $13,598 per treatment-group member, while the estimated present value of earnings gains is $14,146 when benefits are projected through retirement. Organizational Efficiency positive Present value of earnings benefits relative to program cost
Reading fidelity high
Study strength medium
$14,146 present value of earnings impacts versus $13,598 average cost per participant
0.24
Job-training programs generate government fiscal flows equal to approximately three-quarters of their costs through higher tax revenue and lower use of public welfare. Fiscal And Macroeconomic positive Government fiscal return from training programs
Reading fidelity high
Study strength medium
about three-quarters of program cost
0.24
The Job Training Partnership Act increased employment among low-income adults by approximately 2.3 percentage points, but produced no clear benefits for low-income youth. Employment mixed Employment and earnings among low-income adults and youth
Reading fidelity high
Study strength high
about 2.3 percentage points
0.4
The Job Corps had no lasting effect on employment or earnings in follow-ups extending 20 years, apart from a temporary 1–2 percentage-point employment increase in years 3–5. Employment null_result Employment and earnings over up to 20 years
Reading fidelity high
Study strength high
temporary 1–2 percentage point employment increase
0.4
The Workforce Investment Act produced essentially no effects for low-income adults or dislocated workers, with estimates as often negative as positive and statistically insignificant. Employment null_result Employment and earnings effects of WIA training
Reading fidelity high
Study strength high
essentially zero
0.4
Sector programs produced much larger earnings gains than average training-primary programs: their discounted present value of pre-tax earnings impacts was $60,319 versus $14,146. Wages positive Discounted present value of pre-tax earnings impacts
Reading fidelity high
Study strength medium
$60,319 versus $14,146
0.24
Sector programs had an estimated benefit-cost ratio of approximately 7 to 1 and could pay for themselves from the government's perspective through higher tax revenues and lower public-benefit use. Fiscal And Macroeconomic positive Benefit-cost ratio and government fiscal return
Reading fidelity high
Study strength medium
7x benefit-cost ratio
0.24
Sector programs admit approximately one in five applicants, indicating that their selection processes screen out more than 80% of applicants. Hiring negative Applicant selection/admission rate
Reading fidelity high
Study strength medium
n=4
about 1 in 5 applicants admitted
0.24
Employer hiring commitments in training programs are associated with earnings impacts an order of magnitude larger than those of the average program, although this result is based on only three programs. Wages positive Earnings of admitted training participants
Reading fidelity high
Study strength low
n=3
an order of magnitude more than the average program
0.12

Notes