AI recommendations shorten resume review and blunt the benefits of extra scrutiny: without recommendations, extra viewing raises selection odds by about 3–4% and reviewers spend up to 55.6% longer inspecting resumes; completing an implicit-bias test beforehand reduces racial disparities in review time and predicts how people engage with AI screening.

Main Finding

When humans collaborate with racially biased AI recommendations in resume screening, the time people spend reading resumes systematically affects selection outcomes and reveals failures of human oversight. Key quantitative results: participants spent on average 27 seconds per resume; for candidates not recommended by the AI, every additional 30 seconds of viewing increased their chance of being selected by ~3–4%. Absence of AI recommendations led people to view resumes 55.6% longer. Severe, stereotype-incongruent AI bias (for high-status jobs) produced 20.1% shorter viewing times for non-white vs white candidates. Taking an implicit association test (IAT) before screening reduced race-based differences in viewing time for some comparisons, and individual IAT scores predicted how long people engaged with resumes.

Key Points

• Average resume viewing time: ~27 seconds.
• Time matters differently depending on AI recommendation:
  • If AI does NOT recommend a candidate, extra viewing time raises that candidate’s selection probability (~3–4% per 30 s).
  • If AI does recommend a candidate, increased viewing time is associated with a smaller but significant decrease in selection probability.
• Presence vs absence of AI:
  • No AI recommendations → participants spend 55.6% longer per resume (suggesting AI reduces human effort/engagement).
• Racial procedural fairness:
  • Under most conditions, viewing durations did not differ by candidate race.
  • Exception: when AI recommendations were severely biased and incongruent with common stereotypes for high-status occupations, participants spent 20.1% less time on non-white than white candidates.
• Cognitive priming / IAT effects:
  • Completing an IAT before screening made participants more likely to spend equal time on Black vs white candidates for high-status jobs (i.e., changed decision processes).
  • Stronger stereotype-congruent IAT scores predicted increased time spent reading both Black and white resumes (effects varied by racial group and condition).
• Interpretation: measured viewing time functions as both (a) a procedural fairness indicator (unequal time = unequal evaluation quality) and (b) a proxy for cognitive processing mode (shorter time → more heuristic/System 1; longer time → more deliberative/System 2).

Data & Methods

• Source dataset: experiment reported by Wilson et al.; data and scripts available (GitHub link in paper).
• Sample: 528 U.S.-based participants (Prolific); average age 39.1; majority White (70%+), others Black, Hispanic, Asian represented; task ≈25 minutes.
• Task: participants screened five resumes per scenario (four qualified, one unqualified distractor) across 1,500+ AI-HITL resume-screening scenarios. Each scenario described an occupation (16 occupations: 8 high-status, 8 low-status).
• Candidate identities: fictitious male candidates with names, affinity memberships, and/or explicit labels signaling Asian / Black / Hispanic vs White (White candidates left unlabeled to reflect US default).
• Experimental factors:
  • Between-subjects: Group (Asian vs White, Black vs White, or Hispanic vs White), Status (High vs Low), Order (IAT before or after resume task).
  • Within-subjects: Bias (six AI conditions: None, Neutral, Congruent/Moderate, Incongruent/Moderate, Congruent/Severe, Incongruent/Severe), Resume identity, Position in list.
• AI recommendation regimes:
  • Moderate: recommendations biased ~75% vs 25% by race.
  • Severe: recommendations 100% vs 0% by race.
• Implicit measure: race–status IAT (D score computed by Greenwald algorithm); three IAT versions matched Group.
• Dependent variables:
  • Duration: time (in seconds) participant spent viewing each resume (click open/close), rounded to 0.1 s.
  • Selected: whether that candidate was chosen to progress (binary).
• Analysis focus: linking Duration to Selected under different Bias / Status / Group / Order / IAT conditions; testing whether AI bias and IAT priming change viewing-time patterns and procedural fairness.

Implications for AI Economics

• Efficiency vs oversight tradeoff
  • AI recommendations substantially reduce human time per resume (explaining some productivity gains), but reduced time is associated with weaker human oversight and may amplify biased outcomes. Firms optimizing for screening throughput may inadvertently increase discrimination risk.
• Hidden costs of biased AI
  • Time-driven selection effects imply that biased recommendations alter human effort allocation in ways that produce disparate outcomes. These can generate economic costs: legal liabilities, damages to reputation, reduced diversity benefits (innovation, productivity), and turnover costs from inefficient or unfair hiring.
• Incentives and market adoption
  • Because AI adoption is often justified on efficiency and cost-savings, firms may adopt biased systems unless procurement and performance metrics internalize fairness and oversight costs. Measuring only speed/productivity incentivizes under-scrutiny of AI outputs.
• Policy and governance levers
  • Regulatory or buyer-side requirements should include process-level metrics (e.g., evaluation time equity across groups), not only outcome parity. Mandated audits should measure how AI affects human attention and decision processes.
  • Disclosure / interface rules: require that interfaces make provenance and uncertainty salient in ways that encourage deliberation where appropriate (reduce blind reliance on recommendations).
• Interventions and training
  • Brief priming (e.g., IAT-like awareness tasks) can change how people allocate attention and help equalize evaluation time in some contexts — a potentially low-cost intervention but with ethical caveats and limited generalizability.
  • Design incentives (compensation, KPIs) so human reviewers are rewarded for careful, fair deliberation rather than speed alone.
• Organizational monitoring and cost–benefit analysis
  • When procuring AI screening tools, organizations should quantify tradeoffs: time saved per screened resume vs incremental selection bias risk and downstream labor-market costs. Incorporate these into procurement decisions and post-deployment monitoring (A/B tests, audits).
• Research & measurement
  • This study highlights the value of process measures (time-on-item) for detecting procedural unfairness. Economists modeling labor-market impacts of AI should incorporate how AI shifts human time allocation and cognitive effort, not only changes in algorithmic scores.
• Limitations to consider for policy/economic modeling
  • Experimental setup uses synthetic resumes, constrained race comparisons, and U.S.-centric participants; real-world hiring has greater complexity (multi-stage processes, diverse candidate pools, institutional constraints). Estimates here should be treated as indicative of mechanisms rather than direct market-size effects.

Practical recommendations for economists and policymakers: - Require vendors and employers to report process metrics (e.g., average evaluation time by group) in addition to outcome metrics. - Include human effort reallocation and oversight failure in cost–benefit models of AI adoption. - Fund/mandate randomized audits and interface experiments to find defaults that promote deliberation when AI recommendations are potentially biased. - Treat cognitive-priming interventions (like IATs) cautiously: they may change behavior but need evaluation for durability, unintended consequences, and ethics.

Limitations noted by authors: online experimental context, male-only synthetic candidates to avoid gender confounds, binary race contrasts, and U.S.-focused participant pool — all limit external validity and require field validation for precise economic estimates.