The Commonplace
Home Papers Evidence Explore Trends Syntheses Digests References Docs 🎲 Workforce Futures
← Papers
Direction, evidence grade, and study type are AI-generated labels (gpt-5-mini), not human-verified. Syntheses are LLM-written. "Tensions" are machine-detected candidates, not confirmed contradictions. A research-acceleration tool, not peer review. How this is built →

Listing AI skills increases interview invitations by about 8–15 percentage points, while formal certificates add only a modest extra boost; AI credentials can partly or fully offset age and education disadvantages, especially for office-assistant roles, but have smaller effects in creative occupations.

AI Skills Improve Job Prospects: Causal Evidence from a Hiring Experiment
Stephany, Fabian, Teutloff, Ole, Leone, Angelo · January 19, 2026 · arXiv (Cornell University)
openalex rct medium evidence 8/10 relevance Full text usable extracted full text Source PDF

Structured author observations

Linked only from stored provider relations; the raw author line above is never matched by name.

OpenAlex

Latest observation:

  1. Stephany, Fabian provider ID
  2. Teutloff, Ole provider ID
  3. Leone, Angelo provider ID

Semantic Scholar

Latest observation:

  1. F. Stephany provider ID
  2. Ole Teutloff provider ID
  3. Angelo Leone provider ID
In a randomized conjoint experiment with 1,725 recruiters across the US, UK and Germany, listing AI skills on a resume raises interview invitation probabilities by roughly 8–15 percentage points, with formal certificates adding only modest extra value and AI skills partially or fully offsetting disadvantages from older age or lower education—effects that vary by occupation and recruiter background.

Citation observations

Cumulative provider counts captured on specific dates; providers are never combined.

The growing adoption of artificial intelligence (AI) technologies has heightened interest in the labor market value of AI related skills, yet causal evidence on their role in hiring decisions remains scarce. This study examines whether AI skills serve as a positive hiring signal and whether they can offset conventional disadvantages such as older age or lower formal education. We conducted an experimental survey with 1,725 recruiters from the United Kingdom, the United States and Germany. Using a paired conjoint design, recruiters evaluated hypothetical candidates represented by synthetically designed resumes. Across three occupations of graphic design, office assistance, and software engineering, AI skills significantly increase interview invitation probabilities by approximately 8 to 15 percentage points, compared with candidates without such skills. AI credentials, such as university or company backed skill certificates, only lead to a moderate increase in invitation probabilities compared with self declaration of AI skills. AI skills also partially or fully offset disadvantages related to age and lower education, with effects strongest for office assistants, for whom formal AI certificates play a significant additional compensatory role. Effects are weaker for graphic designers, consistent with more skeptical recruiter attitudes toward AI in creative work. Finally, recruiters own background and AI usage significantly moderate these effects. Overall, the findings demonstrate that AI skills function as a powerful hiring signal and can mitigate traditional labor market disadvantages, with implications for workers skill acquisition strategies and firms recruitment practices.

Summary

Main Finding

AI skills on résumés causally increase the likelihood of interview invitations. Across three occupations (office assistant, graphic designer, software engineer) and certification types, listing AI skills raises interview probabilities by roughly 8–15 percentage points on average. Effects are largest for technical roles, weaker for creative work, and certifications matter most when compensating for conventional disadvantages (older age, lower formal education).

Key Points

  • Magnitude: AI skill signals increase interview invitation probabilities by ~8–15 percentage points overall.
  • Occupational heterogeneity:
    • Software engineers: strongest positive effects; interview probabilities for AI-skilled candidates approach ~72–75% in high-usage recruiter subsamples.
    • Office assistants: AI skills strongly compensatory, especially for candidates without tertiary education; university-issued AI micro‑credentials can increase interview probabilities by up to ~25 percentage points versus no AI skills.
    • Graphic designers: smallest or muted effects; recruiter skepticism about AI in creative work lowers valuation of AI skills.
  • Certification vs. self-report:
    • Self-declared AI skills already carry substantial value.
    • Company- and university-issued certificates yield modest additional gains over self-report on average; differences are often small and not always statistically significant.
    • Formal credentials matter most when they substitute for missing traditional signals (e.g., a bachelor’s degree).
  • Recruiter heterogeneity:
    • Recruiters’ own AI usage and attitudes strongly moderate effects. High AI-usage recruiters reward AI-skilled candidates much more than low-usage recruiters.
    • Skeptical attitudes (notably among creative-role recruiters) reduce the premium for AI skills.
  • Signaling interpretation:
    • AI skills act as a market signal of employability and can partially or fully offset traditional disadvantages, consistent with signaling theory while interacting with "muddled information" dynamics in some contexts.

Data & Methods

  • Design: Paired-comparison conjoint (forced-choice) experiment presenting recruiters with side-by-side synthetic CVs; respondents chose which candidate they would invite to interview.
  • Sample: 1,725 hiring professionals recruited via Prolific (sample described as drawn from major labor markets; analyses focus on hiring-experienced respondents). Each participant completed 10–15 choice tasks, yielding 22,195 pairwise comparisons.
  • Roles tested: Office Assistant (administrative), Graphic Designer (creative), Software Engineer (technical).
  • Manipulated attributes:
    • Candidate characteristics: age (younger ≈32 vs older ≈60), education level (e.g., associate vs bachelor), gender.
    • Contract type: 6-month fixed-term vs permanent.
    • AI skill treatments (5 levels): no AI, self-reported AI skills, LinkedIn certification, university micro-credential, company-issued certificate.
    • Counter-certificate for advantaged candidate in some pairs to control for certification effects in general (role-specific non-AI certs).
  • Stimuli construction:
    • CVs were programmatically generated using an LLM (Google Gemini 2.5 Pro) with careful prompts to ensure internal consistency and role relevance; universities specified were non-elite to avoid prestige confounds.
    • AI skill text was tailored to role-relevant tasks (e.g., automation and Power Automate for office assistants; Midjourney/Adobe Firefly for designers; LLM APIs, PyTorch for engineers).
  • Identification & validity:
    • Forced-choice paired design reduces scale and social desirability biases and allows clean estimation of attribute effects.
    • Heterogeneity analyses by recruiter AI engagement and attitudes help probe mechanisms and external validity.

Implications for AI Economics

  • For signaling theory and labor economics:
    • AI skills function as a salient labor-market signal with measurable causal returns; however, the informativeness of AI signals varies by context and gatekeeper attitudes, highlighting a nuanced interplay between credential proliferation and signal quality ("muddled information").
    • Formal micro‑credentials can substitute for degrees in specific cases, supporting the increasing feasibility of skills-based hiring.
  • For workers and reskilling strategy:
    • Acquiring and advertising AI skills (even via self-report) can improve job prospects, particularly for disadvantaged workers (older, lower-educated).
    • Micro-credentials from universities or recognized companies can be especially valuable when formal degrees are absent.
  • For firms and hiring practice:
    • Recruiter AI literacy matters: firms seeking AI capabilities should upskill hiring staff to avoid under‑ or over‑valuing AI signals and to reduce heterogeneity-driven hiring biases.
    • In creative roles, firms should clarify how they value AI‑augmented work and design screening practices that assess genuine creative contribution versus mere AI-produced artifacts.
  • For policy:
    • Evidence supports policies that facilitate affordable, verifiable AI micro‑credentials and broader access to AI training, as these can improve employability and act as degree substitutes in some contexts.
    • Monitor distributional risks: differential AI adoption and credential access (e.g., by gender, socio‑economic status) could create new inequalities; complementary policies should target equitable access to AI training and credential platforms.
  • Cautions and research directions:
    • The use of LLM-generated CVs is realistic but raises questions about how signal perception interacts with AI-mediated presentation; follow-up work should examine real-world hiring outcomes and long-run employer fit/performance of AI‑credentialed hires.
    • Further research should explore cross-country variation, sectoral spillovers, and the interplay between AI skill signaling and actual task performance.

Assessment

Paper Typerct Evidence Strengthmedium — Strong internal identification from randomized conjoint design and a large sample of recruiters across three countries supports causal inference about stated invitation decisions; however, evidence is limited by hypothetical (stated-preference) outcomes rather than observed hiring behavior, potential non-representativeness of the recruiter sample, and scope limited to three occupations and early-stage hiring outcomes (interview invites). Methods Rigormedium — Design is rigorous (randomization, paired comparisons, multiple occupations, heterogeneity analyses), sample size is large, and key contrasts (self-declared vs certified AI skills) are directly tested; but the paper appears vulnerable to typical conjoint limitations (hypothetical bias, design-dependent effects, possible attribute non-attendance), unclear sampling frame/representativeness details, and no behavioral validation against actual hiring outcomes. SampleExperimental survey of 1,725 recruiters based in the United Kingdom, United States, and Germany who evaluated synthetically generated resumes in a paired conjoint design across three occupations (graphic design, office assistance, software engineering); recruiters' own backgrounds and AI usage were recorded for heterogeneity analysis. Themeslabor_markets skills_training human_ai_collab IdentificationPaired conjoint survey experiment with randomized resume attributes: recruiters were shown synthetically generated candidate profiles where the presence/type of AI skills (self-declared vs formal certificate) and other attributes (age, education, occupation, etc.) were independently randomized, allowing causal estimation of the marginal effect of AI skills on interview invitation probabilities. GeneralizabilityStated-preference (survey) responses may not match real-world hiring decisions and downstream outcomes (offers, wages, retention)., Recruiter sample may not be representative of all hiring managers or industries; recruitment/sampling frame not fully detailed., Limited to three occupations; results may not generalize to other job types, seniority levels, or industries., Three-country sample (US, UK, Germany) may not generalize to other institutional or cultural labor markets., Findings reflect a point in time and may change as employer familiarity and norms around AI evolve.

Claims (9)

ClaimDirectionOutcomeConfidence & EvidenceDetails
We conducted an experimental survey with 1,725 recruiters from the United Kingdom, the United States and Germany using a paired conjoint design with synthetically designed resumes. Hiring null_result experimental evaluation / candidate selection decisions in a paired conjoint design
Reading fidelity high
Study strength high
n=1725
1.0
Across three occupations (graphic design, office assistance, and software engineering), AI skills significantly increase interview invitation probabilities by approximately 8 to 15 percentage points compared with candidates without such skills. Hiring positive interview invitation probability
Reading fidelity high
Study strength high
n=1725
approximately 8 to 15 percentage points
1.0
AI credentials, such as university or company backed skill certificates, only lead to a moderate increase in invitation probabilities compared with self declaration of AI skills. Hiring positive interview invitation probability (credential vs self-declaration)
Reading fidelity high
Study strength medium
n=1725
0.6
AI skills partially or fully offset disadvantages related to older age. Hiring positive interview invitation probability (interaction: AI skills × older age)
Reading fidelity high
Study strength medium
n=1725
0.6
AI skills partially or fully offset disadvantages related to lower formal education. Hiring positive interview invitation probability (interaction: AI skills × lower education)
Reading fidelity high
Study strength medium
n=1725
0.6
Compensatory effects of AI skills are strongest for office assistants, for whom formal AI certificates play a significant additional compensatory role. Hiring positive interview invitation probability by occupation and credential status
Reading fidelity high
Study strength high
n=1725
1.0
Effects are weaker for graphic designers, consistent with more skeptical recruiter attitudes toward AI in creative work. Hiring negative interview invitation probability for graphic designers with AI skills
Reading fidelity high
Study strength medium
n=1725
0.6
Recruiters' own background and AI usage significantly moderate the effect of candidate AI skills on invitation decisions. Hiring mixed heterogeneity in interview invitation probability by recruiter characteristics
Reading fidelity high
Study strength medium
n=1725
0.6
Overall, AI skills function as a powerful hiring signal and can mitigate traditional labor market disadvantages, with implications for workers' skill acquisition strategies and firms' recruitment practices. Hiring positive interview invitation probability and mitigation of age/education disadvantages
Reading fidelity high
Study strength medium
n=1725
0.6

Notes