AI-written ads beat human copy in lab preference tests, winning 59% to 41% overall and dominating authority and consensus appeals; when ads are tailored to personality, AI performs on par with human experts.

Main Finding

LLM-generated ads match humans on trait-targeted personalization but outperform humans when deploying universal persuasion principles. In two experiments (Study 1: n=400; Study 2: n=800) the authors find parity for personality-tailored ads (LLM preference 51.1% vs human 48.9%, p>0.05) but clear AI superiority for persuasion-based ads (LLM 59.1% vs human 40.9%, p<0.001). The AI advantage is strongest for authority (63.0%) and consensus (62.5%) appeals and remains robust after accounting for participants’ detection of AI origin.

Key Points

• Two-part empirical design:
  • Study 1: personality-based personalization (openness, neuroticism). Measures: Likert ratings (product attitude, purchase intention, engagement intention) and side-by-side choice between LLM vs human ads.
  • Study 2: universal persuasion principles (authority, consensus, cognition/processing fluency, scarcity) with multimodal ads and qualitative follow-up.
• Outcomes:
  • Personalization parity: no significant difference between LLM- and human-generated ads for matched personality targets (51.1% vs 48.9%, p > 0.05).
  • Persuasion superiority: LLM ads preferred substantially more than human ads (59.1% vs 40.9%, p < 0.001); largest gains in authority and consensus strategies.
• Qualitative diagnostics: participants cited more sophisticated, aspirational messaging and better visual–narrative coherence in AI ads as drivers of preference.
• Origin effects: even when adjusting preferences downward by a 21.2 percentage-point “detection penalty” for correctly identified AI ads, AI content still outperformed human content; 29.4% of participants selected AI content despite knowing it was AI-generated.
• Generation pipeline: authors combine Knowledge Graph grounding (mapping user traits to product attributes) with LLM “generative storytelling” to produce context-driven ad copy; experiments isolate the generative module (no live deployment confounds).
• Practical advantage: LLMs offer near-zero marginal cost and low latency compared with expert human creation, implying potential large-scale production and rapid iteration.

Data & Methods

• Experimental design:
  • Study 1 (n=400): participants exposed to ads targeted for high-openness or high-neuroticism profiles. Tasks: (1) rate ad on 3 Likert outcomes (product attitude, purchase intention, engagement intention); (2) choose preferred ad in side-by-side human vs LLM comparison. Personality measured by a 20-item Big Five questionnaire administered after ad tasks.
  • Study 2 (n=800): participants evaluated LLM- vs human-crafted ads engineered around four persuasion principles (authority, consensus, cognition/fluency, scarcity). Included multimodal stimuli and qualitative prompts capturing reasons for preference and recognition of content origin.
• Generation approach:
  • Knowledge Graphs used to ground prompts (map trait → product attributes), then LLM(s) used to generate ad copy and visual–narrative elements. Human ads drawn from expert-created materials (sourced from existing creative/agency outputs—paper provides sourcing details).
• Outcome metrics and analysis:
  • Primary metric: binary preference (which ad chosen). Secondary metrics: Likert ratings for affect and behavioral intent, qualitative coding of reasons.
  • Statistical tests: preference share comparisons with p-values reported (e.g., p<.001 for persuasion superiority). Robustness check applying a detection-penalty adjustment (21.2 percentage points) to account for origin recognition bias.
• Qualitative methods: thematic analysis identifying motifs (aspirational tone, coherence) explaining AI advantage.

Implications for AI Economics

• Cost structure and scale:
  • Near-zero marginal cost and faster turnaround for LLM-generated creative imply dramatically lower marginal production costs for advertising assets, enabling massive scaling of ad variants (combinatorial personalization and A/B testing).
• Labor & task allocation:
  • Creative production jobs (copywriters, junior creatives) face displacement or role-shift; human labor may concentrate on high-level strategy, brand stewardship, legal/ethical oversight, and curation/editing rather than first-draft generation.
  • A premium may persist for rare human skills (brand voice, deep domain expertise), but routine creative iteration becomes automatable.
• Industry structure & competition:
  • Lower barriers to producing persuasive creative could intensify competition among advertisers (more variants, faster optimization), shifting industry dynamics toward firms that can best integrate LLMs into pipelines and measure ROI.
  • Advertising agencies’ value proposition could pivot to strategy, sourcing, and governance rather than execution; platform and tool providers that bundle KG-grounding, model access, and creative workflows may capture rents.
• Pricing, auctions, and ad markets:
  • If LLM ads yield higher click/engagement rates, this will affect auction dynamics (higher bids justified by higher expected returns), potentially raising equilibrium prices for premium placements unless supply of effective creatives expands even faster.
  • Increased ad effectiveness could raise advertisers’ willingness to pay per impression/engagement, altering allocation of ad spend across channels.
• Consumer welfare, externalities, and regulation:
  • Higher persuasive potency (especially using authority/consensus cues) raises concerns about manipulation, misinformation, and consumer protection—calling for updated disclosure, transparency rules, and possibly limits on certain persuasion techniques.
  • Privacy and microtargeting ethics remain central: cheap personalized persuasion amplifies risks of exploitative targeting, nudging, and political-messaging externalities.
• Measurement & market power:
  • Firms that own large user data, KGs, and fine-tuned creative pipelines can extract more value from LLMs, enhancing platform advantages and potential concentration.
• Research and policy needs:
  • Need for field experiments measuring real behavioral outcomes (purchases, long-run engagement), cross-platform effects, and welfare implications.
  • Policy considerations: mandatory disclosures, limits on manipulative persuasion in sensitive domains, auditability of persuasion pipelines, and support for workforce transition.
• Investment and ROI:
  • Expect reallocation of media budgets: more spending on dynamic creative optimization and measurement; less on high-cost per-unit creative production. Returns to efficient experimentation and measurement tools increase.

Limitations & open questions (relevant for economic analysis) - External validity: lab/online preference measures do not directly translate to long-run purchase behavior or market-level outcomes. - Product & context scope: effectiveness may vary by product category, regulatory environment, and cultural context. - Model & pipeline heterogeneity: results depend on LLM quality, prompt engineering, and KG grounding—returns will vary across implementations. - Origin-disclosure dynamics: real-world effects of disclosure, reputational impacts, and changing consumer priors require longitudinal study.

If you want, I can: - Convert these implications into a short memo targeted to agency executives or policymakers. - Produce a simple economic model (graphical or algebraic) of how marginal cost reductions in creative affect ad-auction equilibrium and creative labor demand.