AI-crafted sustainability explanations nudge shoppers: when LLMs present environmental info with behavioral framing or social‑norm language, sustainable selections jump substantially (to about 67–69%), while mere disclosure only improves user perceptions without changing choices.

Main Finding

LLM-generated, sustainability-aware recommendation explanations can effectively nudge users toward greener choices — but only when the sustainability information is presented through behavioral mechanisms (framing or descriptive social norms). Plain disclosure of sustainability attributes improves subjective perceptions of explanations but does not change selection behavior. The framing and social-norm presentations raised sustainable selections substantially (to ~69% and ~67%), and these effects held across a low-involvement domain (instant coffee) and a high-involvement domain (hotel bookings).

Key Points

• Intervention design
  • Explanations generated by an LLM using prompt-level templates that operationalize two nudging mechanisms: framing and descriptive social norms.
  • Four experimental conditions: (1) preference-only baseline (no sustainability info), (2) mechanism-free sustainability disclosure (same content, no behavioral mechanism), (3) framing, (4) descriptive social norms.
  • Explanations remained grounded in item sustainability attributes and preserved the same choice set (only the justification changed).
• Empirical results (N = 529 across two studies)
  • Overall, sustainability-aware explanations increased the share of sustainable selections compared to the preference-only baseline.
  • Mere disclosure of sustainability content (mechanism-free) did not change choices relative to baseline, although it improved subjective evaluation of explanations.
  • Framing and descriptive social norms significantly increased sustainable selections (≈69% and ≈67% respectively).
  • Effects were robust across both involvement domains (instant coffee — low involvement; hotels — high involvement) and after adjusting for demographics, domain expertise, consumption frequency, and participants’ biospheric values.
  • Perception-behavior divergence: disclosure improved perceived explanation quality, while presentation strategy (framing/norms) impacted actual choice and eased decision-making without reducing satisfaction.
• Validation and robustness
  • Generated texts were audited via human evaluation and LLM-as-judge checks for factual fidelity and adherence to intended behavioral mechanisms.
  • Materials, code, and dataset released publicly.

Data & Methods

• Experimental setup
  • Two preregistered randomized controlled user studies (total N = 529).
  • Domains: instant coffee (low involvement) and hotel bookings (high involvement).
  • Recommendation matching: preference-based recommender that produced items matched to participants’ explicitly stated preferences (to simulate personalized RS).
  • Explanations: generated on-the-fly by an LLM using templates encoding the nudging mechanisms or plain disclosure; a preference-only baseline omitted sustainability info.
• Measures
  • Behavioral outcome: choice among preference-matched recommendations (i.e., which item selected).
  • Subjective outcomes: standard RS measures (explanation evaluation, decision difficulty, satisfaction, etc.).
  • Controls: demographics, domain expertise, consumption frequency, biospheric value measures.
• Validation
  • Human evaluation and automated (LLM-based) audits checked factual grounding and whether generated explanations followed the intended framing/norm templates.
• Analysis
  • Comparisons across conditions isolate two effects:
    • Presence effect: mechanism-free sustainability disclosure vs. preference-only baseline (does presence of sustainability info matter?)
    • Presentation effect: framing or social-norms vs. mechanism-free disclosure (does how it’s presented matter?)
  • Statistical tests and robustness checks controlling for covariates.

Implications for AI Economics

• Platforms as scalable choice architects
  • LLMs enable low-marginal-cost, context-sensitive explanations at scale; platforms can cheaply embed behavioral mechanisms into explanations to influence aggregate demand toward socially desirable goods (e.g., greener options).
  • This provides a powerful lever to internalize environmental externalities through interface design rather than price changes or supply-side regulation.
• Demand-side effects and market outcomes
  • If widely deployed, explanation-level nudges can shift demand composition (higher demand for sustainable products), potentially altering prices, producer incentives, and product portfolios.
  • Short-run demand shifts could encourage suppliers to invest more in sustainable attributes, but long-run producer responses depend on how persistent and credible the nudges are.
• Welfare and distributional considerations
  • Nudging via personalized LLM explanations may improve aggregate welfare by aligning choices with social goals without restricting choice. However, distributional effects matter: who is nudged, how strongly, and whether some consumer groups are disproportionately influenced.
  • The divergence between subjective perception and behavior underscores the importance of measuring both welfare proxies (satisfaction) and revealed behavior (choices).
• Strategic behavior and market competition
  • Firms or platforms could strategically use explanation nudges to favor certain products (e.g., private-label green options) — raising concerns about biased persuasion and the need for rules on transparency or disclosure of objectives.
  • Competing platforms may adopt different nudging regimes, potentially creating competition on persuasive design rather than product quality/price.
• Need for governance, audits, and certification markets
  • LLM-generated nudges can be persuasive but rely on factual grounding and correct presentation. This raises demand for independent audits, certification, or regulation to ensure fidelity, prevent misleading claims, and avoid greenwashing.
  • Markets for third-party verification of LLM explanations (accuracy, adherence to templates, absence of deceptive claims) could emerge.
• Measurement, evaluation, and external validity
  • Lab/online experimental evidence is promising, but field experiments are needed to estimate persistence, spillovers (e.g., rebound effects), and real-world welfare consequences.
  • Mechanism design and A/B testing can be integrated into platform economics to optimize social objectives while monitoring unintended consequences.
• Ethical and regulatory trade-offs
  • Personalized behavioral influence raises ethical concerns (manipulation, autonomy). Economic policy must balance efficiency gains from low-cost nudges with consumer protection and fairness constraints.
  • Regulation could focus on permitted types of nudges, disclosure standards, and auditing requirements for LLM-generated persuasive content.
• Research directions for AI economics
  • Model the platform’s incentive problem: trade-offs between short-term revenue, long-term user trust, and social objectives when using LLM-generated nudges.
  • Quantify externality reductions versus welfare costs (if any) from targeted nudging; estimate equilibrium effects on prices and producer behavior.
  • Study heterogeneity in responsiveness (by income, preferences, values) to design equitable nudging policies.
  • Investigate the robustness and persistence of nudges over time and interactions with other policies (taxes, subsidies, labeling).
  • Develop market institutions for auditing/certifying LLM explanations and study their economics.

Limitations to keep in mind - Lab/online studies may overstate short-term effects; field evidence is required to assess persistence and real-market impacts. - Ethical, legal, and reputational risks if platforms use persuasive explanations without transparency or to favor private interests. - LLM hallucination risk necessitates strong grounding/validation protocols before deployment.

Summary takeaway LLM-generated explanations are a scalable, low-cost tool that platforms can use as choice-architecture interventions to increase sustainable selections — but effectiveness hinges on behavioral presentation (framing or social norms), factual grounding, and governance to manage market and ethical risks.