A new 'interpolative decoding' technique lets language models be dialed across personality dimensions to mimic Big Five traits and replicate human choices in classic economic games; preliminary tuning can even align model actions with individual players, offering a scalable but still imperfect proxy for behavioral research.

Main Finding

Interpolative decoding — combining LLM output distributions from two prompt-defined trait extrema via a continuous interpolation parameter λ — reliably produces intermediate, human-plausible changes in LLM communicative and decision-making behavior along personality-like spectra. Using this method (particularly a contrastive variant) the authors (1) modulate LLM Big Five scores in predictable ways, (2) reproduce known personality‑conditioned effects in economic games, and (3) make initial progress toward “twinning” individual human players by searching interpolation space to match observed actions.

Key Points

• Interpolative decoding represents a trait spectrum by two textual endpoint prompts (low vs high). At each decoding step the model’s next-token distribution is combined from the two conditioned distributions using an interpolation parameter λ.
  • Mixture decoding: weighted average P' ∝ λ·PA + (1−λ)·PB.
  • Contrastive decoding: P' = softmax(PA + λ·(PA − PB)) — asymmetric but empirically effective.
• Psychological soundness:
  • Varying λ produces predictable shifts on Big Five inventories. Spearman correlations between target (prompted) trait level and resulting LLM Big Five scores: openness 0.69; conscientiousness 0.83; extraversion 0.83; agreeableness 0.70; neuroticism 0.73.
  • Contrastive decoding produced smoother, more gradual control than mixture decoding (contrastive range used −10..0; mixture used 0..1).
• Decision-making experiments:
  • Interpolative decoding changes LLM choices in economic games (e.g., dictator game), aligning with human findings that prosocial traits (honesty‑humility / agreeableness) increase generous allocations.
  • In a cooperative game domain (Pandemic), interpolative modulation of dimensions beyond classic Big Five (e.g., weighting social vs deliberative information) changed decisions and reasoning in ways useful for team-performance studies.
• Twinning (FOIL system):
  • Twinning is posed as maximizing the likelihood of observed human actions under interpolative-decoded LLMs (argmax over λ of summed log probabilities of observed actions).
  • Search methods used include golden-section search for unimodal cases; computational cost mitigated by prompt caching and by training a regressor (pretrained on LLM-generated data) to propose good initial λ guesses.
  • Preliminary results show promise for matching individual behaviors in constrained tasks by systematic sampling/regression in interpolation space.
• Practical advantages: the approach requires no model fine-tuning and is compatible with off-the-shelf LLMs and prompt engineering, reducing overhead vs crafting many hand‑written prompts for individual trait settings.
• Limitations noted: LLMs emulate communicative patterns (not bona fide human psychology); tuning depends on choice of endpoint prompts and task framing; objective surfaces can be multimodal and computationally expensive to search; external validity and ethical considerations remain.

Data & Methods

• Models and general setup:
  • Experiments use broadly available LLMs (e.g., GPT-family style models), relying solely on prompt-conditioned decoding (no fine-tuning).
  • Endpoint prompts: descriptive textual templates for trait extrema (e.g., high vs low honesty-humility), plus control prompts unrelated to the trait.
  • Two interpolation mechanisms tested (mixture and contrastive); contrastive selected for most downstream experiments.
• Psychological soundness test:
  • Big Five questionnaire-style evaluation. For each trait, few-shot examples were partitioned by facets; the model was prompted as “low/middle/high” on a trait and then answered inventory items (Likert scale). Scores aggregated per trait and correlated with input trait level across 20 facet-split experiments.
  • Reported Spearman correlations: openness 0.69; conscientiousness 0.83; extraversion 0.83; agreeableness 0.70; neuroticism 0.73.
• Decision-making experiments:
  • Dictator game (single-turn $-split decision): assessed how interpolation along prosocial traits changed allocation choices, comparing to known human correlations with honesty‑humility and agreeableness.
  • Pandemic (cooperative board game): investigated sensitivity to reweighting social vs deliberative information sources using interpolative decoding.
• Twinning methods:
  • Formal objective: maximize P(actions | observations, λ, endpoint prompts, scenario, LLM).
  • Search strategies: golden-section for unimodal 1-D; systematic sampling and regressor-based initialization for higher-dimensional/tougher cases.
  • Regressor training: generate LLM responses over varied λ and scenarios to learn mapping from observed responses to λ estimates.
• Implementation details:
  • Prompt caching used to amortize encoding cost across repeated decoding calls.
  • Decoder parameter ranges: contrastive effective range observed −10..0; mixture 0..1.
• Code and data: authors indicate public release at https://github.com/SRI-AIC/foil (per paper).

Implications for AI Economics

• Scalable in-silico human surrogates: Interpolative decoding provides a parameterized, continuous way to generate agent populations with graded psychological traits, enabling faster and cheaper simulation of experiments that traditionally require human subjects (e.g., policy testing, mechanism design sensitivity).
• Reduced prompt overhead and better replicability: Representing trait spectra via endpoints + λ reduces need to craft many distinct prompts and supports systematic exploration of trait-continuous effects.
• Individualized agent models (twinning): Ability to fit λ to observed behavior opens the possibility of personalized agent models for counterfactual analysis, training simulations, or forensic economic studies (e.g., what-if analyses of individual responses to incentives).
• Experimental leverage for behavioral economics:
  • Parameterized manipulation of traits (and information-weighting preferences) enables testing of which psychological dimensions drive decision outcomes in economic games and cooperative settings.
  • Interpolative decoding can be used to explore candidate trait dimensions beyond Big Five by adding endpoint descriptors and testing whether they increase predictive fidelity.
• Methodological recommendations for economists:
  • Validate interpolated agents against standard inventories (e.g., Big Five) before deploying in broader simulations.
  • Prefer contrastive interpolation for smoother control; empirically determine λ ranges per model/task.
  • Use regressor/ Bayesian optimization methods to reduce search cost when fitting agents to individuals.
  • Account for the fact that LLMs emulate communicative behavior — cross-validate with real-world behavior where possible.
• Cautions and ethics:
  • External validity: LLM “personas” reflect text-derived patterns and may not capture full cognitive/affective processes; results should be triangulated with human data.
  • Risk of misuse: twinning raises privacy and ethical concerns if used to emulate real individuals without consent.
  • Robustness: results depend on endpoint prompt wording, model version, and decoding hyperparameters; reproducibility practices (open prompts, code, seeds) are essential.

Summary verdict: Interpolative decoding is a practical, low-cost lever for producing graded, human-like agent variants from off-the-shelf LLMs. It has clear utility for exploratory and large‑scale simulation in AI economics, but users should validate agents against real data, be mindful of ethical constraints, and employ principled search/regression methods when fitting agents to individuals.