A simple linear vector inside Qwen3-32B encodes short- versus long-term preference and, when added during generation, flips the model’s advice on delayed rewards and changes planning quality; the effect generalizes to out-of-distribution monetary choice tasks but is shown only on one model and depends on steering strength and prompt format.

Main Finding

A short, contrastive linear direction in the residual stream of Qwen3-32B—constructed from paired short-term vs. long-term answer continuations—is (1) linearly readable as a temporal-horizon feature and (2) causally effective: adding (or subtracting) that direction during generation (contrastive activation addition, CAA) reliably shifts the model’s expressed intertemporal preferences, generalizes to out-of-distribution monetary choices, and meaningfully affects a planning capability metric.

Key Points

• Direction construction and readout

  • Built a mean-answer (MM) difference vector dMM = μlong − μshort at selected mid-to-late layers (layers 24, 28, 32, 36, 40, 44, 48).
  • Linear probes (logistic regression, whitened variants) achieve near-ceiling classification on held-out explicit temporal-choice examples (best probe accuracies ≈ 96–99% on explicit holdout; implicit cross-domain accuracy lower but substantial: ~77–83%).
  • The authors caution the direction may capture correlated semantics (abstraction, urgency), not a pure “time” axis.

• Causal steering (binary temporal-choice)

  • Intervention: add ±α · d̂l to the residual stream at the last prompt token and at each decode step; strengths α ∈ {0, ±2, ±4, …, ±128}.
  • Effects are bidirectional and broad across the middle-to-late layers; layer 44 often shows largest parsed-choice contrast but the steering effect is not narrowly layer-specific.
  • A matched-norm random vector orthogonal control produces much smaller and inconsistent effects.

• Generalization to monetary intertemporal choice (time-utility task)

  • Tested on prompts "Take x now or y in t?" with grids varying absolute amounts, multipliers (y/x), and delays (12 delays up to 10 years).
  • Measured area-equivalent indifference multiplier (AEIM): the implied y/x at which the model is indifferent.
  • Steering systematically shifts AEIM: positive steering toward the long-term direction reduces AEIM (more patient), negative steering increases AEIM (more present-biased). Effects grow with delay (e.g., at 10-year horizon, negative steering produced >50× larger AEIM than positive steering in extreme settings).
  • Robust to sampling/stochastic decoding; random orthogonal control does not reproduce signed pattern.

• Effect on planning capability (TravelPlanner)

  • Used a travel-planning benchmark (180 validation queries). Primary metric: Commonsense Constraint Micro Pass Rate.
  • Moderate positive (long-term) steering improves commonsense micro pass rate; negative steering degrades it. Very large positive steering (+128) degrades performance (likely off-distribution disruption).
  • Interpretation: moderate long-horizon bias can help some planning-related outputs; excessive steering harms coherence.

• Magnitudes & operational details

  • The strongest intervention (|α|=128) corresponds to ~36–63% of baseline residual L2 norms at hook layers; |α|≤16 is <8% of residual norms.
  • Steering was applied consistently at prompt and decode steps; main decoding used greedy (temperature 0) with robustness checks under sampling.

• Limitations reported by authors

  • Construct validity: direction may mix horizon with other semantic axes (abstraction, urgency).
  • Layer non-uniqueness and potential off-distribution effects at large α.
  • Study limited to Qwen3-32B and specific prompt formats and datasets.

Data & Methods

• Model: Qwen3-32B (thinking-trace disabled).
• Probe training data:
  • Explicit temporal-choice dataset: 500 questions (validated for clear horizon distinction), split into 400 train / 100 test questions. Each question produced two teacher-forced continuation examples (short-term and long-term), yielding 800 training examples.
  • Implicit dataset: 300 prompts encoding horizon via semantic contrasts (used only for cross-domain evaluation).
• Probe variants:
  • Mean-answer MM difference direction (mean pooling across continuation tokens), final-token pooling diagnostic, logistic regression (LR), whitened LR (WLR), whitened MM (WMM).
• Steering interventions:
  • Layers probed: 24, 28, 32, 36, 40, 44, 48.
  • Strengths α ∈ {0, ±2, ±4, ±8, ±16, ±32, ±64, ±128}.
  • Hook location: residual stream addition at last prompt token and every generated-token step.
• Evaluation tasks:
  • Binary temporal-choice held-out prompts (100 explicit test prompts; 300 implicit prompts).
  • Monetary time-utility grid: combinations of multipliers, delays (1 hour to 3650 days), amount scales → 768 generations per condition; primary outcome AEIM (log-averaged indifference multiplier).
  • TravelPlanner benchmark (Xie et al., 2024): 180 queries; main metric Commonsense Constraint Micro Pass Rate.
• Controls and robustness:
  • Random orthogonal matched-norm vectors as negative control.
  • Sampling robustness checks (temperature 0.8, top-p =1, multiple samples) preserved qualitative effects.
  • Reported relative magnitudes of added vectors vs. baseline residual norms to characterize intervention intensity.

Implications for AI Economics

• Models encode measurable, manipulable intertemporal preferences

  • Finding: a single linear steering vector can shift expressed time preferences substantially and predictably. That implies large LLMs internalize an intertemporal axis whose setting affects advice on delayed-payoff decisions.
  • For economic analysis, the paper shows LLMs’ revealed discounting behavior is not fixed/opaque but can be quantified (AEIM) and altered mechanically.

• Practical uses in economic applications

  • Calibration of model advice: researchers and practitioners could audit or tune models’ implied discounting before deploying them for financial, health, retirement, or policy advising (e.g., align model recommendations with normative social discount rates or client-specific preferences).
  • Experimental tool: steerable directions allow controlled counterfactuals about how horizon affects recommended decisions, permitting causal-style studies of how advice quality and welfare-relevant outcomes vary with model patience.
  • Personalization: potential to tailor model horizon to individual preferences (e.g., more present-biased vs. far-sighted guidance) in decision-support systems—if done transparently and with consent.

• Risks and market/accountability concerns

  • Manipulation and nudging: steering could be used maliciously to bias consumer-facing recommendations (push short-term consumption, delay-saving), creating welfare harms. Because a single vector can shift recommendations, adversarial actors or profit-motivated providers could covertly change implied discounting.
  • Regulatory and disclosure implications: services using LLM advice on economic decisions may need to disclose or constrain models’ time-horizon settings; audits should check for hidden steering capability and default biases.
  • Distributional and welfare effects: if model steering is used at scale (e.g., in robo-advice), it could systematically affect savings, investment, or consumption at population scale; economists should consider model-imposed preference heterogeneity when modeling technology-mediated market impacts.

• Methodological opportunities for economic research

  • Estimating implied discount rates: mapping AEIM (or similar metrics) into discount factors or hyperbolic/exponential discount parameters enables linking LLM outputs to economic primitives.
  • Studying model heterogeneity: probe layers and steering magnitudes provide knobs to study robustness of policy recommendations across hypothetical agent horizons.
  • Policy design experiments: one can test how different horizon settings affect compliance with rules, long-run policy uptake, or planning quality (e.g., retirement saving nudges).

• Recommendations for safe/effective deployment in economic contexts

  • Audit before deployment: measure baseline AEIMs and behavior across delays and amounts; test sensitivity to steering.
  • Limit and log steering controls: treat horizon-steering hooks as high-privilege controls; require monitoring when used to modify economic advice.
  • Transparency to users: disclose whether a model’s time-preference has been tuned and allow users to set or review horizon preferences.
  • Research-standard benchmarks: incorporate intertemporal-choice evaluations into model evaluation suites for economic advice systems.

Summary takeaway: the paper demonstrates that intertemporal preference in a large LLM is a readable, causal lever — both an analytics tool for economists and a potential vector of manipulation. That duality creates opportunities (calibration, controlled experiments) and responsibilities (auditing, access control, transparency) for AI systems that give financially or temporally consequential advice.