Asking behavioral language models to output a probability ranks customers more accurately than asking them to 'reason' in text first; across multiple retail datasets and checkpoints the scored readout outperforms generated rationales in 12 of 13 cells, often by several AUC points, implying firms should source ranking from the model's scored head while retaining prose explanations separately.
Scored vs. Generated Readouts in Behavioral Language Models: An Empirical Study of Elicitation Format
arxiv
quasi_experimental
medium evidence
8/10 relevance
Full text
usable extracted full text
Source
PDF
Across 13 model×domain cells in retail behavioral prediction, reading the model's scored probability yields better ranking of real outcomes than producing a textual rationale first in 12/13 cells, with AUC improvements of roughly 1.5–14.5 points depending on supervision and format mismatch.
Citation observations
Cumulative provider counts captured on specific dates; providers are never combined.
No provider observation is available for this paper.
Missing data, not a zero citation count.
Language models fine-tuned on customer behavior can predict outcomes and generate explanations, but these readouts are often treated as interchangeable. Holding model checkpoint and prompt content fixed, we compare probabilities obtained by scoring answer tokens with predictions generated after a written rationale. Across 13 model-domain cells covering four retail tasks in three markets, including two using fully public data and checkpoints, the scored readout ranks outcomes more accurately in 12 of 13 cells (two-sided sign test, p approximately 0.003), by 1.5 to 14.5 points in area under the receiver operating characteristic curve (AUC). Paired bootstrap confidence intervals exclude zero in every newly measured cell. The gap varies with task-specific supervision and mismatch between training and serving formats, ranging from -2.2 points for an untuned base model to +13.7 for rationale-format supervision. Analysis of approximately 9,000 rationales identifies two correlates: reduced reliance on the dominant predictive feature and convergence on stock formulations. Probability saturation does not track the gap. A third readout, eliciting a probability before any verdict, improves calibration (Brier score from 0.47 to 0.15) while ranking within noise of scoring, but only for outcome rates represented in training; it is worse than scoring when the scored head is already calibrated. We interpret these differences through the objectives matched by each readout, identify training choices that narrow the gap, and propose retaining generated rationales while sourcing ranking from the scored head.
Summary
Main Finding
Across 13 model×domain cells spanning four retail behavioral prediction tasks, reading a probability directly from a model’s binary outcome head (SCORED) ranks real customer outcomes more accurately than asking the model to produce a free-text rationale first and then answer (GENERATED). The scored readout wins in 12 of 13 cells (two-sided sign test p ≈ 0.003), with AUC improvements of roughly 1.5 to 14.5 points; paired bootstrap CI95 exclude zero in all newly measured contrasts.
Key Points
- Primary result: SCORED > GENERATED for ranking in 12/13 cells; typical ∆AUC ranges from +1.5 to +14.5 points (positive = scored better). Example extremes:
- SEA grocery, Rationale-SFT: SCORED .721 vs GENERATED .584 (+13.7)
- SEA e‑comm, Persona-SFT: SCORED .664 vs GENERATED .519 (+14.5)
- One exception: untuned base on SEA coupon showed a small reverse effect (−2.2).
- External API (gpt-5.5) number-first vs prose-first: +1.4 AUC (CI95 [0.6,2.2]).
- Readout formats tested (same prompt/content otherwise):
- SCORED: probability P(YES) read from model’s outcome head (first-token mass).
- GENERATED: model writes a
rationale (2–4 sentences), then P(YES | rationale). - VERBAL-P: model states a numeric likelihood (0–100) before any verdict.
- What modulates the gap:
- The gap grows with task-specific supervision intensity and with train/serve format mismatch.
- Largest gaps when models were trained in rationale-first format (Rationale‑SFT).
- Smallest gaps when supervision matched the serving decision-first format and was in-domain (InDomain‑SFT).
- Untuned base models can show the opposite sign (small benefit for generated).
- Per-row correlates (from ~9,000 rationales):
- Anchor abandonment: generated rationales that stop citing the dominant predictive feature are associated with worse ranking.
- Template convergence: many generated rationales collapse to a small set of stock openings (up to 33% share of top-3 openings), reducing informative content.
- Probability saturation (verbalized overconfidence) was a visible symptom but did not track the ranking gap.
- A third readout (VERBAL-P) recovers calibration (Brier improvement) and yields ranking within noise of SCORED, but only for outcome rates seen in training; it is worse than SCORED when the scored head is already well calibrated.
- Baseline tabular models remain competitive and often beat the language-model arms on ranking (e.g., GBDT leaves-AUC .838 vs LM .766 on assortment change).
Data & Methods
- Base architecture and pipeline:
- Public base Qwen3.5-27B continued-pretrained on domain corpora, then SFT with LoRA adapters. Checkpoints: Base (untuned), MultiTask‑SFT (decision-format), Persona‑SFT, Rationale‑SFT (rationale-format SFT), InDomain‑SFT, plus gpt-5.5 API as external reference.
- Training data:
- Continued-pretraining on consumer voice and serialized customer trajectories (regional variants).
- SFT mixtures vary in format and domain specificity (decision-first vs rationale-first; multi-task vs in-domain).
- Evaluation domains (ground-truth behavioral outcomes, strict time/customer splits):
- SEA grocery coupon (n=2,000; base rate .199) — proprietary but protocol/code released.
- SEA e-commerce voucher (DMBGN public benchmark; n=3,120 shard).
- Assortment-change (product delisting natural experiments; n=380).
- US grocery campaign (Dunnhumby public mirror; n=2,318; base rate .140).
- Experimental design:
- Controlled comparison holding checkpoint and prompt content fixed; only elicitation/readout varied.
- SCORED: P(YES) taken from first-token probability at temperature 0. GENERATED: same score but conditioned on the model’s own generated rationale (rationale appended then scored). VERBAL-P: numeric probability elicited before verdict.
- Statistics: paired bootstrap (104 resamples) for CI95 on newly measured contrasts; two-sided sign test across 13 cells for directionality (p ≈ 0.003).
- Analysis:
- Per-row rationale analysis to identify textual correlates (anchor usage, template overlap).
- Calibration and Brier score comparisons for readouts.
Implications for AI Economics
- Operational cost of readout choice: Using generated rationales as the single surface for both auditability and ranking can silently degrade targeting quality and therefore misallocate incentive budgets. Even fluent explanations can mask poorer ordering of customers.
- Design recommendation for deployments that need both ranking and explanations:
- Source operational ranking from the model’s scored outcome head (SCORED), which optimizes the discriminative objective most aligned with ranking/AUC.
- Retain generated rationales for auditability, interpretability, and human-facing surfaces, but do not rely on them for ranking unless validated.
- When possible, train with in-domain decision-format supervision to both improve AUC and reduce readout sensitivity.
- If using verbalized probabilities, limit reliance to outcome regimes well represented in training; VERBAL-P can improve calibration but is not a universal fix.
- Model validation and governance:
- Add readout-sensitivity checks to pre-deployment validation: compare SCORED vs GENERATED vs VERBAL-P on held-out, real outcomes and report paired AUC differences and calibration.
- Monitor template convergence and anchor abandonment as diagnostics predicting the loss of predictive content when routing through text.
- Consider regulatory/audit implications: rationale fluency is not proof of faithfulness—audits should include ranking tests, not only inspection of rationales.
- Strategic trade-offs:
- Behavioral simulators remain valuable for natural-language interfaces and transfer to new question forms, but AI-economics teams must weigh the trade-off between human-facing explanations and the fidelity of budget-allocation signals.
- For cost-sensitive targeting decisions, conventional discriminative models (or the scored head of an LLM fine-tuned in decision format) may be preferable for the ranking task itself; LLM-generated rationales can be layered for interpretation and accountability.
Reproducibility note: two of the four domains use public data and public checkpoints; authors release code, prompts, and per-row dumps so third parties can reproduce many reported numbers.
Assessment
Paper Typequasi_experimental
Evidence Strengthmedium — The paper presents a controlled, within-checkpoint comparison with paired rows, multiple real-world domains (including two public datasets), and bootstrap confidence intervals showing consistent directional effects across 12/13 cells; however, external validity is limited by domain focus (retail coupon/voucher settings), particular model family and training pipeline (Qwen3.5-derived checkpoints, LoRA adapters, specific SFT/Rationale pipelines), some small samples (n=380 in one domain), and proprietary data for some cells.
Methods Rigorhigh — Design isolates the readout as the only varying factor per cell, uses paired-row inference and bootstrap CIs, evaluates across multiple checkpoints and domains (including public benchmarks), audits for leakage, and reports correlates and ablations; limitations include some small-sample domains, proprietary-data reliance for parts of the study, and potentially model-family-specific choices (decoding, adapter merge) that could affect generality.
SampleFour binary prediction tasks with real outcomes: SEA grocery coupon redemption (n=2,000, base rate 0.199; proprietary), SEA e-commerce voucher (n=3,120 evaluation shard of public DMBGN benchmark), assortment-change response (n=380, mined natural experiments), and US grocery campaign coupon redemption from Dunnhumby Complete Journey (n=2,318, public); five model checkpoints derived from Qwen3.5-27B via continued pretraining and SFT variants (Base, MultiTask-SFT, Persona-SFT, Rationale-SFT, InDomain-SFT) plus a frontier API (gpt-5.5); baselines include gradient-boosted decision trees on tabular features.
Themeshuman_ai_collab adoption
IdentificationWithin-checkpoint paired readout experiment: for each model checkpoint and evaluation row the authors hold model weights, prompt content, and decoding settings fixed while varying only the elicitation/readout (SCORED vs GENERATED vs VERBAL-P); outcomes are paired at the row level and evaluated with paired bootstrap CIs and sign tests; temporal/customer-disjoint splits and leak audits are used for outcome validity, and some domains exploit natural experiments for instrumenting treatment exposure.
GeneralizabilityFindings are specific to behavioral language models and the described CPT+SFT pipeline (Qwen3.5-27B family with LoRA adapters) and may not generalize to other model families, sizes, or training recipes (e.g., models with different SFT/RLHF, fully fine-tuned weights, or fundamentally different architectures)., Domains are retail-centric (coupon/voucher/campaign response); effects may differ in other economic settings (labor, finance, macro decisions)., Some evaluation cells use proprietary data and modest sample sizes (especially the assortment-change n=380), limiting robustness and external replication for those cells., API models without access to scored logprobs may behave differently; decoding/temperature and merged-adapter serving choices could change outcomes., The measured effect concerns ranking/AUC and calibration under specific readout protocols; other deployment priorities (interpretability, auditability) may trade off differently.
Claims (11)
| Claim | Direction | Outcome | Confidence & Evidence | Details |
|---|---|---|---|---|
| The scored readout ranks real behavioral outcomes more accurately than the generated rationale readout in 12 of 13 model-by-domain cells. Decision Quality | positive | AUC ranking accuracy for binary behavioral outcomes |
Reading fidelity
high
Study strength
high
|
n=13
12 of 13 cells
|
| The scored readout exceeds the generated readout by 1.5 to 14.5 AUC points across the reported cells. Decision Quality | positive | AUC ranking accuracy |
Reading fidelity
high
Study strength
high
|
1.5 to 14.5 AUC points
|
| On the SEA grocery coupon task, the rationale-format-supervised model has a scored AUC of .721 versus a generated AUC of .584, a 13.7-point advantage for scoring. Decision Quality | positive | AUC for coupon redemption prediction |
Reading fidelity
high
Study strength
high
|
n=2000
+13.7 AUC points
|
| On the public US grocery campaign domain, the scored readout outperforms the generated readout for all three evaluated checkpoints, with paired 95% confidence intervals excluding zero. Decision Quality | positive | AUC ranking accuracy for coupon redemption |
Reading fidelity
high
Study strength
high
|
n=2318
+3.0 to +9.3 AUC points; all reported paired CIs exclude zero
|
| The performance gap grows with task-specific supervision and train/serve format mismatch: it ranges from −2.2 AUC points for an untuned base model to +13.7 points for rationale-format supervision. Decision Quality | mixed | Difference in AUC between scored and generated readouts |
Reading fidelity
high
Study strength
medium
|
−2.2 to +13.7 AUC points
|
| In-domain, decision-format supervision produces the smallest gap among the tuned open-weights models and achieves the best scored AUC on the US grocery domain. Decision Quality | positive | AUC ranking accuracy for coupon redemption |
Reading fidelity
high
Study strength
medium
|
n=2318
+3.0 AUC points; scored AUC .808
|
| Rationales that stop citing the dominant predictive feature are associated with larger scored-versus-generated ranking gaps. Decision Quality | negative | Faithfulness to the dominant predictive feature and associated AUC gap |
Reading fidelity
high
Study strength
medium
|
n=9000
rank correlation 0.72 → 0.31
|
| Generated rationales often converge on a small set of stock formulations, with up to 33% of generations sharing a top-three opening. Ai Safety And Ethics | negative | Diversity of generated rationale formulations |
Reading fidelity
high
Study strength
medium
|
n=9000
up to 33% of generations
|
| Probability saturation does not track the scored-versus-generated ranking gap. Decision Quality | null_result | Association between probability saturation and AUC readout gap |
Reading fidelity
high
Study strength
medium
|
not reported
|
| Eliciting a probability before a verdict improves Brier calibration from 0.47 to 0.15 and produces ranking within noise of the scored readout, but only for outcome rates represented in training. Decision Quality | positive | Probability calibration and ranking accuracy |
Reading fidelity
high
Study strength
medium
|
Brier 0.47→0.15
|
| On the assortment-change task, a gradient-boosted tabular model achieves .838 AUC, outperforming the best language-model arm at .766 AUC. Decision Quality | positive | AUC for customer response to product delistings |
Reading fidelity
high
Study strength
medium
|
n=380
.072 AUC difference
|