Off-the-shelf LLMs often misalign with human bargaining preferences, but a new benchmark and human-preference training substantially improve strategic depth and negotiated utility across nine test scenarios, including deception and monopoly.

Main Finding

AGORABENCH (a nine-regime bargaining benchmark) plus MERIT (a human-aligned, multi-dimensional performance metric) and a human-preference dataset substantially improve LLM bargaining behavior. Using MERIT as feedback for in-context learning (ICL) and fine-tuning produces deeper, more human-like strategic behavior (higher acquisition of preferred goods, better negotiation power, and stronger opponent awareness) versus profit-only objectives and baseline prompting.

Key Points

• Contributions
  • AGORABENCH: a simulator and offline dataset covering nine economically motivated market regimes (vanilla, deceptive, monopoly, installment, negative seller perception, single vs multi-product variants).
  • MERIT: Multi-dimensional Evaluation of Reasoning & Interaction in Trade — a composite buyer-side score combining Consumer Surplus (CS), Negotiation Power (NP), and Acquisition Ratio (AR).
  • Human-preference dataset: dialogues from LLM negotiations annotated via MTurk; used to tune MERIT weights and to train/guide models.
  • Demonstrated that MERIT-guided ICL and fine-tuning improve negotiation outcomes across multiple LLMs (GPT- and Gemini-series and others).
• MERIT specifics
  • MERITbuyer = α·CS + β·NP + γ·AR
  • CS = (Pwtp − Pdeal) / (Pwtp − Pcost) (normalized consumer surplus)
  • NP = (Pinitial − Pdeal) / (Pinitial − Pcost) (how much buyer shifted price from seller's initial ask)
  • AR = cosine(embedding(acquired_item), embedding(desired_item)) using text-embedding-ada-002
  • Fitted (scaled) weights: α′ ≈ 1.0139, β′ ≈ 0.8812, γ′ ≈ 1.1049 (via Bradley–Terry on MTurk pairwise preferences)
  • MERIT better aligns with human judgments (ROC AUC ≈ 0.80) than a profit-only metric (AUC ≈ 0.68).
• Behavioral findings about LLM negotiators
  • Anchoring effect: higher seller anchors yielded higher deal prices; buyers proposing first tended to secure lower prices (first-mover advantage).
  • Irrational concessions: some models (especially smaller ones) exhibited backtracking and non-monotone offers, which weakens anchoring and looks unlike human behavior.
  • Market-condition effects:
    • Deception capability tended to help buyers (higher MERIT and deal rates in many models).
    • Monopoly contexts harmed buyers (lower MERIT and deal rates).
    • Installment options had mixed effects (sometimes higher deal rates but worse buyer prices).
    • Negative seller perception reduced deal rates.
    • Multi-product settings often raised deal rates (availability of substitutes), but not uniformly across all conditions.
• Empirical improvements
  • Across tested models and conditions, MERIT-guided interventions (prompting/finetuning) substantially increased MERIT and deal rates compared to baseline ReAct prompting and prior narrator-style baselines; several models reached near-100% deal rates in the evaluated settings.

Data & Methods

• AGORABENCH environment
  • Simulator: ReAct (Thoughts–Talk–Action) schema; discrete action space {BUY, SELL, REJECT, DEAL, QUIT}.
  • Scenarios parameterized by product attributes (cost, initial ask, buyer willingness-to-pay), agent profiles, and market regime.
  • Nine regimes: vanilla, deceptive (base for others), monopoly, installment-possible, negative perception, single-product, multi-product (and layered variants).
  • Ensures negotiation is necessary by setting seller initial ask > buyer WTP.
• Human-preference data
  • Collected from MTurk: pairwise comparisons of negotiation dialogues generated by LLMs (20 comparisons per product, ~180 participants total).
  • Used to optimize MERIT weights via Bradley–Terry modeling and to provide supervised signals for fine-tuning/ICL.
• Evaluation & metrics
  • Compared MERIT vs profit-only metrics; measured alignment with human choices (AUC).
  • Reported MERIT scores and deal rates across models and market regimes.
• Models and training
  • Evaluated multiple LLMs (GPT-series, Gemini-series, and others). Experiments include baseline ReAct prompting, alternative narrator-style prompts, and the authors' MERIT-guided ICL/finetuning.
  • Acquisition Ratio computed via text embeddings (text-embedding-ada-002).
  • MERIT used both as evaluation metric and as feedback signal (reward-like supervision) for model adaptation.

Implications for AI Economics

• For research and benchmark design
  • Human-aligned, multi-dimensional rewards outperform single-objective (profit) metrics for training and evaluating strategic agents. Future economic AI benchmarks should integrate ordinal and cardinal preference components (price, product match, perceived satisfaction).
  • Richer market regimes (monopoly, reputational effects, installment plans, deception) are necessary to surface realistic strategic failures and to study policy-relevant dynamics.
• For automated negotiation systems and marketplaces
  • Using MERIT-style objectives can make buyer agents behave in ways closer to human values (prioritizing desired product and perceived satisfaction, not just lowest price), which matters for consumer-facing automation.
  • Systems that learn to exploit deception or dynamic reputation signals pose ethical and regulatory concerns — designs must constrain harmful strategies and manage reputational externalities.
  • Monopoly and asymmetric-power environments can systematically harm automated buyers; platform designers should account for agent incentives and market power effects when deploying automated negotiators.
• For economic modeling and theory
  • Embedding semantic/ordinal preferences (via AR) into utility computations operationalizes non-price utility in agent-based simulations, enabling richer analyses of consumer surplus and welfare in market simulations driven by LLM agents.
  • Observed LLM idiosyncrasies (irrational concessions, unstable anchors) indicate limits in current models’ strategic consistency — theoretical work could explore formalizing bounded-rational heuristics or learning dynamics for LLM agents in repeated/multi-agent markets.
• Safety, policy, and future work
  • Positive: MERIT-guided training can improve alignment with subjective human preferences and perceived fairness.
  • Risks: agents trained with access to deception or adversarial tactics might learn to manipulate human perceptions or game platform rules. Careful constraints and oversight are needed.
  • Open directions: extend MERIT to seller-side objectives, multi-agent markets with many participants, repeated interactions (long-run reputation effects), and cross-cultural preference heterogeneity.

If you want, I can produce a one-page slide-ready summary, extract key quantitative results (tables/figures) into a compact table, or draft suggested follow-up experiments to test robustness (e.g., repeated-play reputation dynamics, cross-market transfer).