Automated Mediator for Human Negotiation: Pre-Mediation via a Structured LLM Pipeline

Pre-mediation, the preparatory phase preceding direct human negotiation, plays a critical role in achieving mutually beneficial agreements, yet is often omitted due to cost, time, and limited access to trained mediators. We introduce an automated mediator for human negotiation, implemented as a structured pipeline of LLM modules, that supports pre-mediation in integrative negotiation settings. The pipeline decomposes preparation into specialized modules for dialogue, preference prediction, response-level critique, and structured summarization, separating inference, generation, and evaluation to address limitations of monolithic single-prompt approaches. We use the term "agent" for each module following common LLM-systems terminology, but the components are not autonomous and do not interact peer-to-peer; outputs are passed forward in a fixed sequence. We evaluate the system in two controlled human-subject experiments comparing AI-based pre-mediation with professional human mediators in a multi-issue negotiation scenario. On short-term self-reported measures, the automated mediator achieves preparation outcomes broadly comparable to human mediators, including trust in the mediator and confidence in reaching mutually beneficial agreements, while achieving substantially lower error on the preference-inference task under our scenario and prompts (36% lower RMSE). A second study shows that targeted prompt refinements reduce excessive affirmation patterns from 36.6% to 16.8%, matching human mediator baselines. Our findings suggest that structured LLM pipelines can provide scalable, low-effort pre-mediation support broadly comparable to human mediators on short-term self-reported preparation outcomes. The pipeline's single-party design mirrors how human mediators run pre-mediation today and enables parallel deployment across all parties to a dispute, supporting scalability.

Summary

Main Finding

A structured pipeline of specialized LLM modules can provide scalable, single-party pre-mediation support that yields short-term, self-reported preparation outcomes broadly comparable to professional human mediators in an integrative negotiation scenario. The pipeline’s dedicated user-prediction module also inferred participant preferences substantially more accurately than human mediators in the study (36% lower RMSE). Prompt refinements reduced an initially excessive affirmation behavior to human-level rates without degrading preparation gains.

Key Points

System architecture
- Sequential pipeline of specialized LLM modules (not an autonomous multi-agent system): user prediction → pre-mediation dialogue → critic → summary generator. Optional voice-to-text (Whisper-1).
- Underlying model: GPT-4o for modules.
- Critic module is architecturally separated and returns APPROVED/REJECTED (Study 1) and WARNING (Study 2) to reduce self-reinforcement errors.
- Single-party design: each disputant can be prepared independently (mirrors human pre-mediation workflow), enabling parallel, scalable deployment.
Scenario and protocol
- Roommate conflict with three issues (chores, quiet hours, guest policy).
- Dialogue follows an 8-phase structured protocol (rapport, exploration, prioritization, perspective-taking, emotional awareness, confidence, relationships, closing).
- Prediction module outputs structured JSON over 11 SVI-derived parameters (preferences, emotion, cooperative vs competitive orientation) with confidence scores.
Experimental results (controlled human-subject studies)
- Study 1: n=38 (AI n=20; Human mediator n=18).
  - Both AI and human conditions produced significant pre→post gains in trust and confidence in mutual outcome.
  - AI uniquely improved participants’ sense of staying true to principles and handling frustration; humans uniquely improved negotiation confidence.
  - Prediction accuracy: AI prediction agent RMSE = 0.61 vs human baseline RMSE = 0.95 (36% lower).
  - Affirmation rate: AI messages contained affirming content at 36.6% vs human mediators 18.9% (∼1.9×), associated with slight entrenchment in issue importance (AI mean change +0.20; Human mean change −0.36).
- Study 2: n=22 (refined AI prompts)
  - Prompt changes: reduce excessive validation, add perspective-taking prompts, add reality-testing.
  - Affirmation rate dropped from 36.6% → 16.8%, matching human baseline, while maintaining significant pre→post improvements in trust and confidence (i.e., no loss of effectiveness).
Design insights
- Decomposing functions (prediction, generation, critique, summarization) helps isolate inference from persuasion and improves prediction accuracy.
- Dedicated critic avoids degeneration-of-thought seen in self-critique.
- Generated structured summaries facilitate human-in-the-loop oversight and reuse by live mediators.

Data & Methods

Participants
- Study 1: 38 university students (20 AI, 18 human mediator), recruited via campus channels; paid and course-credit participants mixed; IRB-approved.
- Study 2: 22 university students in refined-AI condition; same procedures and approvals.
Measures
- Subjective Value Inventory (SVI) dimensions used to capture multi-dimensional preparation effects: instrumental outcomes, self-perception, process fairness, relationship quality.
- Survey items (5-point Likert) measured trust in mediator, confidence in positive outcome for all parties, negotiation confidence, preparedness to understand counterpart, preparedness to stay true to principles, preparedness to handle frustration.
- Issue importance ratings for the three negotiation issues (pre/post).
- Prediction accuracy measured by RMSE on inferred preference parameters compared to ground truth.
- Transcript analysis for affirmation patterns using GPT-4o flagging then human review.
Pipeline details
- Prediction agent uses SVI-derived 11 parameters; outputs structured JSON with confidences.
- Dialogue agent uses an 8-phase structured protocol and receives prediction outputs to personalize strategy.
- Critic evaluates each candidate response against criteria (e.g., avoids multiple questions, not purely validating) and can reject/warn.
- Summary agent produces a structured report of interests, emotional themes, and recommended focus areas for mediator oversight.
Limitations of the empirical setup
- Small, convenience university samples.
- Single scenario (roommate, 3 issues) — limits generalizability.
- Outcomes are short-term, self-reported; no long-run agreement rates or third-party assessed negotiated outcomes reported.
- The system had no access to counterpart preferences (intentionally), so joint-session dynamics were not evaluated.

Implications for AI Economics

Scalability and access
- Automated pre-mediation can materially lower cost and time barriers to structured negotiation preparation, potentially increasing access to mediation services and reducing unmet demand in civil/family/community disputes.
- Single-party, parallel deployment enables large-scale rollout across many disputants simultaneously — reducing per-case marginal cost.
Efficiency and market effects
- Better preference inference (lower RMSE) can reduce information asymmetries and bargaining inefficiencies, enabling more integrative trades and potentially higher joint gains in markets of bilateral/multi-issue agreements.
- If deployed at scale, such systems could change the value proposition of human mediators: shifting human roles toward oversight, high-stakes or culturally sensitive cases, and joint-session facilitation.
Labor and service structure
- Demand for routine pre-mediation labor could decline; demand for trained mediators may concentrate in complex cases, or shift to supervisory/review roles — implying occupational reallocation and potential upskilling needs.
- New business models: subscription/embedded pre-mediation in rental platforms, HR tooling, online dispute resolution marketplaces, or as a component of negotiation training products.
Strategic and incentive considerations
- Parallel single-party pre-mediation preserves private preparation, which may alter bargaining power dynamics depending on asymmetric access — equitable deployment and pricing matter.
- Systems that infer preferences more accurately could be gamed or strategically manipulated; platform design must account for adversarial reporting and incentive compatibility.
Welfare, distributional, and regulatory concerns
- Privacy and data governance: pre-mediation requires sensitive personal and emotional information — policies for data protection, consent, and retention are critical.
- Distributional impacts: scaling low-cost pre-mediation could disproportionately benefit those lacking access to paid mediators, but inequitable deployment could exacerbate disparities (if only some parties use the tool).
- Ethical/regulatory oversight needed for persuasion boundaries, liability (misleading guidance), and cross-cultural validity of prompts and models.
Research and evaluation priorities for economics and policy
- Field experiments measuring real negotiated outcomes, joint-session dynamics, and longer-term relationship/recidivism effects.
- Cost-benefit analyses of substituting automated pre-mediation for human-prep across case types, including sensitivity to model errors (misinference costs).
- Mechanism design studies to ensure incentive compatibility when parties privately use AI pre-mediation tools.
- Labor market modeling for mediator occupations under partial automation and potential retraining pathways.

Short summary: decomposed LLM pipelines can deliver effective, low-cost pre-mediation at human-comparable short-term outcomes and superior preference inference in a controlled scenario; this suggests notable potential to scale mediation services, but generalizability, long-run efficacy, strategic effects, privacy, and labor-market consequences require further empirical and economic evaluation.

Assessment

Paper Typerct Evidence Strengthmedium — The paper uses controlled human-subject experiments with an objective preference-inference metric (RMSE) and self-reported outcomes, giving credible causal comparisons between AI and human mediators in the experimental setting; however, outcomes are short-term and largely self-reported, the negotiation setting is simulated and narrow, and details on randomization balance, sample size, and field validation are not provided, limiting external validity. Methods Rigormedium — Methodologically strong in designing a structured LLM pipeline, separating modules for inference/generation/evaluation, and running two controlled experiments including objective error measurement and iterative prompt refinement; but the rigor is limited by reliance on short-term lab measures, unspecified sample composition and sizes, potential demand/experimenter effects, and no long-run or real-world deployment evidence. SampleHuman participants engaged in a controlled multi-issue integrative negotiation exercise; professional mediators provided the human-mediator baseline; the AI condition used a structured LLM pipeline with modules for dialogue, preference prediction, critique, and summarization; outcomes include short-term self-reported measures (e.g., trust, confidence) and an objective preference-inference task (RMSE); exact sample sizes, recruitment source (e.g., MTurk/lab), and demographic breakdown are not specified in the summary. Themeshuman_ai_collab adoption IdentificationControlled between-subject human experiments that assign participants to receive either AI-based pre-mediation or professional human mediator pre-mediation in a multi-issue negotiation scenario, comparing outcomes (self-reported preparation measures and an objective preference-inference RMSE) across arms; a follow-up experiment tests prompt refinements to the AI pipeline. GeneralizabilityShort-term, self-reported outcomes may not map to real-world negotiation success, long-term agreements, or economic gains, Experimental, simulated multi-issue negotiation may not capture complexity of real disputes or high-stakes bargaining, Results depend on the specific prompts, LLM(s), and pipeline design used and may not hold for other architectures or domains, Professional mediator skill and approach vary; baseline may not represent broader mediator practice, Participant pool details unspecified (convenience samples limit population representativeness and cross-cultural applicability)

Claims (10)

Claim	Direction	Confidence	Outcome	Details
Pre-mediation, the preparatory phase preceding direct human negotiation, plays a critical role in achieving mutually beneficial agreements, yet is often omitted due to cost, time, and limited access to trained mediators. Decision Quality	positive	high	achievement of mutually beneficial agreements (role of pre-mediation)	0.3
We introduce an automated mediator for human negotiation, implemented as a structured pipeline of LLM modules, that supports pre-mediation in integrative negotiation settings. Organizational Efficiency	positive	high	availability of automated pre-mediation support (system implementation)	0.6
The pipeline decomposes preparation into specialized modules for dialogue, preference prediction, response-level critique, and structured summarization, separating inference, generation, and evaluation to address limitations of monolithic single-prompt approaches. Organizational Efficiency	positive	high	modularized pre-mediation workflow (design decomposition)	0.6
The pipeline's components are not autonomous and do not interact peer-to-peer; outputs are passed forward in a fixed sequence (single-party pipeline). Other	neutral	high	pipeline execution model (fixed-sequence, non-autonomous modules)	0.6
We evaluate the system in two controlled human-subject experiments comparing AI-based pre-mediation with professional human mediators in a multi-issue negotiation scenario. Research Productivity	neutral	high	comparative evaluation between AI-mediated and human-mediated pre-mediation	0.6
On short-term self-reported measures, the automated mediator achieves preparation outcomes broadly comparable to human mediators, including trust in the mediator and confidence in reaching mutually beneficial agreements. Decision Quality	positive	high	self-reported trust in mediator; confidence in reaching mutually beneficial agreements (short-term)	0.6
The automated mediator achieves substantially lower error on the preference-inference task under our scenario and prompts (36% lower RMSE). Error Rate	positive	high	preference-inference error (RMSE)	36% lower RMSE 0.6
Targeted prompt refinements reduce excessive affirmation patterns from 36.6% to 16.8%, matching human mediator baselines. Error Rate	positive	high	rate of excessive affirmation patterns (response behavior)	36.6% to 16.8% 0.6
Structured LLM pipelines can provide scalable, low-effort pre-mediation support broadly comparable to human mediators on short-term self-reported preparation outcomes. Organizational Efficiency	positive	medium	scalability and effort required for pre-mediation support; comparability on short-term self-reported preparation outcomes	0.36
The pipeline's single-party design mirrors how human mediators run pre-mediation today and enables parallel deployment across all parties to a dispute, supporting scalability. Adoption Rate	positive	high	parallel deployability / scalability of pre-mediation support	0.1

An automated LLM pre-mediator performs comparably to professional mediators on short-term preparation measures while inferring party preferences more accurately — cutting preference-inference error by 36%; prompt tuning also reduces excessive affirmation to match human mediator baselines.