Limit, label and let users contest: the paper argues that LLM-powered robots allocating scarce, real-time help should use a governance-vetted menu of prioritization modes, clearly communicate which mode is active, and offer an easy contest pathway; this reduces hidden value skews and ad-hoc user configuration but requires governance, adjudication capacity, and careful design to avoid new inequities.

Main Finding

The paper proposes "bounded calibration with contestability" as a design pattern for LLM-enabled robots that must allocate scarce, real-time assistance among multiple people. The pattern constrains prioritization to a governance-approved set of admissible modes, makes the active mode legible at the moment of deferral, and provides an outcome-specific, easy-to-use contest channel. This approach treats pluralistic values and LLM behavioral variability as persistent conditions and aims to avoid hidden value skews and burdensome, ad-hoc user configuration under time pressure.

Key Points

• Problem framed: LLM-mediated, multi-user assistance allocation combines pluralistic (reasonable-disagreement) value tradeoffs with unpredictable LLM behavior across prompts and contexts, making onsite allocation decisions socially fraught and technically brittle.
• Design pattern (bounded calibration with contestability) has three core elements:
• Governance-approved menu of admissible prioritization modes (limits the policy space to vetted options).
• Legibility at the contact point (the robot clearly communicates which mode is active and why when deferring or prioritizing).
• Outcome-specific contest pathway (users can contest a particular decision without renegotiating global rules).
• Rationale: Avoids two problematic alternatives—opaque silent defaults that mask value choices, and wide-open user-configurable value sliders that offload moral choice under stress.
• Illustration and evaluation: The pattern is shown via a public-concourse robot vignette and an evaluation agenda focused on legibility, procedural legitimacy, and actionability.
• Risks identified: automation bias (over-reliance on robot decisions), uneven usability/access to contest channels, potential gaming or strategic behavior, and governance/design costs.

Data & Methods

• Nature of work: Conceptual/design proposal rather than an empirical study.
• Evidence in paper: A concrete vignette (public-concourse robot) used to illustrate how the pattern plays out in practice, plus a proposed evaluation agenda.
• Proposed evaluation methods (as outlined by the authors):
  • User studies and field pilots measuring legibility (do people understand the active mode?), procedural legitimacy (do people see the process as fair?), and actionability (can users effectively contest outcomes?).
  • Metrics to collect: contest frequency and outcomes, time-to-help for different groups, user satisfaction, perceived fairness, incidence of automation bias, and usability/access disparities for contest pathways.
  • Potential empirical tools: A/B experiments, logs/audit trails of decisions, surveys/interviews, and controlled scenarios to test manipulation/gaming.
• Limitations: No empirical data reported; evaluation agenda remains to be operationalized and tested in deployments.

Implications for AI Economics

• Allocation efficiency vs. equity tradeoffs: The pattern recognizes that resource allocation in real time is both an efficiency and distributional problem. Constraining policy options can reduce costly misallocations due to LLM unpredictability but may also lock in distributional outcomes chosen by governance.
• Transaction and enforcement costs: Implementing governance-approved menus, legibility interfaces, and contest systems creates administrative and operational costs (design, monitoring, adjudication). These are economic frictions that affect overall system welfare and scale.
• Externalities and strategic behavior: Readily contestable decisions create incentives for strategic contesting (false claims, gaming) and may increase congestion of the assistance system; conversely, transparent rules can reduce costly disputes and increase trust.
• Incentives for governance design: Who designs the admissible menu matters—regulators, platform operators, or local stakeholders—and their incentives shape distributional outcomes. Economic policy analyses should account for capture, political economy, and welfare implications of menu selection.
• Measurement and auditing value: Legible decision modes and recorded contest pathways improve verifiability and lower information asymmetries. This has value for regulators and platforms in reducing litigation, reputational risk, and monitoring costs.
• Adoption and labor effects: Devices that transparently allocate help and offer contest routes may increase user trust and uptake but could reduce some on-site human discretion (affecting jobs that currently triage); conversely, contest resolution may create new labor or adjudication roles.
• Welfare and inequality: If contest channels are unevenly usable (digital literacy, language, physical access), the pattern could exacerbate inequities unless contest pathways are designed and resourced to be inclusive.
• Research and policy priorities: Empirical evaluation (field experiments, logged outcomes, cost–benefit analyses) is needed to quantify tradeoffs—efficiency gains from constrained, legible systems versus costs of governance and contest handling; distributional impacts across demographic groups; and effects on subsequent behavior (gaming, reliance).

If you want, I can (a) draft an experimental design and metrics to evaluate bounded calibration with contestability in a field pilot, or (b) map the likely welfare tradeoffs into a simple economic model (social planner vs. platform designer) to quantify when the pattern improves expected welfare. Which would be most useful?