An LLM-driven adaptation layer raises e-scooter demand satisfaction and revenue in Chicago backtests, outperforming standard rebalancing policies. The AMPLIFY framework tweaks baseline strategies in real time under emergent events, suggesting LLMs can flexibly improve operational efficiency — though results are limited to simulations in one city.

Main Finding

The paper introduces AMPLIFY, a modular LLM-augmented policy-adaptation framework that sits on top of existing shared-micromobility rebalancing policies and uses an LLM (GPT-4o in experiments) to adapt baseline rebalancing plans in real time under emergent scenarios (demand surges, vehicle outages, regulator directives). On a real-world Chicago e-scooter dataset, AMPLIFY improves demand satisfaction and system revenue in emergent scenarios compared to rule-based and optimization baselines. Grounding the LLM in a pre-generated baseline policy and using an iterative self-reflection loop yields more feasible and stable adaptations than asking the LLM to generate plans from scratch.

Key Points

• Architecture: Two decoupled components
  • Baseline vehicle rebalancing module (optimization- or learning-based) that generates an initial plan.
  • LLM-augmented adaptation agent that ingests the baseline plan, current vehicle distribution, predicted demand, and a natural-language description of the emergent situation, and outputs an adapted plan.
• Emergent scenarios addressed:
  • Rising demand (observable and latent surges)
  • Shrinking supply (vehicle faults/maintenance)
  • Dynamic goals (e.g., regulator-imposed equity targets)
• Input modality: Natural language descriptions of emergent events (reflecting real-world operator reports).
• Prompting + self-reflection: The LLM is given a structured prompt with system background, real-time context, and adaptation instructions; it iteratively verifies and revises outputs (checking feasibility constraints such as vehicle conservation and dimensional validity).
• Empirical finding: LLM-based adaptations yield higher demand satisfaction and revenue under emergent events. Grounding the LLM in baseline strategies significantly improves effectiveness and stability versus direct LLM-only planning.
• Practical advantages: real-time, human-like adaptation without retraining baseline models or hand-coding scenario-specific rules.

Data & Methods

• Dataset: Public Chicago e-scooter dataset (June–September 2022), ~629k trips, operators: Lime/Spin/Bird.
• Spatial partition: 77 city regions (community divisions).
• Temporal setup: Day divided into 24 hourly slots; operator rebalancing occurs every 12 hours.
• Modeling:
  • Baseline rebalancing policies can be optimization-based (e.g., genetic algorithm) or learning-based (RL).
  • Emergent scenario formalization Et = {∆Ut (demand changes), ∆St (supply changes), Ct (constraints)}.
  • Adaptation policy πadj(at, St, Et) → ˆat; objective maximize expected system utility R(ˆat, Et) (metrics: demand satisfaction, revenue, equity).
• LLM setup:
  • Model: GPT-4o used as the adaptation agent.
  • Prompt contains structured system state (vehicle distribution, demand predictions, trip variance), baseline plan, and multi-step adaptation instructions.
  • Self-reflection loop: up to 10 iterations to check and refine candidate adaptations.
• Implementation: PyTorch, python-mip, gym; experiments run on a server with 32 GB RAM and an RTX 3080 Ti GPU.
• Baselines evaluated (examples described): SDSM (rule-based demand-supply matching), GA (genetic-algorithm optimization). Performance compared primarily under emergent scenarios; metrics include demand satisfaction, system revenue, and vehicle deployment equity.
• Key empirical results: AMPLIFY substantially improves pre-optimized strategies in emergent scenarios (more satisfied demand, higher revenue), and grounding in baseline plans reduces infeasible or unstable LLM outputs.

Implications for AI Economics

• Operational efficiency and revenue capture
  • Real-time LLM-driven adaptation can reduce missed trips during demand surges and increase operator revenue without retraining costly models—improving short-run revenue extraction and utilization of fixed fleets.
• Cost-benefit and deployment trade-offs
  • Using an LLM as an adaptation layer can be cheaper and faster than retraining robust policies for every conceivable shock, but introduces ongoing model-inference costs and API/compute expenses; quantifying per-adaptation cost vs. marginal revenue gain is an important next step.
• Labor and organizational effects
  • The approach can reduce reliance on scarce human-in-the-loop operators for ad hoc interventions, shifting managerial roles toward monitoring and verification of LLM outputs.
• Market competition and strategic behavior
  • Operators with more responsive, LLM-augmented systems may obtain competitive advantages in demand-dense episodes (events, festivals), potentially increasing market concentration unless regulators require fairness-equity constraints.
• Regulation, governance, and welfare
  • The ability to interpret natural-language regulatory directives is valuable, but also raises governance questions: how to audit LLM adaptations, ensure compliance with safety/regulatory constraints, and prevent gaming (e.g., manipulating natural-language signals)?
  • Equity implications: LLMs can be directed to satisfy regulatory equity goals, but the choice of equity metric and enforcement mechanism matters for distributional welfare.
• Risk and robustness
  • LLMs can hallucinate or propose infeasible transfers; grounding in explicit baselines and self-reflection mitigates this but does not eliminate model risk. Economic analyses should account for the cost of failures (misallocations, downtime).
• Research directions for AI economics
  • Formal cost–benefit studies comparing (i) retrained robust policies, (ii) LLM-adaptation layers, and (iii) human-in-the-loop interventions across a range of shock frequencies/intensities.
  • Mechanism design for incentives: aligning operator profit motives with social goals (equity, coverage) when adaptation is automated.
  • Dynamic pricing integration: combining rebalancing adaptation with price signals to manage both demand and supply economically.
  • Welfare and externalities: study how improved rebalancing affects congestion, modal substitution, emissions, and public transit ridership.
  • Measurement of ongoing operational costs (compute, latency, monitoring) and regulatory compliance costs when deploying LLM-based adaptors in production systems.

Limitations noted in the paper and relevant for economic assessment: reliance on LLM reliability and grounding, model inference cost/latency, the need for strong feasibility checks (safety layers), and evaluation focused on a particular dataset and set of emergent scenarios—generalization and long-run effects remain to be quantified.