Language-model-driven multi-agent systems can solve simple inventory problems and, with experience-based matching, beat standard benchmarks in simulations; the AIM-RM agent improves robustness across diverse synthetic supply-chain scenarios, though real-world validation remains outstanding.

Main Finding

An LLM-based multi-agent system (MAS) can produce optimal ordering policies in a restricted multi-echelon inventory setting when given a structured decision prompt (stepwise process + safety-stock rule). However, such LLM-only agents lack robustness across diverse supply-chain scenarios. Augmenting the LLM agents with a memory/retrieval module (AIM-RM) that stores and retrieves similar historical episodes (including RL-generated optimal actions) substantially improves adaptability and outperforms baseline LLM configurations across varied scenarios.

Key Points

• Demonstrates both capability and limits of vanilla LLM-based MAS for inventory management:
  • With a step-by-step environment description (PSD) and a safety-stock strategy (PSS) inserted into the decision prompt (PDM), an LLM (o4‑mini) can derive optimal order decisions in a restricted problem instance.
  • The same LLM agent fails to find optimal policies in other scenario configurations, indicating sensitivity to context and limited generalization without additional mechanisms.
• Proposes AIM-RM: an agent architecture combining:
  • Decision module: LLM-driven PDM that includes PSD, optional PSS, and a memory-usage prompt (PMU).
  • Memory module: vector-indexed stores of past (state, order, reward) tuples; similarity retrieval (Euclidean distance) returns up to K neighbors below a threshold τ for use in decision prompts.
  • Ability to preload RL-generated logs (e.g., from IPPO) so agents can reuse coordinated, high-quality solutions.
• Empirical results: AIM-RM (especially when initialized with RL logs) yields higher total rewards and greater robustness across five experimental scenarios (uniform vs diverse parameters; constant/increasing/decreasing demand) than InvAgent baselines without memory.
• Practical design choices shown important:
  • Explicit stepwise descriptions (PSD) that encode order arrival and timing improve LLM comprehension.
  • Adding a conventional safety-stock calculation (SS = z * σ̂ * sqrt(L + 1)) into prompts gives structure and reduces need for delicate prompt-tuning.
  • Memory retrieval enables implicit coordination across distributed agents by surfacing historically coordinated actions.

Data & Methods

• Problem setup:
  • Multi-echelon inventory MDP with M = 4 stages (tier 0 retailer → tier 3 upstream), episode length T = 12 periods.
  • State per agent: s_m,t = [I_m,t-1, B_m,t-1, B_m+1,t-1, S_m,t-L..S_m,t-1, R_m,t-L..R_m,t-1] (R and S are shipment/received sequences over lead times).
  • Actions: O_m,t (order quantity). Rewards: P_m,t = revenue - procurement cost - backlog penalty - holding cost.
  • Two supply-chain parameter configurations: Uniform (identical across tiers) and Diverse (different lead times, capacities, costs); see Table 1 (paper) for exact numerical settings.
  • Demand patterns: constant (4), increasing (Dinc = 2 + ceil(t/3)), decreasing (Ddec analogous).
• Agent configurations:
  • InvAgent (w/ step desc): PDM includes PSD (stepwise environment description).
  • InvAgent (w/ step and safety-stock): PDM includes PSD + PSS safety-stock heuristic.
  • AIM-RM (w/o RL log): same PDM (with PSD), maintains memory during episode (no preloaded logs).
  • AIM-RM (w/ RL log): memory preloaded with RL (IPPO) simulation results; uses PMU instructing how to leverage retrieved cases.
• LLM and hyperparameters:
  • LLM: OpenAI o4-mini used as decision module.
  • Reasoning parameter settings: high and medium experiments.
  • AIM-RM retrieval: K = 6 nearest neighbors, threshold τ = 2 (Euclidean distance on state embeddings). Embeddings map φ : S → R^d stored in a vector DB.
• Memory/search complexity:
  • Similarity matching cost estimated O(|M| d + X + K) where |M| is memory size, d embedding dimension, X sorting cost.
• Evaluation:
  • 5 episodes per configuration (trade-off between cost and variability) measuring total reward aggregated across tiers and time.
  • Baseline comparisons include heuristic-driven InvAgent variants and RL-generated optimal logs (used as oracle memory for AIM-RM).

Implications for AI Economics

• Practical deployment pathway for AI in supply chains:
  • LLM-based MAS can be a lower-cost, fast-to-deploy alternative to full multi-agent RL in some settings, because prompt-encoded heuristics + LLM reasoning can reproduce optimal decisions without heavy training.
  • Augmenting LLM agents with retrieved historical episodes (especially RL-derived coordinated solutions) yields robustness and transferability across contexts—reducing sample complexity and the simulation/training burden that RL requires.
• Effects on firm-level and market coordination:
  • Distributed LLM agents with shared or interoperable memory could reduce coordination frictions (e.g., mitigate bullwhip effects) by surfacing historically coordinated policies—changing bargaining and inventory dynamics along supply chains.
  • However, benefits depend on data-sharing: firms obtaining or pooling high-quality historical logs (or paying for curated memory) may gain competitive advantages, raising questions about incentives to share memories and potential strategic withholding.
• Investment and infrastructure considerations:
  • Practical adoption implies investments in vector databases, secure experience-sharing mechanisms, and routine curation of historical episodes. These are nontrivial fixed costs but may be smaller than long RL training pipelines.
  • Latency and per-query LLM costs remain relevant; AIM-RM reduces repeated training costs but increases runtime retrieval/LLM query needs.
• Risks, robustness, and regulation:
  • LLM brittleness across scenarios implies economic risk if firms rely solely on off-the-shelf prompts; mis-specified memory pools or mismatched contexts could cause large inventory losses.
  • Data-privacy and competition policy issues: sharing memories across firms (to improve coordination) may raise antitrust concerns or require contractual/regulatory frameworks.
• Research directions for AI economics:
  • Welfare analysis: quantify social welfare gains from decentralized AIM-RM coordination vs centralized RL or conventional heuristics.
  • Incentive design: study contracts and markets for sharing historical logs/memories—who should pay for curated experience stores?
  • Robustness economics: evaluate how model misspecification, demand shocks, and adversarial or nonstationary environments affect equilibrium outcomes when firms deploy LLM agents with memory.
  • Cost-benefit: formalize trade-offs between up-front investment in memory infrastructure + LLM runtime costs vs RL training/simulator calibration costs.
  • Strategic behavior: analyze whether accessible shared memory could enable tacit collusion or price-coordinating behavior implicit in shared policies.
• Overall: This paper points to a pragmatic hybrid approach—structured prompts plus retrieval of experience—that can lower the barrier to using intelligent decentralized agents in supply chains and suggests a rich agenda at the intersection of AI capability, organizational adoption, and economic policy.

If you want, I can (a) extract the exact numeric parameter tables and example prompts from the paper into a compact reference, or (b) draft potential empirical designs to evaluate welfare and incentive effects of memory-sharing across firms. Which would be most useful?