Large language models guided by numerical optimization can autonomously discover new, interpretable inventory policies that substantially lower simulated lost-sales costs—yielding mean cost reductions of ~17–30% versus optimized base-stock rules and retaining ~22% average savings after re-optimization across 10,064 transfer instances.
Automated Design of Inventory Policy with Large Language Models: An Exploratory Study
An LLM-guided, optimization-informed search framework (AIPS) discovers interpretable replenishment policy classes that, after parameter optimization, reduce simulated lost-sales inventory costs substantially (mean reductions rising from 17.5% after one generation to 30.0% after ten generations versus optimized base-stock benchmarks) and generalize to thousands of new instances.
Citation observations
Cumulative provider counts captured on specific dates; providers are never combined.
No provider observation is available for this paper.
Missing data, not a zero citation count.
Firms making inventory decisions have access to operational data, optimization tools, and large language models (LLMs). Typically, data characterize the operating environment, optimization selects parameters within a prespecified inventory policy class, and LLMs support coding and decision analysis. We develop an integrated framework that combines these resources to automate inventory policy design. Given demand data, the framework iteratively uses an LLM to generate parameterized policy classes and an external solver to optimize its parameters within each class. Across 30 lost-sales inventory instances, the mean cost reduction relative to optimized base-stock benchmarks increases from 17.5% after one generation to 30.0% after ten generations. Parameter optimization is central to this performance: an LLM-only variant performs substantially worse, whereas optimization-guided feedback improves policy quality, accelerates search, and directs the LLM toward better policy classes rather than merely better parameter values within a fixed class. The strongest discovered policies are also interpretable: they combine recognizable inventory-control motifs, including capped orders, discounted or weighted pipeline inventory, and threshold-based replenishment logic. The search thereby produces new policy-class functional forms that, to our knowledge, have not previously been studied in the lost-sales inventory literature. These functional forms are not specified ex ante but emerge from the search process. Moreover, after their parameters are re-optimized, three discovered policy classes achieve average cost reductions of 21.75% to 22.60% across 10,064 new inventory instances. Overall, the results show that data-driven parameter optimization can guide LLM-based search over a broad space of inventory policy classes and identify high-performing, interpretable, and transferable decision rules.
Summary
Main Finding
An integrated framework (AIPS) that combines off-the-shelf LLMs with data-driven numerical optimization can automatically discover high-performing, interpretable replenishment-policy classes for lost-sales inventory problems. Across a suite of problems, AIPS-generated policy classes—after parameter optimization—substantially outperform optimized base-stock benchmarks (mean cost reduction ≈17.5% after one generation, ≈30.0% after ten generations). Optimization-guided feedback is central: LLM-only proposals perform much worse, while returning optimized parameters and performance to the LLM accelerates discovery of better policy classes whose structures are interpretable and transferable.
Key Points
- Problem focus: single-item, periodic-review lost-sales inventory with positive lead times—settings where choice of policy-class materially affects performance.
- AIPS architecture: LLM proposes parameterized policy classes (executable code), an external numerical optimizer finds best parameters for each class via simulation-based empirical cost minimization, simulation evaluates performance, and results feed back to the LLM to generate new classes iteratively.
- Empirical gains: over 30 benchmark instances, mean cost reductions vs optimized base-stock rise from 17.5% (generation 1) to 30.0% (generation 10).
- Optimization matters: an LLM-only variant (no parameter optimization) yields substantially worse policies. Optimization-guided feedback directs the LLM toward structurally better policy classes rather than merely better parameter guesses.
- Interpretability: top discovered classes combine inventory-control motifs (capped orders, discounted/weighted pipeline inventory, threshold-based replenishment). These are economically meaningful and in some cases novel to the lost-sales literature.
- Transferability: after re-optimizing parameters, three discovered classes achieved average cost reductions of 21.75%–22.60% across 10,064 new instances (varying lead times, cost ratios, and demand distributions).
- Sensitivity: performance depends on LLM backbone (authors tested six: GPT-5 Nano, Gemini 2.5 Flash-Lite, Grok 4.1 Fast NR, GPT-5 Mini, DeepSeek V3, Gemini 3 Flash). Numerical optimization reduces but does not remove backbone variation.
Data & Methods
- Inventory model:
- Single-item, periodic review over T periods, deterministic lead time L.
- State: on-hand I_on and L pipeline components I_pipe, arrivals shift forward each period; unmet demand is lost.
- Costs: holding cost h per unit held, lost-sales penalty p per unit unmet; no variable ordering cost.
- Decision: stationary Markov policy π mapping state to nonnegative order quantity (bounded by a large upper limit).
- AIPS framework:
- LLM-based policy-class generator: prompts an LLM to produce executable, parameterized policy classes (code mapping inventory state → order quantity). Classes may be simple (base-stock) or richer/custom combinations of state features.
- Parameter optimization: for each generated class, use a numerical optimizer to minimize a simulation-based empirical cost over parameter space, producing an optimized policy representative of that class.
- Simulation evaluator: simulates optimized policies to estimate empirical cost; returns performance statistics and optimized parameter values.
- Feedback loop: feed optimized parameters, code, and performance back to the LLM to guide next-generation class proposals; iterate across generations (authors report up to 10).
- Experiments:
- Suite: 30 lost-sales instances for core benchmarking; further robustness tests across lead times L∈{2..8}, multiple p/h ratios, and a range of demand distributions (bounded continuous/discrete, light-to-moderate tails, heavy/skewed).
- Ablations: compare full AIPS vs LLM-only vs variants without optimization-guided feedback.
- Cross-model study: evaluate sensitivity to LLM choice (six backbones), default generator = DeepSeek (deepseek-chat-v3-0324) in main experiments.
- Transfer tests: re-optimize parameters of discovered classes on 10,064 new instances to assess generality.
- Key quantitative results:
- Mean cost reductions relative to optimized base-stock: 17.5% (gen 1) → 30.0% (gen 10).
- Top discovered classes remain effective after parameter re-optimization on large out-of-sample instance set (avg reductions ≈21.75–22.60%).
Implications for AI Economics
- LLMs as design engines, not direct deciders: The economic value of LLMs in operational decision problems may lie more in expanding the design/search space (generating novel, interpretable functional forms) than in acting as one-shot decision agents. Firms can leverage LLM creativity while retaining numerical optimization to ensure parameter-level efficiency.
- Complementarity of data, optimization, and LLMs: Data-driven empirical objectives and numerical solvers provide the evaluative backbone that guides LLMs toward economically meaningful structures. This complementarity suggests practical deployment paths where generative models accelerate model class discovery and optimization secures performance.
- Productivity and cost implications: Automated discovery of better policy classes can yield nontrivial cost savings (20–30% in experiments) in lost-sales settings—potentially large aggregate economic gains for inventory-intensive firms. Because discovered policies are interpretable, adoption barriers (trust, regulation, auditability) are lower than for opaque black-box policies.
- Robustness and governance considerations: Gains depend on LLM quality and the optimization/evaluation pipeline. Organizations should (a) retain optimization-based evaluation, (b) re-optimize parameters when transferring rules to new environments, and (c) validate discovered classes across plausible demand regimes. Model-choice heterogeneity implies governance/validation protocols before operational adoption.
- Research and policy directions:
- Extend to multi-item, multi-echelon, capacity-constrained, and nonstationary environments; quantify sample complexity and compute costs.
- Formalize guarantees: develop methods to certify safety, worst-case performance, or statistical generalization of discovered classes.
- Human-in-the-loop workflows: integrate domain experts to steer LLM search, prioritize interpretable motifs, and incorporate managerial constraints.
- Economic evaluation: study market-level impacts if many firms adopt automated policy-discovery tools (competitive dynamics, welfare effects).
- Practical caveats: computational expense (simulation + optimization + LLM generations), dependence on prompt design and LLM capabilities, and the need for reliable demand data and realistic simulation models. Despite these, AIPS illustrates a scalable template: use generative models to suggest structural innovation and rely on optimization + data to validate and calibrate economically meaningful decision rules.
Assessment
Paper Typedescriptive
Evidence Strengthmedium — The paper provides extensive simulation-based experiments (multiple demand families, lead times, cost ratios, ablations, and cross-model comparisons) demonstrating consistent cost reductions from the proposed LLM+optimization framework; however, evidence is limited to synthetic/simulated inventory environments and offline computational experiments rather than field or real-world deployment data.
Methods Rigorhigh — The study runs many controlled experiments: benchmark comparisons, ablations that isolate the role of numerical optimization, structural analyses of discovered policies, robustness/transfer tests across thousands of instances, and sensitivity checks across multiple LLM backbones; evaluation uses simulation-based optimization and re-optimization of parameters for transfer — collectively a thorough computational methodology, though still limited to simulated settings.
SampleSimulation-based experiments on lost-sales, periodic-review single-item inventory systems. Primary experiments over 30 inventory instances (varied lead times, demand distributions, and cost ratios); further transfer/generalization evaluation across 10,064 new inventory instances. Multiple LLM backbones tested (e.g., DeepSeek v3 default, GPT-5 Nano, Gemini variants, Grok, GPT-5 Mini). Policies evaluated via simulation with numerical parameter optimization and iterative LLM-guided policy-class search.
Themesproductivity innovation
GeneralizabilityResults are from simulated single-item lost-sales models and may not transfer directly to multi-item, multi-echelon, or real-world supply chains., Environments are stationary; nonstationary demand or dynamic contexts may limit policy performance., Performance depends on LLM backbone and prompt/implementation specifics; commercial LLM updates could change outcomes., Computational costs and scalability to large real-world datasets/operational constraints are not demonstrated., Assumes ability to simulate environment accurately; misspecification of demand or lead-time processes in practice could reduce effectiveness.
Claims (7)
| Claim | Direction | Outcome | Confidence & Evidence | Details |
|---|---|---|---|---|
| Across 30 lost-sales inventory instances, the mean cost reduction relative to optimized base-stock benchmarks increased from 17.5% after one generation to 30.0% after ten generations of AIPS search. Organizational Efficiency | positive | Mean inventory cost relative to an optimized base-stock benchmark |
Reading fidelity
high
Study strength
medium
|
n=30
17.5% cost reduction after one generation; 30.0% cost reduction after ten generations
|
| Numerical parameter optimization is central to AIPS performance: an LLM-only variant performs substantially worse than the optimization-guided framework. Organizational Efficiency | negative | Inventory-policy performance of the LLM-only variant relative to optimization-guided AIPS |
Reading fidelity
high
Study strength
medium
|
not reported
|
| Optimization-guided feedback improves policy quality, accelerates the search, and directs the LLM toward better policy classes rather than merely better parameter values within a fixed class. Organizational Efficiency | positive | Quality and efficiency of the search over inventory policy classes |
Reading fidelity
high
Study strength
medium
|
not reported
|
| The strongest policies discovered by AIPS are interpretable and combine recognizable inventory-control motifs, including capped orders, discounted or weighted pipeline inventory, and threshold-based replenishment logic. Decision Quality | positive | Interpretability and structural content of discovered inventory policies |
Reading fidelity
high
Study strength
medium
|
not reported
|
| After re-optimization, three discovered policy classes achieved average cost reductions of 21.75%–22.60% across 10,064 new inventory instances. Organizational Efficiency | positive | Average inventory cost relative to the benchmark on new inventory instances |
Reading fidelity
high
Study strength
medium
|
n=10064
21.75%–22.60% average cost reduction
|
| The discovered policy classes include functional forms that, according to the authors, had not previously been studied in the lost-sales inventory literature. Innovation Output | positive | Novelty of discovered inventory-policy functional forms |
Reading fidelity
medium
Study strength
low
|
not reported
|
| The economic performance of discovered policies varies with the choice of LLM backbone, although numerical parameter optimization reduces, but does not eliminate, this variation. Organizational Efficiency | mixed | Economic performance of discovered inventory policies across LLM backbones |
Reading fidelity
high
Study strength
medium
|
n=6
|