Summarizing planned promotions and holidays with an LLM cuts demand-forecasting errors sharply: EventCast reduces MAE by up to 57% and MSE by up to 83% versus top industrial baselines during event-driven periods, and delivers large improvements versus models that ignore event knowledge.

Main Finding

EventCast is a practical, production-ready forecasting framework that substantially improves e‑commerce demand prediction in non-stationary, event-driven periods by using a frozen LLM only to reason about future events (campaigns, holidays, incentives) and convert unstructured operational records into human-interpretable textual summaries. Fusing those summaries with historical multivariate time-series in a dual-tower architecture yields large accuracy gains (up to 86.9% MAE and 97.7% MSE improvements vs. the same model without event knowledge; up to 57.0% MAE and 83.3% MSE improvements vs. the best industrial baseline during event-driven periods). The system is modular, interpretable, and has been deployed in production across multiple countries since March 2025.

Key Points

• Core idea: decouple semantic reasoning (LLM) from numerical prediction (lightweight forecaster). The LLM interprets future unstructured business data and emits structured textual summaries; a compact forecasting model consumes those summaries plus historical features.
• LLM role: frozen (not fine-tuned) and used solely to reason and produce textual summaries that capture cultural nuance, overlapping campaigns, and combinations of novel events. Reasoning traces are logged for auditability.
• Event Database: uses existing operational records (campaign calendars, holiday schedules, seller incentives) — no new bespoke KB required.
• Architecture: dual-tower design — one tower encodes historical multivariate time-series via a Transformer-style encoder; the other maps LLM textual summaries into learnable token/positional embeddings. An alignment layer fuses the two and passes fused features to two forecasting heads (trend and event).
• Practical design choices: avoids heavy LLM embeddings or fine-tuning; textual outputs are parsed into semicolon-delimited fields and tokenized into learnable embeddings, enabling fast adaptation and component swap-in (e.g., different LLMs).
• Interpretability & maintainability: human-readable summaries let operators trace forecast drivers; modular components simplify updates and reduce manual feature-engineering burden.

Data & Methods

• Deployment & evaluation scope: real-world deployment covering 4 countries, 160 regions, over a 10-month period; system running in production since March 2025.
• Inputs:
  • Historical multivariate time-series (e.g., GMV, order volume, categorical/numeric features).
  • Unstructured business event data (campaign calendars, holidays, incentive rules) from internal operational databases.
• LLM prompting:
  • Parameterized templates combine database entries and target date queries (day of week, in-event day, promotion intensity, free-shipping rules, logistics blackout).
  • LLM asked to reason step-by-step and emit a final structured summary within tags (e.g., ...) for reliable parsing.
  • Leveraged world knowledge for cultural nuance (e.g., Ramadan vs. Eid behavior) and robustness to noisy/unstructured text.
• Model architecture:
  • Historical encoding: treat each feature’s time series as a token (transpose), feed to multi-head self-attention encoder to capture cross-variate dependencies; project to aligned embedding dimension.
  • Textual features: LLM text parsed, tokenized, converted into learnable token and positional embeddings; an alignment layer maps these into the same representation space.
  • Fusion: dual-tower fusion preserves explicit future-event signals rather than letting them be diluted in historical latent representations.
  • Forecast heads: trend forecasting head + event forecasting head, outputs combined to predict demand.
• Training and baselines:
  • Compared to variant without event knowledge and to industry baselines; evaluated on MAE and MSE, with focused analysis on event-driven periods.
  • Avoided LLM fine-tuning or embedding extraction — all LLM output used as plain text input for the model.

Implications for AI Economics

• Improved operational efficiency: substantially better forecasts during promotions and holidays can reduce stockouts, overstock, last-minute expedited shipments, and inefficient labor scheduling. While the paper reports prediction-error reductions (MAE/MSE), these translate in practice to lower inventory holding costs and fewer lost sales — improving bottom-line supply-chain economics.
• Better decision-making & adoption: human-readable event summaries increase trust from non-technical operators (warehouse managers, planners), enabling forecasts to be operationalized rather than overridden. Explainability lowers organizational friction for automated decision pipelines.
• Reduced feature-engineering & maintenance costs: using LLM reasoning to convert messy operational text into standardized summaries reduces brittle rule-based parsers and the need to manually enumerate event feature interactions across markets — lowering engineering and maintenance overhead as promotions or rules evolve.
• Scalable cross-market generalization: one prompt template parameterized by country/time-zone can generalize to different cultural contexts via LLM world knowledge, reducing per-market customization costs in multinational platforms.
• Cost–benefit trade-offs: EventCast sidesteps heavy LLM inference during prediction by using LLM only to produce text summaries; this reduces compute and cost compared to fine-tuning or embedding-based LLM pipelines. However, running LLM reasoning at scale still incurs operational costs and requires governance (prompt/version management, audit of reasoning traces to guard against LLM errors/hallucinations).
• Research & policy avenues:
  • Extension to other economic forecasting domains (retail, logistics, event-driven macro indicators) where structured event records exist.
  • Need for systematic evaluation of LLM reasoning reliability and bias across cultures/events; auditing mechanisms and fallback rules are important.
  • Opportunities to quantify downstream economic impact (inventory cost savings, service-level improvements) by mapping forecast-error reductions to operational KPIs.
• Practical recommendations for practitioners:
  • Maintain and curate an expert event database (even if unstructured); logging reasoning traces aids audits.
  • Use frozen LLM outputs as interpretable inputs to compact predictors to balance performance and cost.
  • Monitor LLM reasoning quality and establish governance for prompt updates, especially when new promotion types or country-specific customs appear.

Limitations to note (for deployment/interpretation): - EventCast depends on the quality and completeness of the event database and on the LLM’s ability to reason reliably about ambiguous inputs; hallucinations or incorrect inferences could harm forecasts unless audited. - The approach improves event-driven forecasting specifically; regular-period gains are less emphasized. - Economic impact (monetary savings) is not directly quantified in the paper — mapping statistical improvements to dollar outcomes requires additional operational modeling.