← Papers

Pre-trained time-series foundation models slash day-ahead ERCOT load-forecast error by up to ~47% versus a Seasonal Naive baseline and remain accurate with very short historical windows; Chronos-2 also delivers superior probabilistic calibration while other models (and Prophet) exhibit overconfidence or failure modes under limited context.

Time Series Foundation Models for Energy Load Forecasting on Consumer Hardware: A Multi-Dimensional Zero-Shot Benchmark

Luigi Simeone · February 11, 2026

arxiv descriptive medium evidence 7/10 relevance Full text usable extracted full text Source PDF

Structured author observations

Linked only from stored provider relations; the raw author line above is never matched by name.

Arxiv

Latest observation: July 30, 2026

Luigi Simeone unresolved corpus identity

Semantic Scholar

Latest observation: August 25, 2026

L. Simeone provider ID

Pre-trained time-series foundation models substantially improve day-ahead ERCOT load forecasting accuracy and robustness compared with standard statistical baselines, with some models also producing well-calibrated prediction intervals.

Citation observations

Cumulative provider counts captured on specific dates; providers are never combined.

3 cumulative citations

Semantic Scholar · Observed August 25, 2026

View corpus context

Time Series Foundation Models (TSFMs) have introduced zero-shot prediction capabilities that bypass the need for task-specific training. Whether these capabilities translate to mission-critical applications such as electricity demand forecasting--where accuracy, calibration, and robustness directly affect grid operations--remains an open question. We present a multi-dimensional benchmark evaluating four TSFMs (Chronos-Bolt, Chronos-2, Moirai-2, and TinyTimeMixer) alongside Prophet as an industry-standard baseline and two statistical references (SARIMA and Seasonal Naive), using ERCOT hourly load data from 2020 to 2024. All experiments run on consumer-grade hardware (AMD Ryzen 7, 16GB RAM, no GPU). The evaluation spans four axes: (1) context length sensitivity from 24 to 2048 hours, (2) probabilistic forecast calibration, (3) robustness under distribution shifts including COVID-19 lockdowns and Winter Storm Uri, and (4) prescriptive analytics for operational decision support. The top-performing foundation models achieve MASE values near 0.31 at long context lengths (C = 2048h, day-ahead horizon), a 47% reduction over the Seasonal Naive baseline. The inclusion of Prophet exposes a structural advantage of pre-trained models: Prophet fails when the fitting window is shorter than its seasonality period (MASE > 74 at 24-hour context), while TSFMs maintain stable accuracy even with minimal context because they recognise temporal patterns learned during pre-training rather than estimating them from scratch. Calibration varies substantially across models--Chronos-2 produces well-calibrated prediction intervals (95% empirical coverage at 90% nominal level) while both Moirai-2 and Prophet exhibit overconfidence (~70% coverage). We provide practical model selection guidelines and release the complete benchmark framework for reproducibility.

Summary

Main Finding

Time Series Foundation Models (TSFMs) provide practical, zero-shot day‑ and week‑ahead electricity load forecasts on consumer hardware and outperform fitted statistical baselines in accuracy and operational utility—provided sufficient context—while exhibiting substantial heterogeneity in probabilistic calibration. In the ERCOT hourly-load benchmark (2020–2024) run on an AMD Ryzen 7 laptop (16 GB RAM, no GPU), top TSFMs reach MASE ≈ 0.31 at long context (C = 2048 h, day‑ahead), reported by the authors as a ~47% reduction versus the Seasonal Naive baseline. Chronos-2 yields the best-calibrated intervals; Moirai-2 and Prophet are overconfident; TinyTimeMixer (TTM) shows vacuous or poor uncertainty behaviour and needs long context to be competitive.

Key Points

Scope: Zero-shot evaluation of four TSFMs (Chronos-Bolt, Chronos-2, Moirai-2, TinyTimeMixer) vs. Prophet (industry fitted baseline) and two statistical baselines (SARIMA, Seasonal Naive) on ERCOT hourly demand (Jan 2020–Dec 2024, 43,732 observations).
Hardware: All inference and evaluations performed on consumer‑grade laptop (AMD Ryzen 7 8845HS, 16 GB RAM, no GPU); model selection restricted to models that run feasibly under these constraints.
Evaluation design: 8 context lengths (24 → 2048 h), 2 forecast horizons (H = 24, 168 h), 3 test periods (Summer 2023, Winter 2022–23, COVID Mar–Apr 2020), 7 rolling windows → 2,352 forecasts.
Accuracy (point): Chronos-Bolt, Chronos-2, and Moirai-2 steadily improve with longer context (no saturation up to 2048 h). Example: Chronos-Bolt MASE falls 0.549→0.315 (C=24→2048 h); Moirai-2 drops 1.304→0.307.
Fitted-model fragility: Prophet and SARIMA fail catastrophically at short fitting windows (Prophet MASE > 74 at C=24) because they must estimate seasonal parameters from insufficient data; they only match TSFM performance after weeks of context.
Calibration (probabilistic): Chronos-2 approximates good calibration (empirical 95% coverage at nominal 90%); Moirai-2 and Prophet show overconfidence (~70% coverage at 90% nominal); TTM produces vacuous or untrustworthy uncertainty estimates.
Robustness: TSFMs maintain stable zero-shot accuracy even with limited local history; however, model behaviours vary during distribution shifts (COVID, Winter Storm Uri), and calibration can be unreliable for some models under such shifts.
Prescriptive analytics: Authors implement a framework linking probabilistic forecasts to operational decisions (demand response scheduling, reserve sizing, storage optimization) and show value from well-calibrated predictive distributions.
Reproducibility: Full benchmark framework and experiments are released.

Data & Methods

Data: ERCOT system-wide hourly demand (MW), Jan 2020–Dec 2024. Key regimes include normal operations (2022–24), COVID lockdown effects (Mar–Apr 2020, ~15–20% lower demand), and Winter Storm Uri (Feb 2021).
Models evaluated:
- TSFMs (zero-shot): Chronos-Bolt (amazon/chronos-bolt-small, ~48M params), Chronos-2 (amazon/chronos-2, ~120M), Moirai-2 (Salesforce/moirai-2.0-R-small, ~11M), TinyTimeMixer (ibm-granite r2, <1M).
- Fitted baseline: Prophet (multiplicative seasonality, interval_width=0.90), refitted per invocation.
- Statistical: SARIMA(2,1,2)(1,1,1)[24]; Seasonal Naive (repeat value 168 h prior) used to define MASE scaling.
Hardware constraints: Experiments designed and run on a single laptop CPU; excluded models that required GPU or excess memory.
Protocol: Context lengths C ∈ {24,48,96,168,336,512,1024,2048} h; horizons H ∈ {24,168} h; 3 test periods × 7 rolling windows.
Metrics:
- Point accuracy: Mean Absolute Scaled Error (MASE) with weekly period m=168.
- Distributional quality: Continuous Ranked Probability Score (CRPS).
- Calibration: Empirical coverage vs nominal quantile intervals (e.g., 90% PI).
- Interval quality: Winkler Score (penalises width and misses).
Key experimental finding examples:
- At C=24 h (day‑ahead), foundation models MASEs: Chronos-Bolt 0.549, Chronos-2 0.659, Moirai-2 1.304, TTM 5.73; Prophet and SARIMA catastrophically worse.
- At C=2048 h, foundation models MASEs converge near 0.31–0.45; Seasonal Naive MASE ~0.749 (paper reports ~47% improvement by top TSFMs).
- Chronos-2 empirical coverage ≈95% for 90% nominal intervals; Moirai-2 & Prophet ≈70% (overconfident); TTM unreliable.

Implications for AI Economics

Operational economic value of zero-shot TSFMs:
- Reduced onboarding friction: Zero-shot forecasts eliminate the need to collect long local histories and retrain per site, lowering time-to-deploy and labor/compute costs for utilities, microgrids, and distribution-level forecasting.
- Cost savings at scale: The paper cites that a 1% accuracy improvement in ERCOT-scale forecasting can translate to millions of dollars annually; TSFMs’ improved MASE suggests material financial benefit if adopted system-wide.
- Resource democratization: Demonstration on consumer hardware implies smaller utilities and research groups can access state-of-the-art forecasting without cloud/GPU expenditure, narrowing technology access inequalities.
Risk management and reserve procurement:
- Calibration matters economically: Overconfident predictive intervals (Moirai-2, Prophet) risk under-procurement of reserves, increasing exposure to costly scarcity or load-shedding events. Well‑calibrated models (Chronos-2) enable tighter, more cost‑efficient reserve sizing and storage dispatch.
- Stress events still challenging: Extreme, out‑of‑distribution events (Winter Storm Uri, COVID) require careful validation; even accurate point forecasts can misrepresent tail risk if uncertainty is miscalibrated—leading to asymmetric economic losses.
Deployment trade-offs and policy:
- Model selection guidance: For decision-critical tasks requiring reliable uncertainty (reserve planning, market bids), prefer Chronos-2 or otherwise ensure post-hoc calibration. For CPU-constrained, latency-critical deployments, Chronos-Bolt offers strong point accuracy with fast inference. TTM may suit edge deployments only when long context is available and uncertainty is not central.
- Regulatory implications: Market rules and reliability standards that rely on probabilistic forecasts should mandate calibration reporting and stress‑testing for any model used in operational procurement or bidding.
Macroeconomic and market effects:
- If broadly adopted, TSFMs could lower aggregate forecast error, tightening reserve requirements and reducing fuel/peaker usage—benefits that accrue system-wide. However, widespread adoption without calibration safeguards risks correlated underestimation during extremes, which could amplify systemic risk.
Research & investment priorities:
- Invest in calibration methods and post‑hoc recalibration pipelines tailored to TSFMs before operational rollout.
- Fund domain-specific robustness testing (extreme events, structural shifts) and light fine‑tuning strategies compatible with low-resource hardware.
- Consider incentives for open reproducibility and benchmarking across multiple ISOs to quantify transferability of zero-shot performance.

Limitations to bear in mind - Single-region (ERCOT) study—transferability to other markets with different seasonality/behavior is not guaranteed. - Evaluation limited to zero-shot inference; the incremental value of light fine‑tuning or covariate inputs (weather, calendar effects) was not explored here. - Hardware-driven model selection excluded some large models that might perform differently.

Practical takeaway - For utilities seeking low-friction, low-cost forecasting: TSFMs (especially Chronos-2 and Chronos-Bolt) are practical and effective zero-shot options on consumer hardware. Ensure calibration checks and consider post‑hoc recalibration before using probabilistic outputs for reserve procurement or market commitments.

Assessment

Paper Typedescriptive Evidence Strengthmedium — The paper provides a thorough, multi-axis empirical benchmark on real-world ERCOT hourly load data with multiple baselines and probabilistic evaluation, giving credible evidence that pre-trained TSFMs can improve forecasting accuracy and robustness; however, conclusions rely on a single regional dataset, opaque pre-training data, and zero-shot evaluation only, limiting strength for broader claims. Methods Rigorhigh — Evaluation is multi-dimensional (context length sensitivity, calibration, shift robustness, prescriptive metrics), compares against industry and statistical baselines, reports probabilistic calibration, and releases code for reproducibility — though some external validity limitations remain (single market, unspecified pre-training corpora). SampleERCOT (Texas) system-wide hourly electricity load time series from 2020 through 2024 (covering COVID-19 lockdowns and Winter Storm Uri); models evaluated: four pre-trained time-series foundation models (Chronos-Bolt, Chronos-2, Moirai-2, TinyTimeMixer), Prophet, SARIMA, and Seasonal Naive; experiments run zero-shot on consumer hardware (AMD Ryzen 7, 16GB RAM, no GPU). Themesproductivity adoption GeneralizabilitySingle-region (ERCOT) — may not generalize to other electricity markets or countries, Domain-specific (electricity load) — results may not hold for other time-series domains (finance, demand for other goods), Pre-training opacity — model behavior depends on unknown pre-training data and may vary across model families, Zero-shot focus — fine-tuning or local retraining could change relative performance, Extreme shock period in sample (COVID, Uri) both stresses models and may overrepresent rare events, Hardware constraint (no GPU) may disadvantage models requiring specialized inference stacks

Claims (10)

Claim	Direction	Outcome	Confidence & Evidence	Details
Time Series Foundation Models (TSFMs) have introduced zero-shot prediction capabilities that bypass the need for task-specific training. Other	positive	zero-shot prediction capability (ability to predict without task-specific training)	Reading fidelity high Study strength medium	not reported 0.18
We present a multi-dimensional benchmark evaluating four TSFMs (Chronos-Bolt, Chronos-2, Moirai-2, and TinyTimeMixer) alongside Prophet as an industry-standard baseline and two statistical references (SARIMA and Seasonal Naive), using ERCOT hourly load data from 2020 to 2024. Other	null_result	benchmark composition (models evaluated and dataset used)	Reading fidelity high Study strength high	not reported 0.3
All experiments run on consumer-grade hardware (AMD Ryzen 7, 16GB RAM, no GPU). Other	null_result	computational resource requirement (hardware used)	Reading fidelity high Study strength high	not reported 0.3
The evaluation spans four axes: (1) context length sensitivity from 24 to 2048 hours, (2) probabilistic forecast calibration, (3) robustness under distribution shifts including COVID-19 lockdowns and Winter Storm Uri, and (4) prescriptive analytics for operational decision support. Other	null_result	evaluation design (axes and scenarios)	Reading fidelity high Study strength high	not reported 0.3
The top-performing foundation models achieve MASE values near 0.31 at long context lengths (C = 2048h, day-ahead horizon), a 47% reduction over the Seasonal Naive baseline. Error Rate	positive	MASE (Mean Absolute Scaled Error) at day-ahead horizon with 2048h context	Reading fidelity high Study strength high	MASE values near 0.31 at long context lengths (C = 2048h, day-ahead horizon), a 47% reduction over the Seasonal Naive baseline. 0.3
Prophet fails when the fitting window is shorter than its seasonality period (MASE > 74 at 24-hour context). Error Rate	negative	MASE at 24-hour context for Prophet	Reading fidelity high Study strength high	MASE > 74 at 24-hour context 0.3
TSFMs maintain stable accuracy even with minimal context because they recognise temporal patterns learned during pre-training rather than estimating them from scratch. Error Rate	positive	forecast accuracy stability under minimal context	Reading fidelity medium Study strength medium	not reported 0.11
Chronos-2 produces well-calibrated prediction intervals (95% empirical coverage at 90% nominal level). Output Quality	positive	empirical coverage of 90% nominal prediction intervals for Chronos-2	Reading fidelity high Study strength high	95% empirical coverage at 90% nominal level 0.3
Both Moirai-2 and Prophet exhibit overconfidence in their probabilistic forecasts (~70% empirical coverage for 90% nominal intervals). Output Quality	negative	empirical coverage of 90% nominal prediction intervals for Moirai-2 and Prophet	Reading fidelity high Study strength high	~70% coverage (for 90% nominal intervals) 0.3
The paper provides practical model selection guidelines and releases the complete benchmark framework for reproducibility. Other	positive	availability of model selection guidelines and released benchmark framework	Reading fidelity high Study strength high	not reported 0.3