← Papers

A hybrid forecasting tool that reads the news spots impending Bolivian roadblocks better than statistical inertia alone, raising one‑day AUC‑ROC to 0.677 and cutting Brier score by 10.9%; the NLP-enhanced model delivers statistically significant gains out to seven days, offering a practical risk-management aid for logistics and transport planning.

From Seasonality to Semantics: Benchmarking a Hybrid Probabilistic Forecasting System for Roadblocks in Bolivia

Rodrigo Vargas Sainz, Christian Berón Curti · July 23, 2026

arxiv descriptive medium evidence 7/10 relevance Full text usable extracted full text Source PDF

Structured author observations

Linked only from stored provider relations; the raw author line above is never matched by name.

Arxiv

Latest observation: July 27, 2026

Rodrigo Vargas Sainz unresolved corpus identity
Christian Berón Curti unresolved corpus identity

Semantic Scholar

Latest observation: August 25, 2026

Rodrigo Vargas Sainz provider ID
Christian Berón Curti provider ID

Integrating semantic signals from six years of Bolivian news into a Prophet time-series model improves short-term prediction of roadblocks versus purely statistical baselines (H+1 AUC‑ROC 0.677; 10.9% Brier score reduction).

Citation observations

Cumulative provider counts captured on specific dates; providers are never combined.

0 cumulative citations

Semantic Scholar · Observed August 25, 2026

View corpus context

Roadblocks in Bolivia are a social conflict phenomenon with devastating economic impacts, estimated at losses equivalent to 4% of the national Gross Domestic Product. Despite their recurrence and impact, there is a lack of local predictive systems to anticipate these events for logistical decision-making. This paper presents a hybrid probabilistic forecasting system that integrates time series decomposition (Prophet) with natural language processing (NLP) techniques applied to a six-year corpus of Bolivian news coverage. The methodology employs vector semantic embeddings and zero-shot classification models to capture signals of discursive escalation prior to the materialization of the roadblocks. Using an expanding walk-forward validation scheme applied over 1,762 days and seven forecasting horizons (H+1 to H+7), seven internal configurations and four external benchmarks were compared, including SARIMA and LightGBM. The results demonstrate that the hybrid configuration (Prophet + NLP, C6) consistently outperforms purely statistical models, achieving an AUC-ROC of 0.677 at H+1 and reducing the Brier Score by 10.9% relative to the baseline temporal model (0.220 vs. 0.247), maintaining a statistically significant error reduction across all evaluated horizons ($p < 0.02$). This research validates that the integration of semantic news signals allows for the detection of social tension peaks not captured by historical inertia, providing a technical tool for risk management in critical transport corridors.

Summary

Main Finding

A hybrid probabilistic forecasting system that combines temporal decomposition (Prophet) with semantic news signals (dense sentence embeddings + zero-shot classification) improves the prediction and calibration of national-level roadblock risk in Bolivia. The best parsimonious configuration (Prophet + NLP, called C6) achieves an AUC-ROC of 0.677 at H+1 and reduces the Brier Score by 10.9% relative to a temporal-only baseline (0.220 vs. 0.247). The improvement is statistically significant across evaluated horizons (p < 0.02).

Key Points

Problem and stakes
- Roadblocks in Bolivia are recurrent and economically large (est. losses ≈ 4% of monthly GDP when prolonged).
- There was no local predictive system for anticipating these events for logistics and risk management.
Data
- Raw news archive: 916,110 headlines (2008–2026). Analysis period (2020–2026) used 386,884 filtered articles across 2,137 days (≈181 relevant items/day).
- Target labels: official Administradora Boliviana de Carreteras (ABC) records filtered to social-conflict disruptions on six strategic corridors; aggregated to national daily binary outcome (roadblock/no roadblock).
Feature extraction (text)
- Zero-shot relevance classification: mDeBERTa-v3-base-mnli-xnli producing a continuous road-relevance score and discrete escalation level (four levels).
- Sentiment: RoBERTuito via pysentimiento (polarity per headline).
- Semantic embeddings: paraphrase-multilingual-MiniLM-L12-v2 (384 dimensions). PCA to 10 dims was evaluated but discarded due to loss of discriminative power.
- Daily aggregation: weighted average of embeddings using zero-shot relevance as weight (with small residual weights for explicitly irrelevant or missing classifications). Additional daily features: volume, 3-/7-day MA, delta, z-score, avg relevance, max escalation.
Temporal component
- Prophet fitted with weekly and annual seasonality. At each walk-forward step Prophet produced in-sample fits (used as predictors) and out-of-sample projections for H+1..H+7.
Experimental design
- Seven ablation configurations (C1–C7) trained with a calibrated XGBoost classifier (Platt scaling via CalibratedClassifierCV). Uniform XGBoost hyperparameters: max depth 3, lr 0.1, 50 trees, colsample_bytree 0.3, subsample 0.8; dynamic positive class weight per training window.
  - C1: Pure Prophet (temporal only).
  - C2: Volume only.
  - C3: Pure NLP (embeddings only).
  - C4: Volume + Zero-Shot + NLP.
  - C5: Prophet + Zero-Shot.
  - C6: Prophet + NLP (volume + full embeddings).
  - C7: Total Hybrid (temporal + volume + zero-shot + semantics).
- Four external benchmarks evaluated under the same expanding walk-forward scheme:
  - B1: Regularized logistic regression (C=0.01).
  - B2: LightGBM (100 trees, depth 3, lr 0.05).
  - B3: Univariate SARIMA (1,1,1)×(1,1,1,7), refit every step.
  - B4: XGBoost including autoregressive lags (1,2,3,7).
- Validation: expanding walk-forward over 1,762 out-of-sample days (Aug 15, 2021 – Jun 11, 2026); predictions generated for horizons H+1..H+7.
- Metrics: discrimination (AUC-ROC), calibration (Brier Score, Brier Skill Score), classification metrics (precision, recall, F1, log loss), calibration curves; statistical tests: Diebold–Mariano with Newey–West correction and Cohen’s d on squared-error differentials. Model interpretability via SHAP (embeddings grouped).
Main quantitative results
- C6 (Prophet + NLP) vs C1 (Pure Prophet):
  - H+1 AUC-ROC (C6): 0.677.
  - Brier Score reduced from 0.247 (baseline temporal) to 0.220 (C6) → 10.9% relative improvement.
  - Error reductions remain statistically significant across horizons (p < 0.02).
- Temporal component matters: configurations including Prophet (C1, C5, C6, C7) consistently outperform non-temporal ones (C2, C3, C4).
- C6 ≈ C7 in performance; explicit zero-shot score in C7 is largely redundant because it was already used as aggregation weight in C6, making C6 the more parsimonious choice.
- Benchmarks show mixed results by horizon and metric (e.g., univariate SARIMA performed strongly in AUC at H+1 in the reported excerpt), but the hybrid approach yields consistent calibration and probabilistic gains.

Data & Methods

Data sources and aggregation
- News: national news-aggregator archive; headline-level timestamps, links, tags. The analysis window focuses on 2020–2026 articles with thematic filtering.
- Label: ABC official roadblock records constrained to social-conflict events on six corridors; aggregated to a national binary daily target because most headlines lack specific route identifiers.
Text processing pipeline
- Remove irrelevant categories (e.g., “World”), apply zero-shot thematic filter to drop sports/entertainment/etc.
- Per-headline transforms:
  - Zero-shot classification to four escalation levels (mDeBERTa MNLl).
  - Sentiment polarity (RoBERTuito).
  - 384-d multilingual sentence embedding (MiniLM).
- Weighted daily aggregation (relevance score as weight; specified residual weights for irrelevant/missing).
Temporal modeling
- Prophet for seasonal decomposition; fitted at each walk-forward step to furnish a temporal inertia predictor for each horizon.
Learning and evaluation
- Primary learner: calibrated XGBoost (hyperparameters fixed across ablations).
- Walk-forward expanding validation that replicates real-time inference: each model trained only on data available up to t−1, then forecasts for t+1..t+7.
- Hyperparameter tuning for benchmarks conducted on a separate window to avoid selection bias.
Statistical assessment
- Pairwise Diebold–Mariano tests (Newey–West) over horizons to determine significance of forecast differences; effect sizes (Cohen’s d) reported for squared-error differentials.
- Calibration diagnostics via reliability diagrams; interpretability via grouped SHAP.

Implications for AI Economics

Practical value for logistics and risk management
- Probabilistic forecasts with improved calibration let firms and public agencies make better cost-sensitive decisions (routing, inventory pre-positioning, contingency planning).
- Detecting semantic escalation in press coverage provides lead signals for non-seasonal spikes that seasonal models miss—this reduces unexpected disruptions and associated economic losses.
Methodological: hybrid architectures for socio-political event forecasting
- Validates the schedule: use robust temporal decomposition (interpretable baseline) plus semantic residual modeling. This reduces false alarms from seasonal inertia while capturing exogenous discursive triggers.
- Demonstrates that dense multilingual embeddings + simple tree learners (XGBoost) can effectively operationalize media semantics in forecasting tasks, without requiring large end-to-end LLM retraining.
Policy and welfare considerations
- Early warnings can mitigate macroeconomic shocks from transport disruptions (avoiding supply shortages, price spikes, and health emergencies).
- Systems like this can enable targeted, proportional responses (e.g., temporary supply corridors) instead of blanket restrictions.
Limitations and economic-ethical cautions
- Data bias: reliance on press aggregator and headline text may miss grassroots or localized mobilization signals; spatial aggregation to national level hides route-specific risk.
- Political sensitivity: monitoring protest discourse has civil liberties implications; deployment should respect privacy, transparency, and non-discrimination.
- Model maintenance: concept drift (political regime changes, media behavior shifts) requires continuous retraining and recalibration. Economic value estimates depend on decision contexts and user-specific cost functions.
- Generalizability: results are specific to Bolivian press ecology and the studied time frame; transferring the pipeline to other countries requires local data and validation.
Directions for AI economics research and operational upgrades
- Incorporate additional exogenous signals (social media, mobility, commodity prices) and multimodal inputs for finer-grained and route-level forecasts.
- Explore LLM-based reasoning modules for richer event causality and to extract actor/location when headlines omit route identifiers.
- Cost-sensitive evaluation: translate probabilistic improvements into expected monetary savings under decision models (routing, inventory, emergency services) to quantify economic ROI.
- Ethical governance frameworks to balance early-warning utility with rights protections.

If you want, I can: - produce concise tables comparing C1–C7 and benchmarks across AUC and Brier Score for H+1..H+7 (if you want numeric breakdowns), - draft a short technical appendix describing the walk-forward procedure and Diebold–Mariano implementation, - sketch a decision-theoretic toy model that converts forecast improvements into expected cost savings for a logistics operator. Which would you prefer?

Assessment

Paper Typedescriptive Evidence Strengthmedium — The paper provides systematic out-of-sample evidence (expanding walk-forward validation over 1,762 days) and benchmark comparisons showing consistent predictive gains from adding semantic news signals; however, the claims are predictive (not causal), rely on a single-country dataset and media sources, and lack external (geographic/temporal) validation, which limits how strongly the results can be generalized. Methods Rigormedium — The authors use appropriate time-series practice (walk-forward validation, multiple horizons), compare against standard baselines (SARIMA, LightGBM), and report statistical significance and multiple performance metrics (AUC, Brier score). Methods are nevertheless limited by potential label noise in event definition, reliance on zero-shot NLP without detailed calibration or ablation analysis, unclear handling of class imbalance, and no validation on an independent out-of-sample country or later time period. SampleSix-year corpus of Bolivian news coverage covering 1,762 days, with roadblock events as the target; forecasting evaluated across seven horizons (H+1 to H+7) and seven internal model configurations (hybrid Prophet + NLP among them) versus four external benchmarks including SARIMA and LightGBM; reported top performance: AUC-ROC 0.677 at H+1 and a 10.9% reduction in Brier score relative to a temporal baseline. Themesproductivity governance GeneralizabilitySingle-country (Bolivia) analysis — findings may not transfer to other countries or regions, Reliance on local media coverage — performance depends on news volume, timeliness and editorial bias, Language and NLP model specifics (Spanish, zero-shot classifiers) may not generalize to other languages, Model trained on a particular historical period — social dynamics or reporting patterns could change over time, Detects discursive escalation correlated with roadblocks — may not capture other protest types or covert actions, No external geographic validation or robustness checks to alternative data sources (social media, administrative data)

Claims (9)

Claim	Direction	Outcome	Confidence & Evidence	Details
Roadblocks in Bolivia are a social conflict phenomenon with devastating economic impacts, estimated at losses equivalent to 4% of the national Gross Domestic Product. Fiscal And Macroeconomic	negative	economic losses (share of GDP)	Reading fidelity high Study strength medium	4% of the national Gross Domestic Product 0.18
There is a lack of local predictive systems to anticipate roadblocks for logistical decision-making in Bolivia. Adoption Rate	negative	presence/availability of local predictive systems	Reading fidelity high Study strength low	not reported 0.09
The paper presents a hybrid probabilistic forecasting system that integrates time series decomposition (Prophet) with NLP techniques applied to a six-year corpus of Bolivian news coverage. Other	positive	forecasting system architecture / integration of Prophet and NLP	Reading fidelity high Study strength medium	not reported 0.18
The methodology employs vector semantic embeddings and zero-shot classification models to capture signals of discursive escalation prior to the materialization of the roadblocks. Other	positive	detection of discursive escalation signals in news text	Reading fidelity high Study strength medium	not reported 0.18
The evaluation used an expanding walk-forward validation scheme applied over 1,762 days and seven forecasting horizons (H+1 to H+7), comparing seven internal configurations and four external benchmarks (including SARIMA and LightGBM). Other	null_result	evaluation protocol (walk-forward validation; number of days and horizons)	Reading fidelity high Study strength medium	n=1762 0.18
The hybrid configuration (Prophet + NLP, C6) consistently outperforms purely statistical models, achieving an AUC-ROC of 0.677 at H+1. Decision Quality	positive	AUC-ROC (discriminative performance of the forecasting model)	Reading fidelity high Study strength medium	n=1762 AUC-ROC of 0.677 at H+1 0.18
The hybrid model reduces the Brier Score by 10.9% relative to the baseline temporal model (0.220 vs. 0.247). Decision Quality	positive	Brier Score (probabilistic forecast accuracy)	Reading fidelity high Study strength medium	n=1762 10.9% reduction (0.220 vs. 0.247) 0.18
The hybrid model maintains a statistically significant error reduction across all evaluated horizons (p < 0.02). Decision Quality	positive	statistical significance of error reduction (p-value)	Reading fidelity high Study strength medium	n=1762 p < 0.02 0.18
Integration of semantic news signals allows for the detection of social tension peaks not captured by historical inertia, providing a technical tool for risk management in critical transport corridors. Decision Quality	positive	detection of social tension peaks (events) beyond what historical time series alone capture	Reading fidelity medium Study strength medium	n=1762 0.11