LLM-extracted structured event features improve cross-sectional stock return forecasts, with a novel SER-attention model outperforming existing text-driven approaches. The approach also yields interpretable event structures that help explain the sources of predictability.

Main Finding

Structured event representations (SERs) extracted by large language models (LLMs) — where each news article is converted into subject–action–object triplets (with canonical entity links) — substantially improve cross-sectional stock return predictability relative to standard text approaches (sentiment scores and document embeddings). A SER-based attention model delivers economically meaningful out-of-sample gains (high Sharpe ratios and a positive Fama–French five-factor alpha) and yields highly interpretable, event-level attributions that map news to returns and to firm comovement.

Key Points

• Core idea: Use LLMs not as opaque embedding machines but as controllable extractors to produce structured, human-readable event triplets (subject, action, object, plus context and canonical links).
• Prompt engineering + in-context exemplars + LLM-based validation are used to enforce a JSON triplet format and reduce hallucination.
• Entity linking (DBpedia URLs) standardizes surface variants and enables aggregating the same real-world entity across articles.
• Model architecture: stock-specific representation × event representations, attention over multiple events to weight their importance, aggregated event vector passed to an MLP trained with MSE to predict stock returns.
• Empirical performance (U.S. stocks, newspaper full-text):
  • Daily predictions: annualized return 10.93%, Sharpe ratio 0.78.
  • Weekly predictions: annualized return 5.23%, Sharpe ratio 0.63.
  • Positive and significant Fama–French five-factor α — predictive gains not explained by standard risk premia.
  • Outperforms sentiment-based and semantic-embedding (BERT/FinBERT) benchmarks across tests.
• Interpretability:
  • Gradient-based attribution quantifies each event/entity’s marginal contribution to predicted returns, enabling ranking of drivers (earnings, policy, capital flows, corporate actions).
  • Shows heterogeneity of informativeness across events, entities, and horizons (daily vs weekly drivers differ).
• Connected-stocks / comovement: firms that share exposure to high-importance entities exhibit stronger return comovement around events tied to that entity; comovement strength scales with entity importance.
• Practical design choices: post-extraction validation, re-generation and discarding heuristics to limit noisy/hallucinated events.

Data & Methods

• Data
  • Source: Full-text newspaper articles covering U.S. firms (details and exact newspapers likely in the paper’s data section).
  • Target: Cross-sectional return prediction at daily and weekly horizons for U.S. stocks.
• Event extraction pipeline
  • LLM prompts force JSON outputs with fields: subject, subject_link (DBpedia), action, object, object_link (DBpedia), context (location/metadata).
  • Use of in-context examples to guide format and content.
  • Entity linking via DBpedia canonical URLs to unify surface variants.
  • Post-processing validator implemented with an LLM “judge” to check conformity and semantic consistency; failing outputs are regenerated up to a limit or dropped.
  • Implementation reported using commercial GPT-series APIs.
• Model architecture
  • Stock-specific representation encodes firm-level features relevant to returns.
  • Each article → multiple SER triplets → embedded into event vectors.
  • Attention mechanism assigns dynamic weights across concurrent events to capture heterogeneous informativeness.
  • Aggregated event representation interacts with stock representation and is fed to a multi-layer perceptron (MLP) predicting stock returns.
  • Loss: mean squared error (MSE).
• Evaluation
  • Out-of-sample prediction and portfolio-sorting exercises.
  • Benchmarks: sentiment-score models, document-embedding models (BERT/FinBERT), and likely simple baselines.
  • Metrics: annualized return, Sharpe ratio, Fama–French five-factor alpha, Fama–MacBeth regressions for cross-sectional predictability, and comovement statistics for entity-based linkages.
• Interpretability & diagnostics
  • Gradient-based attribution to compute marginal contributions of events/entities to predicted returns.
  • Topic/role grouping of events to compare horizon-specific drivers.
  • Entity importance grouping to test for induced comovement.

Implications for AI Economics

• Methodological implication: LLMs are more valuable as structured-information extractors than black-box embedding providers for economic prediction tasks. Controllable prompt design + canonical entity linking yields inputs that are both predictive and economically interpretable.
• Transparency and attribution: SERs make it feasible to connect model signals to concrete economic mechanisms (earnings, policy, M&A, flows), improving trust, auditability, and the capacity for economic interpretation — important for both research and regulated deployment.
• Asset pricing and market microstructure:
  • Event-level signals enable richer tests of information diffusion, news-driven comovement, and connected-stocks hypotheses by explicitly tracing which entities/events link firms.
  • The model’s positive risk-adjusted returns suggest text-extracted event information can capture predictable cross-sectional variation not explained by standard factor models.
• Policy and market-design: Tools that produce interpretable event-level attributions can help regulators and market participants monitor information channels, detect concentrated informational impacts, and assess market responses to firm- or entity-specific shocks.
• Practical deployment considerations:
  • Reproducibility and cost: reliance on commercial LLM APIs raises issues of cost, model-versioning, and reproducibility; open models/standardized prompts and knowledge graphs can mitigate this.
  • Hallucination and coverage risks: validation steps and canonical linking are necessary but imperfect; coverage of DBpedia and other knowledge bases may limit entity mapping in niche domains.
• Directions for future research:
  • Extend SER approach to other asset classes, geographies, and languages; compare alternative knowledge graphs and entity-linking methods.
  • Combine SERs with causal identification strategies to move from prediction to causal inference about news impacts.
  • Explore end-to-end LLM forecasting vs structured-extraction + downstream model tradeoffs in finance.
  • Assess market-impact, liquidity, and strategic behavior arising from event-driven trading signals.