0 cumulative citations
View corpus contextDigital personas of FOMC members, trained on 24,000 public statements and conditioned on current macro data, produce a committee-level index that tracks the 2022–2025 rate cycle (Kendall’s τ≈0.68) and predicts meeting outcomes with 0.69 accuracy versus a 0.47 base rate, leading the federal funds target by roughly three quarters; the method outperforms retrieval- and corpus-average baselines but rests on a small, institution-specific sample and model/prompt choices.
A Persona-based Rate Action Index
Personas built from 24k attributed FOMC statements—using retrieval-augmented generative models and market-conditioned queries—produce member-level stance vectors that aggregate into an index tracking and modestly leading federal funds rate actions and outperform retrieval-only baselines.
Citation observations
Cumulative provider counts captured on specific dates; providers are never combined.
We propose an index for predicting the U.S.\ Federal Open Market Committee (FOMC) decision to hike/hold/cut the current federal funds target rate based on how a collection of personas responds to current market conditions. To construct the index, we collected a new dataset consisting of nearly $25{,}000$ retrievable chunks from publicly available data. We partition the data into per-member corpora and use each as the retrieval database of a generative system we refer to throughout as a ``persona''. We first evaluate the personas across two complementary components of likeness: identifiability and detectability. Each persona's behavior is highly attributable (average member-conditional recall is $ 8\times $ chance) and generated content is nearly indistinguishable from held-out real content ($\hatτ_{\mathrm{det}} = 0.23$ against a $0.15$ floor). We then present evidence that query-conditioned representations of the personas capture members' monetary-policy stance relative to a known hawk--dove reputational ordering (Kendall's $τ= 0.63$, $p < 0.001$), substantially outperforming retrieval-only representations. These representations vary with time and current market conditions and form the basis of our proposed persona-based rate action index. For the $2022$--$2025$ period the index tracks the rate cycle (Kendall's $τ= 0.68$, $p < 10^{-6}$) and can be used to construct a simple classifier that predicts per-meeting outcomes at non-trivial accuracy ($0.69$ versus a $0.47$ base rate). Importantly, the index outperforms informative baselines and leads the federal funds target rate by roughly three quarters. As far as we are aware, our results are the first to demonstrate the ability to capture time-varying group behavior via a collection of digital personas.
Summary
Main Finding
The authors build and validate a collection of per-member generative “personas” for FOMC participants and show these personas can (i) reproduce member-specific language (high likeness) and (ii) generate time- and market-conditioned stance estimates that track and anticipate committee rate-action. A persona-based rate-action index (PBI) constructed from these outputs (2022–2025) tracks the fed funds rate cycle well (Kendall’s τ = 0.68, p < 10−6), yields a simple per‑meeting classifier with 0.69 accuracy (vs. a 0.47 base rate), outperforms informative baselines, and “leads the federal funds target rate by roughly three quarters” (as reported).
Key Points
- New dataset: 24,333 retrievable, speaker-attributed text chunks from 2006–2026 covering 17 of 19 FOMC members (speeches, testimony, press conferences, and transcripts). Each chunk includes metadata and a 1024-d embedding.
- Persona construction: each persona = base LLM (gpt-4o-mini) + member-specific retrieval database (Di) + standardized biography in system prompt. Retrieval depth k varied from 0–5.
- Two-axis likeness evaluation:
- Identifiability (between-person attribution): mean attribution recall ≈ 0.48 at k=3 (≈8× chance; chance = 1/17 ≈ 0.059; minimum 0.30).
- Detectability (real vs generated within-person): mean ˆτdet ≈ 0.23 at k=3, vs. real–real lower bound ≈ 0.15.
- The two axes are largely uncorrelated; both are not simple functions of corpus size.
- Stance recovery (hawk–dove reputational ordering):
- Compared three per-member representations: corpus-average, retrieval-based, persona-based.
- Corpus-average and persona-based representations recover the external reputational hawk–dove ordering strongly (persona-based: Kendall’s τ ≈ 0.63, p < 0.001; peaks at τ ≈ 0.65 at k=2).
- Retrieval-only representations perform poorly.
- Useful query set size: diminishing returns beyond m ≈ 10 questions; mandate-priorities queries are most informative.
- Persona-based Rate-Action Index (PBI):
- Market-aware queries formed by prepending current economic conditions (CPI, core PCE, unemployment, current target range) to the query set; personas are conditioned on only data publicly available before the prediction time (special care around delayed transcript releases).
- On 2022–2025 data, the PBI tracks the rate cycle (Kendall’s τ = 0.68) and produces a classifier with 0.69 accuracy vs. 0.47 base rate; PBI outperforms informative baselines and reportedly leads realized federal funds moves by roughly “three quarters” (paper wording).
Data & Methods
- Corpus
- 883 source documents → 24,333 chunks (2006–2026); per-chunk schema: ⟨source, member id, time, is_voting, is_chair, topic, stance, embedding⟩.
- Topics aggregated into six themes (inflation/prices, employment, rates/policy, financial stability, growth/outlook, other).
- Embeddings: OpenAI text-embedding-3-large (1024-d).
- Public release: dataset and code announced (links in paper: GitHub and Hugging Face).
- Persona architecture
- Base model: gpt-4o-mini.
- Retrieval: cosine similarity ranking of Di embeddings; top-k stances placed in context (k ∈ {0,…,5}); k=0 is biography-only.
- System prompt includes per-member standardized biography.
- Likeness evaluation
- Identifiability: every persona answers the same curated set of m = 30 monetary-policy queries; a linear classifier is trained on response embeddings for 17-way attribution; persona is identifiable when recall > chance.
- Detectability: seeded-completion protocol—hold out 40 real stances per member (≥8 words), reveal opening words, have persona complete them, then train a classifier to separate real vs. generated; report τdet = 1 − R(h*)/R(hc).
- Stance and ranking
- Build per-member vectors via: (i) corpus average, (ii) retrieval-based (mean top-k retrieved embeddings over queries), (iii) persona-based (mean embeddings of persona-generated responses).
- Project per-member vectors onto a hawk–dove direction defined by anchor hawk/dove statements; evaluate ranking with Kendall’s τ against an external reputational ordering.
- Rate-action index
- Time-varying query set Q(t) = {c(t) + q1, …, c(t) + qm}, where c(t) is a short summary string of current U.S. conditions pulled from FRED (CPI, core PCE, unemployment, current target).
- Personas only read Di dated ≤ t (transcripts dated to release to avoid lookahead).
- Aggregate persona stances into a committee-level index and evaluate against realized FOMC outcomes and baselines for 2022–2025.
Implications for AI Economics
- Demonstrates digital twins / persona-based generative models can capture time-varying, group-level policy stance beyond static classification tasks; retrieval-augmented generation + persona conditioning can outperform retrieval-only summaries for behavioral inference.
- Forecasting & market applications: a persona-based index that leads realized policy moves could be useful for traders, risk managers, and macro forecasters as an informational signal complementary to market-implied measures (futures) and text classification indices.
- Policy and institutional analysis: provides a new way to study heterogeneity within policy committees and how individual member stances respond to evolving economic conditions.
- Methodological takeaways:
- Per-person retrieval corpora + short biographies are an effective structure for modeling recurring public decision-makers.
- Evaluating both identifiability and detectability is essential when claiming persona fidelity.
- Conditioning queries on contemporaneous market data is a practical way to extract time-varying covariates from personas.
- Risks, limitations and caveats:
- Coverage: only 17 of 19 members, and per-member corpus sizes vary widely; some members have small public footprints.
- Dependence on base LLM and retrieval/embedding choices (closed‑model choices may affect reproducibility).
- Detectability > real–real floor: personas are not literally indistinguishable from real text; generated outputs may still be detectable and sensitive to prompt phrasing.
- Validation window: main rate-index validation reported for 2022–2025 — longer-term robustness, structural breaks, or regime changes require further testing.
- Ethical and governance issues: creating realistic digital personas of public officials raises questions about misuse, misattribution, and disclosure; methods should be deployed with transparency and safeguards.
- Directions for future work: extend to other central banks or policymaking bodies, integrate richer market signals and higher-frequency data, explore causal identification of the reported lead, and evaluate robustness across base model families and more extensive out-of-sample periods.
Assessment
Paper Typedescriptive
Evidence Strengthmedium — The paper provides empirical validation (likeness checks, correlation with reputational hawk–dove ordering, backtests against realized FOMC outcomes with Kendall's τ and classification accuracy improvements over baselines). However, the evidence is predictive/descriptive rather than causal, the sample is small (17 scored members / ~24k text chunks) and results depend heavily on model choice, prompt/query design, and the curated reputational ordering used for validation.
Methods Rigormedium — The authors construct a carefully attributed, time-stamped dataset, define clear metrics (identifiability, detectability), test sensitivity over retrieval depth and query set size, and backtest the index against realized decisions and baselines. Limitations include small effective N (committee-size), potential labeling/dating issues (transcript embargo handling), reliance on one primary base model and embedding, limited robustness checks reported in the excerpt, and validation that leans on reputational rankings rather than independent ground-truth continuous stance labels.
SampleNew speaker-attributed corpus of FOMC public statements (speeches, testimony, press conferences, and released transcripts) covering 17 of 19 current members, 883 documents and 24,333 retrievable chunks from 2006–2026; per-chunk attributes (source, member id, date, topic, stance, 1024-d embedding); personas built using gpt-4o-mini with retrieval of top-k relevant chunks; evaluation queries: curated set of ~30 monetary-policy questions; market-conditioning via FRED variables (CPI, core PCE, unemployment, current target).
Themesgovernance adoption
GeneralizabilitySpecific to the U.S. FOMC institutional setting — behaviors, public visibility and record length differ from other policy bodies or private firms, Requires reasonably large, public, attributed textual record per individual; will not generalize to actors without public statements, Results depend on chosen base LLM, embedding model, prompt engineering, retrieval method and query set — may change with model updates, Uses reputational ordering and backtests rather than randomized or causal identification, so predictive relationships may not hold out-of-sample or under structural shifts, Five-year transcript embargoes and dating heuristics create potential for subtle data-timing issues in other settings
Claims (9)
| Claim | Direction | Outcome | Confidence & Evidence | Details |
|---|---|---|---|---|
| The authors constructed a speaker-attributed corpus covering 17 of 19 FOMC members, containing 883 documents and 24,333 retrievable chunks spanning 2006 to 2026. Other | positive | Corpus coverage and size |
Reading fidelity
high
Study strength
medium
|
n=24333
24,333 chunks
|
| At retrieval depth k=3, the personas were identifiable by member, with mean attribution recall of 0.48 and a minimum member-level recall of 0.30, compared with a chance level of 1/17. Other | positive | Persona identifiability through member-attribution recall |
Reading fidelity
high
Study strength
medium
|
n=17
mean recall 0.48; minimum 0.30; chance 1/17
|
| At retrieval depth k=3, generated persona content was relatively difficult to distinguish from held-out real member content, with average detectability of 0.23 versus a real–real lower bound of 0.15. Other | positive | Detectability of generated content relative to real member content |
Reading fidelity
high
Study strength
medium
|
n=680
average τ̂det = 0.23; real–real lower bound = 0.15
|
| The persona-based stance representation recovered the external hawk–dove reputational ordering of FOMC members with Kendall’s τ=0.63 and p<0.001. Decision Quality | positive | Recovery of members' relative monetary-policy stance ordering |
Reading fidelity
high
Study strength
medium
|
n=16
Kendall’s τ = 0.63, p < 0.001
|
| The persona-based stance representation outperformed the retrieval-only representation for recovering the hawk–dove ordering: persona-based Kendall’s τ reached 0.63, whereas retrieval-based estimates remained between 0.23 and 0.32 and were not statistically significant. Decision Quality | positive | Relative accuracy of stance-ordering recovery |
Reading fidelity
high
Study strength
medium
|
n=16
persona-based τ = 0.63 versus retrieval-based τ = 0.23–0.32
|
| The two likeness dimensions—identifiability and detectability—were not significantly correlated across members. Other | null_result | Association between persona identifiability and detectability |
Reading fidelity
high
Study strength
medium
|
n=17
Kendall τ = −0.17, not significant
|
| The persona-based rate-action index tracked the 2022–2025 federal funds rate cycle with Kendall’s τ=0.68. Decision Quality | positive | Tracking of the realized FOMC rate cycle |
Reading fidelity
high
Study strength
medium
|
Kendall’s τ = 0.68, p < 10^-6
|
| A simple classifier based on the persona-based rate-action index predicted per-meeting FOMC outcomes with accuracy of 0.69, compared with a 0.47 base rate. Decision Quality | positive | Per-meeting classification accuracy for FOMC rate decisions |
Reading fidelity
high
Study strength
medium
|
0.69 accuracy versus a 0.47 base rate
|
| The persona-based rate-action index led the federal funds target rate by approximately three quarters. Decision Quality | positive | Lead time of the index relative to the federal funds target rate |
Reading fidelity
high
Study strength
low
|
roughly three quarters
|