The Commonplace
Home Papers Evidence Explore Trends Syntheses Digests References Docs 🎲 Workforce Futures
← Papers
Direction, evidence grade, and study type are AI-generated labels (gpt-5-mini), not human-verified. Syntheses are LLM-written. "Tensions" are machine-detected candidates, not confirmed contradictions. A research-acceleration tool, not peer review. How this is built →

Simple, black-box manipulations of inputs and prompts can reliably hijack multi-agent LLM trading systems' decisions; compromising the terminal risk-management role nearly guarantees control of final actions across tested architectures.

Poisoning Agentic Alpha: Adversarial Vulnerabilities Across Roles and Architectures in Multi-Agent Trading Systems
CheolWon Na, Hao Ni, Lukasz Szpruch, Zhangyang Wang, Dhagash Mehta, Saurabh Nagrecha, Alejandro Lopez-Lira, Chanyeol Choi, Yongjae Lee, Jee-Hyong Lee · August 25, 2026
arxiv descriptive medium evidence 7/10 relevance Full text usable extracted full text Source PDF

Structured author observations

Linked only from stored provider relations; the raw author line above is never matched by name.

Arxiv

Latest observation:

  1. CheolWon Na unresolved corpus identity
  2. Hao Ni unresolved corpus identity
  3. Lukasz Szpruch unresolved corpus identity
  4. Zhangyang Wang unresolved corpus identity
  5. Dhagash Mehta unresolved corpus identity
  6. Saurabh Nagrecha unresolved corpus identity
  7. Alejandro Lopez-Lira unresolved corpus identity
  8. Chanyeol Choi unresolved corpus identity
  9. Yongjae Lee unresolved corpus identity
  10. Jee-Hyong Lee unresolved corpus identity

Semantic Scholar

Latest observation:

  1. CheolWon Na provider ID
  2. Hao Ni provider ID
  3. Lukasz Szpruch provider ID
  4. Zhangyang Wang provider ID
  5. Dhagash Mehta provider ID
  6. Saurabh Nagrecha provider ID
  7. Alejandro Lopez-Lira provider ID
  8. Chanyeol Choi provider ID
  9. Yongjae Lee provider ID
  10. Jee-Hyong Lee provider ID
In black-box backtests of LLM-based multi-agent trading pipelines across multiple assets and architectures, low-cost role-specific attacks frequently survive inter-agent communication and flip trading decisions, with jailbreaks of terminal risk-manager agents being the most effective.

Citation observations

Cumulative provider counts captured on specific dates; providers are never combined.

LLM-based multi-agent trading systems, in which specialized agents collaborate through structured communication to produce trading decisions, are moving rapidly from research prototypes to live deployments that control real assets. The same inter-agent communication that makes them effective also exposes them: a corrupted signal can propagate to the final decision and translate into realized financial loss. Unlike prior attacks that presume privileged access to system internals, we restrict the adversary to what is practically reachable---the source data and prompts agents consume---yielding a low-barrier, and thus democratized threat model instantiated as role-specific adversaries. We present the first systematic empirical study in the financial domain to characterize how an adversarial signal enters a multi-agent trading system and how far it survives toward the decision. Along the role axis, we decompose a widely-used trading pipeline into four functional roles---Analyst, Researcher, Trader, and Risk Manager---and pair each with an attack matched to its interface. Along the structural axis, we evaluate four communication topologies under data- and agent-level attacks, using the Adversarial Signal Preservation Score (APS) as a post-hoc lens on why some designs are more robust than others. We conduct experiments across five assets, two backbones, and two target directions. A central finding is that no architecture is inherently robust. These findings provide insights for the future design of safer and more robust agentic trading systems.

Summary

Main Finding

Multi-agent LLM trading pipelines are vulnerable to low-cost, black‑box attacks that manipulate only the data sources or prompt inputs. Adversarial signals frequently survive inter-agent deliberation and aggregation; no single communication architecture is intrinsically robust. In this setting, compromising a terminal safety/decision role (the Risk Manager) or using persuasive attacker agents produces the highest attack success and most reliable financial impact.

Key Points

  • Threat model: a pragmatic black‑box adversary that can only (1) alter external source data (news, social posts) or (2) change prompt-level inputs to agents. No access to models, weights, tools, or orchestration.
  • Role-specific attacks studied:
    • Data poisoning (Analyst/news): rewrite a fraction of news items to invert sentiment.
    • Indirect prompt injection (Analyst/social): hide adversarial directives in otherwise legitimate social posts.
    • Persuasive adversary (Researcher): substitute a debating researcher with one using persuasive prompts (FOMO, appeals to authority).
    • Objective hijacking (Trader): replace the trader’s objective prompt to invert behavior.
    • Jailbreaking (Risk Manager): prepend jailbreak prompts to bypass safety constraints.
  • Measured attack success with Attack Success Rate (ASR): fraction of days where the clean system’s decision could be flipped and the attack actually flips it to the adversary’s target (BUY/SELL).
  • Empirical ASR (pooled over 5 assets):
    • Jailbreaking (Risk Manager): ~97–99% (highest)
    • Persuasive adversary (Researcher): ~42–53%
    • Indirect injection (Social Analyst): ~24–30%
    • Data poisoning (News Analyst): ~19–22%
    • Objective hijacking (Trader): ~14–18% (lowest)
  • Communication topologies evaluated: centralized (mean aggregation), linear (cumulative aggregation), hybrid (revision + mean), decentralized (majority voting). To interpret robustness they propose the Adversarial Signal Preservation Score (APS):
    • APS ordering observed: centralized = 1.00 (most preserving of adversarial signal), linear ≈ 0.50, hybrid ≈ 0.33, decentralized = 0.00 (least preserving).
    • Intuition: averaging-style aggregation preserves injected adversarial bias across steps; voting/majority rules can discard minority adversarial inputs.
  • Additional patterns:
    • Compromising a terminal decision/safety node (Risk Manager) is effectively a single point of failure because it bypasses upstream validation.
    • Attack effectiveness depends strongly on asset and directional prior (the system’s baseline BUY/SELL tendency). Some attack directions are easier to flip.
    • Higher injection/poison ratios tend to increase ASR, but asset heterogeneity matters.
  • Financial impact (signed expected value per attempted decision):
    • Persuasive and jailbreak attacks produced negative EVs (losses) on average (examples: Persuasive ≈ −$60, Jailbreaking ≈ −$43 per attempt in the reported long-only backtest), though per-success payouts varied by attack and asset.
  • Experimental scope: five assets (BTC-USD, MSFT, NVDA, TSLA, AAPL), 61 trading days (Q1 2026), two model families (GPT and Qwen), backtests restricted to post-cutoff data to avoid lookahead bias. Code and data released.

Data & Methods

  • System modeled: multi-agent trading pipeline with four functional roles—Analyst (market/social/news), Research (bull vs bear debate), Trader (risk‑profiled decision agents), Risk Manager (constraints/enforcement). For architecture experiments, analysts simplified to three: Market (M), Social (S), News (N).
  • Threat model: adversary may modify external data sets and prompts only. No white‑box access to model internals or infrastructure.
  • Attacks:
    • Data-level: data poisoning (LLM-rewrites of selected news items toward target sentiment), indirect prompt injection (embedding instructions in social posts).
    • Agent-level: persuasive researcher (replace benign researcher with adversarial prompt‑tuned agent), objective hijack (swap trader prompt), jailbreak (prepend jailbreak prompt to Risk Manager).
  • Aggregation topologies tested: centralized (mean of analyst outputs), linear (cumulative aggregation through chain), hybrid (revision + mean), decentralized (independent analyst votes + majority).
  • Evaluation metrics:
    • ASR as defined above (targets both BUY and SELL and excludes days already equal to target under clean system).
    • Adversarial Signal Preservation Score (APS): analytical lens quantifying how much an adversarial signal survives aggregation and successive reasoning steps (closed-form values derived for each topology under study).
    • Financial backtest: daily decisions applied to a long-only portfolio; compute signed EV per attempted decision and per successful attack day.
  • Models/backbones: gpt-4.1 (and gpt-4.1-mini for analyst roles) and Qwen family (large and smaller variants for different roles). Temperature=0. Data and experiment code available at the paper’s GitHub.

Implications for AI Economics

  • Systemic risk and market manipulation:
    • Low-barrier attacks that only manipulate publicly consumable inputs can materially change trading agent decisions and produce realized losses. This democratizes the capability to manipulate algorithmic trading pipelines and raises systemic market-manipulation risk.
    • Multi-agent LLM deployments controlling capital create new contagion channels: adversarial narratives or coordinated prompt injections across social/news sources can cascade through agent communication and move prices.
  • Design recommendations for safer deployments:
    • Avoid a single terminal safety/decision authority: separate decision execution from final safety enforcement; require independent cross-checks or multi-signature approval for trades.
    • Prefer aggregation rules that reduce adversarial signal preservation: majority voting or heterogenous independent evaluators can discard minority poisoned inputs better than naïve averaging. Introduce diversity in models, data sources, and aggregation rules.
    • Harden input pipelines: provenance, source reputation, automated fact/consistency checks, rate-limited ingestion from untrusted forums, and adversarial-content detectors for social/news feeds.
    • Layered defenses: prompt sanitation, input validation, adversarial training/robustness testing, red‑teaming specifically at the inter-agent communication level, and monitoring of APS-like metrics to detect unusually preserved signal patterns.
    • Operational controls: transaction thresholds, human-in-the-loop checks for sizable or unusual actions, audit logs and replayable traces for incident forensics.
  • Policy and market-structure implications:
    • Regulators and exchanges may need to require operational standards for agentic trading systems: provenance requirements for data feeds, minimum safety separation between monitoring and execution, reporting obligations for incidents and near-misses.
    • Liability and insurance: the ease of black‑box attacks increases counterparty and firm-level operational risk; insurers and risk managers should incorporate adversarial-threat scenarios into underwriting and capital reserves.
  • Research priorities for AI economics:
    • Quantify market‑level externalities: how localized adversarial manipulations of agentic trading systems can propagate price shocks, liquidity effects, and cross-asset contagion.
    • Develop principled aggregation mechanisms and provable robustness guarantees for multi-agent decision pipelines.
    • Create standardized stress-testing benchmarks and certification regimes for agentic financial systems that evaluate role-specific and topology-specific adversarial scenarios.

If you want, I can: - Extract the paper’s APS derivations and present the closed-form equations and intuition step-by-step. - Produce a checklist for defenders (engineering and policy) tailored to asset managers planning agentic trading deployments.

Assessment

Paper Typedescriptive Evidence Strengthmedium — The paper runs systematic, repeatable experiments across multiple assets, two model families, and several architectures with clear metrics (ASR, signed EV), and provides code/data; however, evidence is based on simulated/backtest experiments (no field deployment or real-money testing), limited asset/time window, specific prompt/backbone choices, and attack generation choices that may not fully reflect real adversaries or production systems. Methods Rigormedium — Design strengths include a clear threat model (black-box, source/prompts-only), multiple assets/backbones/topologies, post-cutoff data to limit lookahead, statistical tests for comparisons, and public code. Limitations: short time window and limited asset mix, dependence on particular LLM prompts and poisoning ratios, simulation (no market impact/slippage), and limited sensitivity/robustness checks to alternative prompt strategies and operational deployment configurations. SampleBacktested daily trading decisions over 2026 Q1 (Jan 1–Mar 31), five instruments (BTC-USD, MSFT, NVDA, TSLA, AAPL), yielding 61 trading days (305 asset-day observations per architecture). Inputs: historical prices (Alpha Vantage, yfinance), news articles, and Reddit social posts. Models/backbones: gpt-4.1 and Qwen variants (analyst roles use smaller variants), temperature=0. Attacks: role-specific data- and agent-level manipulations (data poisoning, indirect prompt injection, persuasive adversary, objective hijacking, jailbreaking). Key outcome metrics: Attack Success Rate (ASR) and signed expected-value change in capital under a long-only backtest. Themesgovernance org_design IdentificationControlled black-box experiments: the authors compare system decisions under clean vs attacked inputs using a pre-specified Attack Success Rate (ASR) that counts days where an attack flips the clean decision to the adversary's target; experiments run in backtested daily decision setting on post-cutoff data to avoid lookahead bias. No econometric causal identification beyond these within-system counterfactual comparisons. GeneralizabilitySimulated/backtest setting — not a deployed live trading environment; market impact, slippage, and real order execution risk not modeled, Limited asset set (large-cap US equities + BTC) and short time window (2026 Q1), may not generalize to other assets, regimes, or longer horizons, Results depend on particular LLM backbones and prompt engineering; model updates or different LLMs could change vulnerability profiles, Attack instantiations (e.g., LLM-rewritten poisoned articles, chosen poison ratios, jailbreak prompts) are specific choices that may not reflect all real-world adversaries, Assumes access to the same data streams (news/Reddit); different data pipelines, provenance checks, or enterprise controls would alter outcomes

Claims (11)

ClaimDirectionOutcomeConfidence & EvidenceDetails
No evaluated communication architecture is inherently robust to adversarial signals. Ai Safety And Ethics negative Adversarial signal survival and attack vulnerability across multi-agent trading architectures
Reading fidelity high
Study strength medium
n=305
0.18
Risk-manager jailbreaking achieved a 98.9% attack success rate on BUY-targeted attackable days. Ai Safety And Ethics negative Attack success rate in steering the final trading decision
Reading fidelity high
Study strength high
n=183
98.9%
0.3
Risk-manager jailbreaking was substantially more effective than the other tested attacks, with the paper describing it as 1.9 times the effectiveness of the next most effective attack. Ai Safety And Ethics negative Relative attack success rate by compromised role
Reading fidelity high
Study strength high
n=408
1.9×
0.3
The persuasive-adversary attack against the Researcher had the highest macro-average attack success rate among the non-terminal attack scenarios, at 50.6%. Ai Safety And Ethics negative Attack success rate of persuasive manipulation of the research debate
Reading fidelity high
Study strength medium
n=305
50.6%
0.18
Objective hijacking of the Trader had the lowest macro-average attack success rate among the reported role-specific scenarios, at 25.4%. Ai Safety And Ethics negative Attack success rate after replacing the Trader's objective
Reading fidelity high
Study strength medium
n=305
25.4%
0.18
Attack success did not increase monotonically with an attack's position or depth in the trading pipeline. Ai Safety And Ethics mixed Relationship between pipeline position and attack success rate
Reading fidelity high
Study strength medium
n=305
0.18
For non-persuasive attacks, BUY-targeted attacks were less effective than SELL-targeted attacks: data poisoning was lower by 2.7 percentage points, objective hijacking by 5.8 points, and indirect injection by 4.2 points. Ai Safety And Ethics mixed Attack success rate by target direction
Reading fidelity high
Study strength medium
n=816
−2.7, −5.8, and −4.2 percentage points
0.18
The persuasive attack showed the opposite directional pattern: it had a 53.3% ASR for BUY-targeting versus 41.9% for SELL-targeting. Ai Safety And Ethics mixed Persuasive-adversary attack success rate by target direction
Reading fidelity high
Study strength high
n=408
53.3% BUY-targeted versus 41.9% SELL-targeted
0.3
The system's bullish prior was associated with BUY being the clean prediction on 40.0% of days, compared with 26.2% for SELL. Decision Quality mixed Baseline distribution of clean BUY and SELL trading decisions
Reading fidelity high
Study strength medium
n=305
40.0% BUY versus 26.2% SELL
0.18
Increasing the poisoned-data ratio generally increased BUY-targeted attack success rate, from 19.1% at 10% poisoning to 28.4% at 40% and 30.6% at 80%, although the effect varied widely across assets. Ai Safety And Ethics positive Attack success rate as a function of poisoned-data ratio
Reading fidelity high
Study strength medium
n=305
19.1% to 28.4% to 30.6%
0.18
In the long-only portfolio financial-impact analysis, the persuasive-adversary attack produced the most negative expected value per attempted decision, at −$60. Consumer Welfare negative Mean signed change in final capital per attempted trading decision
Reading fidelity high
Study strength medium
n=305
−$60/attempt
0.18

Notes