Production LLM trading agents move large volumes but produce no net edge: UI mechanics — not strategy text — determine behavior, driving uniform high leverage, concentrated liquidations, and weak capture of upside across two live fleets.

Main Finding

At production scale, what LLM trading agents actually do is driven far more by the operating layer (UI sliders, rendered candidate lists, order-path mechanics) than by free-text strategy; this yields volatility-blind sizing, concentrated liquidation risk, large failure to capture realized upside, and no detectable directional edge across two large, continuous deployments.

Key Points

• Scope and scale

  • Continuous six-month, population-scale record across two sibling systems:
  • DX Terminal Pro: 3,505 funded vaults, real ETH, 21 days, 7.5M model invocations, ~300K onchain actions.
  • DXAP live alpha: 500–599 user-created agents, Jun–Aug 2026, 231,638 finalized turns, 14,596 fills (5,035 real-money fills flagged).
  • All analyses use an explicit evidence-class discipline (FIRM vs PROVISIONAL), day-clustered inference, ablations, and fee restatement to a common 5.5 bps/side rate.

• Four headline (FIRM) findings

• Operating layer dominates behavior
  • Risk slider → chosen leverage: +0.425× per slider level (p ≈ 3.8×10−279).
  • Agent fixed effects explain ~60% of leverage variance.
  • Leaderboard rendering causally alters symbol selection: regression discontinuity at the top-3 cut gives a selection ratio ≈1.75× [1.49, 2.06].
• Sizing is volatility-blind
  • Across 6,400 closed DXAP positions, median leverage = 5.0× in every volatility sextile (Spearman(volatility, leverage) ≈ −0.001, p = 0.92).
  • Notional actually increases with volatility (Spearman ≈ +0.165, p ≈ 2.7×10−40), producing sharply worse realized returns in higher-volatility names and higher liquidation rates.
• Capture gap on favorable moves
  • 43.2% of positions hit ≥+300 bps favorable excursion within 24h, yet ~49.3% of those closed with negative trade returns; median capture where upside existed ≈ 2.0%.
  • A simple mechanical bracket reclaim strategy recovers ~+39.0 bps per position.

• No directional edge at fleet scale

  • DXAP fleet cumulative realized P&L (re-stated at 5.5 bps) = −$217K over the measured window.
  • DXAP roundtrip win rate ≈ 41% vs. matched Hyperliquid retail ≈ 50%; only ~15% of agents net-positive over a week vs. 53% of retail sample.
  • Paired-replay league across 416 captured production scenarios: decision quality statistically indistinguishable across frontier models at this horizon; choice stability varies by family.

• Important negative/control findings

  • Forcing the agent to compute/state liquidation distance did not reduce risky sizing; agents that stated liquidation distance liquidated more. Prompt-level exhortation failed when the dangerous parameter is a configuration constant.
  • A neural encoder reading the rendered post-order card adds a small but robust incremental signal (PROVISIONAL) for liquidation prediction beyond concrete features, but that signal appears after the order line—suggesting value for post-order checks rather than pre-commitment prevention.

Data & Methods

• Systems and telemetry

  • Two sibling production systems sharing a five-slider config and one-action-per-turn loop; different venues (Uniswap memecoin pools on Base vs Hyperliquid perpetuals) and different business designs (bounded tournament with real ETH vs open alpha with mostly paper accounts).
  • Primary stores: Athena for DX Terminal Pro inference logs + onchain reconciliation; ClickHouse analytics for DXAP (turn logs, fills with realized P&L, leverage, liquidation price, valuations at ~2.5-minute cadence, etc.).
  • Historical joins fix the template/configuration at turn time (no look-ahead attribution).

• Statistical and causal methods

  • Regression discontinuity design (RDD) on leaderboard render cut to estimate causal selection effect (rank-3 vs rank-4).
  • Linear/ordinal regressions and Spearman correlations for slider→behavior mappings (e.g., risk slider → leverage).
  • Mantel–Haenszel stratified odds ratio for liquidations concentrated in a single posture×frequency cell.
  • PR-AUC / ROC probe with day-clustered confidence intervals for a neural encoder reading rendered card anchors (pre-order vs post-order signals).
  • Paired-replay league (matched replays of 416 captured scenarios) to compare model decision quality.
  • Robustness: day-clustered uncertainty, permutation nulls, ablations, and fee-restated P&L.

• Evidence classification and transparency

  • Headline numeric claims are marked FIRM when preregistered/registered, day-clustered, and ablated; narrower or design-sensitive claims are PROVISIONAL; prior retractions are documented.

Implications for AI Economics

• Mechanism and UI design matter more than model text
  • Platform operating choices (slider semantics, leaderboard rendering, order-path mechanics) are the primary economic levers that determine agent portfolios, risk concentration, and market impact. Economists and platform designers should model agent behavior as a function of UI/marketmechanism primitives, not only as function of LLM prompts.
• Attention/leaderboard externalities and coordination risk
  • Rendered leaderboards cause large selection amplification (1.75× at the top-3 cut). Platforms that surface candidate assets create predictable herding and crowding; these attention rents are an economic externality and can amplify liquidity stress and contestable flow.
• Mispricing of risk and concentrated tail externalities
  • Volatility-blind sizing and a single configuration cell producing 62% of liquidations imply that user-configured fleets produce concentrated tail losses that are predictable and manageable via mechanism design (e.g., per-order leverage caps, volatility-normalized sizing). Absent such mechanics, losses are configuration-driven and not model-driven.
• Limits of prompt-level interventions and the role of mechanisms
  • In-context exhortation (e.g., forcing arithmetic/statement of liquidation distance) is insufficient when key levers are set outside the model’s context. Effective economic control must be implemented via mechanisms (hard caps, order path checks) rather than prompts—important for platform governance, regulatory design, and product roadmaps.
• Value capture and market efficiency
  • The large capture gap (frequent favorable excursions but little retained upside) suggests agent fleets are not extracting available informational rents; instead, execution and exit mechanics, horizon mismatch, and mechanical behavior create inefficiencies. There are opportunities for products (bracketing/execution tools, exit automation) that materially increase agent returns.
• Benchmarking, competition, and product development implications
  • Paired-replay results show that at short horizons decision quality across frontier models is similar; differentiation emerges in stability and in how models interact with operating layers. Market for "agent development" should emphasize stable decision mappings, robust order-path checks, and better exit logic rather than purely higher-capacity LLMs.
• Regulatory and market-structure considerations
  • Platforms should audit operating layers because these determine systemic behavior and tail risk. Regulators interested in market integrity should look beyond model prompts to UI and mechanism design that produce herding, concentrated risk, or misleading leaderboards.
• Research and industrial priorities
  • Short-term: focus on order-path guardrails, volatility-normalized sizing, post-order neural screening (useful as a reject/screen rule), and automation of exits (bracketing).
  • Medium-term: develop evaluation regimes that measure stability and interaction-with-UI, not just per-turn P&L; create standardized replay testbeds and population-scale metrics.
  • Long-term: study how attention-driven selection (leaderboards, renderings) creates endogenous market effects and design platforms to internalize these externalities (e.g., randomized renders, liquidity-aware highlights).

Caveats and limits - The record is large and continuous but covers two sibling systems with shared lineage and crypto venues; generalization to other asset classes or non-sibling platform designs should be done cautiously. - DXAP contains many paper accounts with engine simplifications (e.g., funding set to zero and maintenance-margin placeholder), though main P&L conclusions survive fee restatement and other robustness checks. - Some signals are PROVISIONAL (e.g., neural encoder post-order signal); operational deployment needs further validation.

Short takeaway If you want different agent economics, change the operating layer—sliders, renders, and order mechanics—not just the prompts or the underlying LLM.