Autonomous language-model research agents discover tradable signals: a crypto factor pool achieves IC ≈0.19 and an equity model outperforms a GRU (IC 0.0843 vs 0.0613), producing a held-out long/short strategy with Sharpe up to 2.50 and walk-forward ≈2.0.

Main Finding

AQuA demonstrates that two separate, sandboxed language-model-driven research systems can implement bounded recursive self-improvement in quantitative-investment research: (1) a manager-mediated multi-agent factor-discovery system that accumulates validated evidence and reaches a combined information coefficient (IC) ≈ 0.190 on a crypto universe; and (2) a config-driven autonomous model-development loop that attains a per-stock IC = +0.0843 on US equities (vs. +0.0613 for a GRU baseline; +0.0230 absolute, +37.5% relative improvement) and yields a threshold long/short strategy with held-out Sharpe up to +2.50 (two-leg cost 2 bps) that is positive in every year 2021–2025 (walk-forward Sharpe ≈ +2.0).

Key Points

• Two separate systems:
  • Part I — Factor discovery: manager-mediated multi-agent pipeline (Data Steward → Visual Analyst → Idea Miner → Factor Evaluator → Backtest Engineer → Research Librarian). Produces formulaic factors expressed in a restricted operator DSL and aggregates surviving signals into a combined factor.
  • Part II — Model development: config-driven loop emitting single config diffs in a DSL that composes registered architecture blocks (conv stems, multi-resolution stacks, state-space mixers, attention, cross-entity mixers, etc.). Each config compiles to one variant, trained and scored in a sealed evaluator.
• Sealed sandbox design:
  • Data splits, feature/label definitions, and evaluator are fixed and human-authored prior to any autonomous iteration.
  • Agents cannot alter the data path; they may only emit constrained DSL artifacts (factor expressions or config diffs).
  • Search uses a fixed validation slice for ranking; final test window is untouched during search (Part II test period 2021–2025).
• Causality-by-construction (Part I): operator registry composed of raw fields and time-series / cross-sectional operators ensures any assembled factor is causal.
• Persistent research state per part:
  • Each system stores validated experiment records, beliefs, and policy that guide future proposals (recursive self-improvement applies to the research process, not model weights or evaluator).
• Evaluation and robustness checks:
  • Factors/models are validated on held-out splits, tested for regime dependence, compared to baselines, turnover and complexity examined, and direction calibrated via backtests.
  • Walk-forward (causal) evaluation retained strong performance (strategy Sharpe ~+2.0).
• Main empirical results:
  • Part I combined factor IC ≈ 0.190 (crypto universe).
  • Part II per-stock IC = +0.0843 on US equities; trading strategy Sharpe up to +2.50 with two-leg cost 2 bps; positive annually 2021–2025.

Data & Methods

• Sealed sandbox S = (D, F, L, V):
  • D: pre-defined train/validation/test splits (test window withheld).
  • F/L: frozen feature and label definitions (causal features).
  • V: sealed evaluator reporting held-out IC, R^2, and Sharpe (with configurable cost and walk-forward mode).
• Part I (Factor discovery):
  • Registry O: formulaic-alpha operators (raw fields: open/high/low/close/volume/vwap/returns; cross-sectional ops: rank, z-score; time-series ops: lag, difference, rolling correlations, rolling rank/std, linear-decay weighting; arithmetic/conditionals).
  • Proposal discipline: each candidate begins as a falsifiable hypothesis (mechanism, expected direction, refutation criteria), then assembled into an expression tree from O.
  • Pipeline agents produce event profiling, candidate generation, evaluation (IC across horizons, monthly stability, regime tests), backtest conversion to quantile portfolios, and persistent storage of evidence and beliefs.
  • Cross-run memory: Research Librarian stores structured run records and belief updates; Manager uses these to steer later searches.
• Part II (Model development):
  • Agent emits a single config diff: selects frozen split, sampler, architecture blocks, loss(s), optimizer settings (examples in paper: per-entity z normalization with train-only stats, history length 64, sampler stratified_minute batch 8192, losses [spearman_ic, huber_csz, turnover_reg], optim AdamW lr=3e-4, bf16, ddp).
  • Architecture registry composes primitives: convolutional stems (multi-scale), multi-resolution stacks (temporal conv + state-space mixers for fine, attention for coarse), repeated blocks with cross-entity mixers, readout gates/pooling.
  • Every config compiles to one comparable model variant; training/evaluation occurs in sealed harness; only validation scores on pre-specified slice are returned to agent; final test scores computed once on withheld window.
• Metrics and checks:
  • Information coefficient (IC) used as core predictive metric.
  • Additional diagnostics: R^2, turnover, complexity, correlation with existing pool, event vs control comparisons, monthly stability, and regime sensitivity.
• Practical safeguards:
  • Separation between the metric used for internal selection (validation slice) and final reported metric (untouched test) to mitigate adaptive overfitting.
  • Manager-mediated handoffs and run-level auditable records for reproducibility.

Implications for AI Economics

• Acceleration of quantitative research: Autonomous, recursively improving research loops can compress the time to discover and validate factors/models, increasing the pace at which new signals are generated and tested.
• Productivity and labor impacts: Such systems may reduce routine research engineering work and shift human roles toward higher-level problem formulation, sandbox design, and oversight—potentially changing skills demanded in quant research teams.
• Market dynamics and alpha decay:
  • Faster, automated discovery could accelerate alpha discovery and decay cycles, increasing short-lived strategies and competition among firms using similar automation.
  • Aggregation of many autonomous systems could compress cross-sectional mispricings more rapidly, affecting market efficiency dynamics and crowding risks.
• Safety, reproducibility, and standards:
  • The sealed-sandbox pattern is a concrete engineering practice to mitigate leakage and adaptive overfitting in automated research. This suggests an industry need for audited sandboxes, sealed evaluators, and shared best practices for autonomous model testing.
  • Manager-mediated audit trails and explicit hypothesis framing (mechanism + falsification conditions) improve interpretability and reproducibility—important for compliance and risk controls.
• Limits and cautionary notes:
  • The paper’s recursive improvement is bounded to the research process (it does not update underlying LMs or evaluators); wider autonomy (e.g., self-updating models) would raise additional economic, safety, and regulatory issues.
  • DSL and registry constraints reduce leakage risk but may limit the agent’s creativity or miss classes of useful constructs outside the registry.
  • Empirical generalizability remains to be tested across more asset classes, broader markets, and live trading; undisclosed factors and the proprietary nature of datasets constrain external replication.
• Policy and governance:
  • Regulators and market operators may need to consider standards for automated alpha-research systems (e.g., disclosure, stress testing, model governance) to manage systemic risks from synchronized automated strategies.
  • Infrastructure for independent audit and walk-forward evaluation standards would help verify claimed out-of-sample performance.
• Research agenda:
  • Evaluate interactions among multiple independent autonomous research agents (market-level effects).
  • Explore hybrid systems that safely allow shared learning while preserving auditability.
  • Develop benchmarks and open protocols for sealed-sandbox evaluations to foster transparent comparison and best-practice diffusion.

Overall, AQuA is a practical demonstration that constrained, sandboxed agentic loops can produce repeatable, out-of-sample predictive signals while reducing classic leakage risks—an approach with clear productivity benefits for quantitative research but important economic, systemic, and governance implications as such tools scale.