Frontier AI agents handle the engineering of research but not the research itself: in two shadow evaluations on unpublished NeurIPS submissions, agents completed coding and experiments yet produced work the original authors unambiguously rejected as not meeting the bar for novel, publishable AI research.

Main Finding

Frontier agentic models (Opus 4.8; robustness check with GPT-5.6 Sol + Codex) can perform the engineering and mechanics of ML research (code, experiments, writing), but they fail to produce substantive, publishable, open-ended AI research. Two shadow evaluations—each giving an agent six days, a VM, GPU access, and ~$3,000 in API credits to answer an unpublished NeurIPS research question—ended with both agent-generated papers unambiguously rejected by the original authors. The agents repeatedly failed on judgment, creativity, and high-level research reasoning even though they completed engineering tasks autonomously.

Key Points

• New evaluation method: "shadow evaluations" — give an agent an unpublished paper’s core research question (authors are the reviewers), so tasks are open-ended, uncontaminated, and assessed by domain experts who solved the same question.
• Two test cases: a paper on LLM personas (Personas) and a paper on distribution-shift detection for tabular foundation models (TabPFN).
• Resources provided: 6 days wall-clock time, $3,000 Anthropic API credits, GPU credits, full VM, web access, subagents, and external AI-review tools (Stanford Agentic Reviewer, CMU Paper Reviewer, refine.ink).
• Outcome summary (authors’ review scores): both submissions rejected; scores were low on quality/clarity/significance (see paper’s Table 1); reviewers were confident in their assessments.
• Five recurring failure modes identified:
• Poor judgment about what constitutes publishable research (e.g., underpowered experiments, overstated conclusions).
• Uncreative responses to flawed research design (adding caveats rather than redesigning experiments).
• Ineffective backtracking from dead ends (ambitious targets retired early, no fundamental strategy shifts).
• Poor resource and timeline awareness (agents underused budgets, mismanaged time).
• Instruction drift (ignored explicit constraints like paper length, review cadence).
• Agents did run experiments, create datasets, and write drafts, but produced shallow or underpowered empirical work and did not engage the literature or reasoning to the depth required for top-tier publication.
• Robustness check: repeating one case with GPT-5.6 Sol + Codex and the model’s native scaffold reproduced nearly all failure modes, suggesting results are not scaffold-specific.
• Artifacts released for transparency (reviews, logs, agent repos): https://cruxevals.com
• Limitations: small sample (2 papers), non-blinded review (authors knew the work was AI-generated), choice of scaffolds/parameters may affect generalizability.

Data & Methods

• Experimental design: two unpublished NeurIPS 2026 submissions selected with authors’ cooperation. Agents were tasked to answer the same central research questions without access to the authors’ final papers.
• Agents & scaffolds:
  • Primary runs: Claude Opus 4.8 with extra-high reasoning on the OpenClaw scaffold; subagents and tool integrations enabled.
  • Robustness run: GPT-5.6 Sol + Codex with native scaffold on one paper.
• Resources: six days of wall-clock time per run, ~$3,000 API credits per run, GPU credits, Linux VM with internet access, monitoring of remaining time and spend.
• Support tooling: AI self-review subagent (reads final PDF + review template), external reviewer tools (Stanford Agentic Reviewer, CMU Paper Reviewer, refine.ink); running logs and delegation traces captured.
• Outcome measurement: original paper authors graded the agent-produced manuscripts as if reviewing for a top-tier conference (evaluating quality, clarity, significance, originality, and overall decision).
• Reproducibility: run logs, agent code, reviews, and survey responses released at cruxevals.com. Authors plan expanded experiments with later models (GPT-5.6 Sol, Opus 5, Fable 5).

Implications for AI Economics

• Forecasts depending on rapid automation of open-ended AI R&D should be tempered. Current frontier agents can automate substantial engineering work (experiments, coding, drafting) but not the high-level, creative, judgment-intensive components that drive novel scientific contributions.
• Economic impact will likely be heterogeneous across R&D tasks:
  • Near-term productivity gains: automation of routine engineering and experiment execution (lower marginal cost of running experiments, faster iteration on implementation details).
  • Limited substitution for high-level research labor: conceptual hypothesis generation, designing robust experiments, strategic backtracking, and evaluative judgment remain human-complementary. Senior researchers and idea generators retain high value.
• Returns to scale and R&D diffusion: automation of engineering may increase aggregate experimental throughput but may not translate to proportionate increases in frontier innovation or breakthroughs. This constrains models of recursive self-improvement that assume agents will autonomously produce sustained leaps in capabilities.
• Labor-market effects: increased demand for roles that supervise, curate, evaluate, and translate agent outputs (meta-researchers, evaluators, reviewers). Possible displacement for research-engineering tasks (experiment runners, data curators), but less near-term displacement for roles requiring deep judgment.
• Investment and policy signals:
  • Investors and labs should distinguish automation of research engineering (cost and time savings) from automation of discovery (transformative productivity). Valuation and strategy should reflect that distinction.
  • Policymakers modeling AI-driven growth should incorporate limits on autonomous open-ended discovery and consider monitoring systems (such as shadow evaluations) as signals of research automation capability.
• Measurement/forecasting recommendation: incorporate shadow evaluations into capability tracking alongside verifiable benchmarks and blind-review tests. Shadow evaluations provide a targeted, expert-graded measure of agents’ ability to carry out open-ended R&D tasks that many economic forecasting exercises assume will soon be automatable.

If you want, I can: (a) extract the numerical reviewer scores and resource usage details into a compact table for quick reference, or (b) draft language you could use to adjust a model of AI-driven productivity to reflect these findings.