Evidence (272 claims)
Search and filter individual claims pulled from the papers. Looking for a specific finding ("what's the effect on wages?"), you're in the right place. Want to compare whole outcome categories against each other instead? Use the Evidence Explorer.
The board below groups claims two ways: by broad theme (nine paper-level topics) and by outcome category (the 34 claim-level outcomes that the Explorer and Syntheses also use).
Browse by theme
Nine broad, paper-level topics. Click one to filter the claims below.
Adoption
9875 claims
Filter claims →
Productivity
8807 claims
Filter claims →
Governance
7870 claims
Filter claims →
Human-AI Collaboration
7560 claims
Filter claims →
Org Design
4892 claims
Filter claims →
Innovation
4781 claims
Filter claims →
Labor Markets
4004 claims
Filter claims →
Skills & Training
3308 claims
Filter claims →
Inequality
2332 claims
Filter claims →
Claims by outcome category
Counts by direction of finding. These are the same 34 outcome categories the Explorer compares and the Syntheses are written for. A linked row has a published synthesis.
| Outcome | Positive | Negative | Mixed | Null | Total |
|---|---|---|---|---|---|
| Other | 870 | 233 | 116 | 1066 | 2363 |
| Governance & Regulation | 976 | 451 | 218 | 133 | 1809 |
| Organizational Efficiency | 949 | 224 | 144 | 88 | 1416 |
| Technology Adoption Rate | 764 | 287 | 141 | 122 | 1325 |
| Research Productivity | 501 | 152 | 74 | 362 | 1101 |
| Output Quality | 542 | 216 | 69 | 69 | 896 |
| Decision Quality | 387 | 198 | 94 | 54 | 740 |
| Firm Productivity | 513 | 67 | 101 | 27 | 714 |
| AI Safety & Ethics | 249 | 303 | 73 | 36 | 667 |
| Market Structure | 190 | 192 | 134 | 27 | 548 |
| Task Allocation | 243 | 77 | 91 | 36 | 452 |
| Innovation Output | 291 | 33 | 55 | 20 | 401 |
| Skill Acquisition | 206 | 72 | 65 | 21 | 364 |
| Employment Level | 133 | 63 | 115 | 22 | 335 |
| Fiscal & Macroeconomic | 153 | 79 | 52 | 32 | 323 |
| Task Completion Time | 206 | 37 | 12 | 15 | 272 |
| Firm Revenue | 179 | 52 | 29 | 5 | 266 |
| Consumer Welfare | 130 | 76 | 47 | 13 | 266 |
| Inequality Measures | 48 | 137 | 51 | 6 | 242 |
| Worker Satisfaction | 101 | 81 | 25 | 13 | 220 |
| Error Rate | 84 | 110 | 11 | 5 | 210 |
| Wages & Compensation | 98 | 47 | 30 | 10 | 185 |
| Regulatory Compliance | 88 | 73 | 17 | 7 | 185 |
| Automation Exposure | 66 | 64 | 33 | 16 | 182 |
| Team Performance | 105 | 29 | 30 | 11 | 176 |
| Training Effectiveness | 109 | 22 | 14 | 21 | 168 |
| Developer Productivity | 114 | 21 | 14 | 8 | 158 |
| Job Displacement | 12 | 90 | 24 | 1 | 127 |
| Hiring & Recruitment | 57 | 9 | 9 | 5 | 80 |
| Skill Obsolescence | 6 | 56 | 9 | 1 | 72 |
| Social Protection | 43 | 17 | 8 | 2 | 70 |
| Creative Output | 35 | 21 | 9 | 4 | 70 |
| Labor Share of Income | 18 | 21 | 17 | 1 | 57 |
| Worker Turnover | 15 | 16 | — | 4 | 35 |
| Industry | — | — | — | 1 | 1 |
In coding tasks, low agreeableness leads to large communication shifts that have little effect on milestone completion.
Experimental manipulation of agreeableness in LLMs on structured coding tasks; observed large changes in communication but little change in milestone completion rates. No quantitative effect sizes or sample counts given in the abstract.
Participants' IAT scores were predictive of the time they spent in human-AI collaboration.
Reported predictive relationship between individual IAT scores and measured time spent interacting with/considering resumes during human-AI collaborative screening tasks (likely from regression or correlation analyses); exact statistics and sample size not provided in the excerpt.
Frontier proprietary models achieve near-zero success under GUI-based interaction, whereas COM-based execution yields substantial immediate gains.
Experimental comparison reported in the paper on ComCADBench between GUI-based interaction by proprietary models and COM-based execution (authors report success rates and comparative performance).
The same observation is seen with the amount of changes (e.g., code churn, number of modified files) and with the efforts to merge an agentic PR (e.g., merge time and number of comments).
Reported that pre/post comparison across projects shows mixed/no consistent improvement patterns for code churn, modified files, merge time, and comment counts after instruction-file creation (analysis over 15,549 PRs in 148 projects).
Claude Code completed the pipeline in ~3.4 minutes with silent deviations from the specification, while Codex required ~16 minutes across explicit self-correcting restarts, including an unsolicited performance optimization of the matched filter inner loop.
Reported run-time measurements and qualitative behavior descriptions in paper: timing values (~3.4 min vs ~16 min) and observed behaviors (silent deviations for Claude Code; explicit restarts and an unsolicited optimization by Codex).
AI assistance can generate a deceptive productivity signature: average completion times fall because AI tools typically supply a fast first draft, yet workflow-level performance can deteriorate when a subset of AI errors escapes review and returns as costly downstream rework.
Analytical derivation and discussion based on the paper's queueing model (theoretical/model-based evidence; no empirical sample provided).
Across 78 endpoints, the same model on different endpoints differs in tail latency by an order of magnitude.
Empirical tail-latency measurements across 78 endpoints serving 12 model families.
Provisioned Throughput delivers the lowest latency at low concurrency but saturates its reserved capacity above approximately 20 concurrent users.
Empirical measurements from the instrumented system across concurrency up to 50 users and tier comparisons; the paper reports the observed saturation point near ~20 concurrent users.
Wall-clock time can be reduced to O(√E) through team parallelism, but total human effort remains O(E).
Model-derived result showing parallelism across humans can speed wall-clock completion time while aggregate human effort does not drop asymptotically.
For knowledge-intensive workers whose intellectual capital spans tens of thousands of files, the CAD constitutes a qualitative threshold in AI usefulness: below it, the cognitive burden of context curation falls on the human, reproducing the inefficiencies AI is meant to eliminate.
Theoretical argument grounded in the paper's conceptual discussion about large personal/organizational corpora (stated scale: tens of thousands of files) and the user burden of manual context attachment.
Human interfaces define throughput limits in areas such as prompt engineering, data-stream curation, adjudication of model outputs, and the orchestration of hybrid automation workflows including robotics, scraping, and digitization.
Theoretical assertion supported by the paper's systems-oriented analysis and literature synthesis (no empirical measurement or sample size provided).
Current machine learning models commonly require large and well-annotated datasets, and the annotation process often becomes a bottleneck with increased complexity leading to higher chances of human errors.
Background statement in the paper summarizing common knowledge and prior literature about dataset requirements and annotation challenges.
Reconstructing this context can consume an estimated 5,000-20,000 tokens per session.
Statement in paper abstract presenting an estimate (no detailed method or sample described in the abstract).
Extensive experiments across frontier models and agentic systems reveal that even the best-performing configuration (Mini-SWE-Agent with Claude Opus 4.7) achieves only a 68.3% success rate on AARRI-Bench.
Empirical evaluation reported in the paper: experiments across multiple models/agentic systems; the excerpt reports the top configuration and its success rate. The excerpt does not state the number of tasks or sample size.
Strict matter completion stalls (does not improve) despite stronger models.
Harvey LAB empirical results (12,510 agent trajectories) report that while per-criterion accuracy increases, strict matter completion does not show corresponding improvement.
Even frontier agents remain far from completing matters in a single pass.
Results reported from the Harvey LAB empirical study (12,510 agent trajectories) comparing end-to-end matter completion across agent runs.
Human-only teams take longer to complete the escape room than mixed human–AI teams.
Reported comparison of time-to-complete between human-only and mixed teams in the experiment; specific times or statistical tests are not provided in the abstract.
Cellular research and development (R&D) is throttled by six structural processes that each consume months of manual engineering work per iteration: (i) synthesizing new features from standards or research papers into production code; (ii) conformance and interoperability testing; (iii) hardening against field anomalies and diverse deployment environments; (iv) data-driven optimization of network functionalities; (v) discovering and prototyping novel waveforms, functionalities, and capabilities for future standards; and (vi) securing the stack against vulnerabilities.
Author assertion in the paper (qualitative analysis / domain expertise). No empirical sample size or quantitative study reported in the abstract.
Mean-based metrics (e.g., tasks completed per worker-hour or mean handle time) can misrepresent AI's effects in workflows where tasks accumulate and compete for scarce human attention.
Argument and analysis presented in the paper; theoretical reasoning and illustrative queueing model (no empirical sample reported).
There is a 'speedup illusion' where people have accurate forecasts of independent completion times but significantly underestimate AI-assisted times.
Empirical pattern reported in the abstract: comparison of predicted vs. actual times shows accurate independent forecasts but underestimation of AI-assisted completion times (preregistered study, N = 1237).
More persuasive narratives may have had a detrimental effect on decision response times.
Exploratory analyses reported in the paper indicating persuasive narratives were associated with longer decision response times.
However, models remain limited in long-horizon reliability and domain-specific planning.
Evaluation results and analysis in paper highlighting failures in maintaining reliability over long-horizon tasks and in planning for domain-specific workflows.
Extensive evaluations reveal that existing agents achieve only 36.0% task success on realistic media editing tasks.
Empirical evaluation reported in paper measuring task success rates of existing GUI agents on the Cutverse benchmark (benchmark size: 186 tasks across 7 apps implied).
Frontier agents struggle with end-to-end completion despite partial progress.
Evaluation experiments reported in the paper showing frontier (state-of-the-art) agents achieving partial progress but failing to reliably complete end-to-end tasks in the OpenComputer benchmark.
AI coding assistants expand the volume of code requiring review, turning code review into a growing bottleneck.
Authors' analytical claim linking increased code production from AI assistants to increased review workload; presented as an observed/trend claim in the paper rather than supported by a quantified study in the abstract.
AI deployment reduces average chat duration.
Randomized field experiment on Alibaba's Taobao platform: workers in treatment supervised an agentic AI resolving AI-eligible chats while handling AI-ineligible chats; control workers resolved all chats without AI. Effect observed on average chat duration in experiment data.
This overthinking behavior significantly increases inference latency and energy consumption, forming a potential vector for denial-of-service (DoS)-style resource exhaustion.
Authors assert increased latency and energy consumption as consequences of longer reasoning traces; framed as a potential attack vector in the abstract (no quantitative latency/energy measurements provided in abstract).
Large reasoning models (LRMs) exhibit a tendency to "overthink", producing excessively long and redundant reasoning traces when confronted with incomplete or logically inconsistent inputs.
Empirical observation reported by the authors based on experiments described in the paper (abstract references experiments across multiple SOTA reasoning models); no numerical sample size for inputs reported in abstract.
Participants using LLMs had significantly shorter idea-generation periods (p=0.0004).
Within-subject comparison between LLM-assisted and unassisted conditions reported in paper; p-value reported as p=0.0004. Sample size N=20.
Breaking down user stories into actionable tasks is a critical yet time-consuming process in agile software development.
Background/introductory statement in the paper describing the problem motivation; no experimental sample size reported for this claim.
Telemetry across 10,000+ developers shows 91% longer code review times.
Observational telemetry data aggregated across >10,000 developers reported in the paper; metric reported is percent increase in review time.
There is a persistent female disadvantage in work intensity.
Analysis of EWCTS 2021 with IFR robot exposure measures using weighted logit models controlling for individual and job covariates and fixed effects; gender-specific patterns examined via interaction terms.
Standard PayGo degrades substantially under classroom-scale concurrency.
Empirical latency measurements and comparative analysis across throughput tiers and concurrency levels in the instrumented deployment.
Each student query triggers several concurrent API calls whose latencies compound through a parallel-phase maximum effect that single-agent systems do not face.
Architectural description and instrumentation of the four-agent ITAS system (paper reports measurements and latency analysis across tiers and concurrency levels).
Current AI agent frameworks have made remarkable progress in automating individual tasks, yet all existing systems serve a single user.
Statement in paper's introduction/positioning; conceptual survey-style claim (no empirical study or systematic benchmark reported).
In an observational study of documented interactions across four AI tools (Claude, ChatGPT, Cowork, Codex), incomplete context was associated with 72% of iteration cycles.
Observational study reported in the paper covering interactions across four AI tools; the paper reports the 72% figure.
People are more likely to give up after interacting with AI (increased likelihood of quitting tasks unassisted).
Randomized controlled trials (N = 1,222) measuring rates of task abandonment/giving-up after AI interaction vs. control.
Resolution margin: the probability that posted queries are resolved declines because AI raises contributors' outside options, thinning the contributor pool and creating congestion on the platform.
Mechanism and comparative-static implication produced by the paper's theoretical model; no empirical sample provided in the excerpt.
Real estate pro forma development remains one of the most time-intensive functions in property investment, typically requiring twenty to forty hours per multifamily project through manual research, Excel-based modeling, and iterative scenario analysis.
Statement in paper asserting typical industry practice; not tied to the paper's controlled test. No empirical sample size or survey data reported alongside this assertion.
Reliance on massive, schema-heavy prompts results in prohibitive per-token API costs and high latency, hindering scalable production deployment.
Introductory problem statement in the paper arguing that large context prompts increase per-token API costs and latency for API-based LLMs; no quantitative study or sample size provided for this claim within the excerpt.
Using C.A.P. entails trade-offs: potential increases in latency and compute cost and a risk of over-correction (unnecessary clarification).
Paper explicitly notes these trade-offs as part of the design discussion and proposes measuring latency, compute cost, and unnecessary clarification rate in evaluations; this is an acknowledged design risk rather than an empirically quantified result.
On-Premise RAG incurs higher latency compared with cloud RAG.
Technology evaluations included measured system latency comparisons between architectures; exact latency values and statistical details not provided in summary.
Integration cost: AI-generated outputs often require human revision, testing, and manual integration into existing systems.
Reported practitioner experience and observed practices from the field study at Netlight; authors note time and effort spent on revision and integration; no quantitative time-cost estimates provided.
We conducted a small-scale randomized experiment to measure uplift from human-agent collaboration on real-world computational reproducibility tasks.
Randomized experiment described in the paper (authors report it was small-scale; details in methods section).
The divergence between mean task speed and system-level delay caused by AI assistance is labeled the 'variance wedge'.
Definition/terminology introduced in the paper as part of its conceptual framing; supported by the analytic model description.
LLM guidance did not increase the total number of victims saved (no increase in total victims saved relative to baseline).
Same experimental comparison (two LLM-guided conditions vs no-LLM) in the simulated SAR environment; behavioral measure of total victims saved reported.
Larger-scale GPU workload results are projections calibrated from published benchmarks.
Paper states that larger GPU results are not directly measured but are projections calibrated using published benchmarks; no calibration dataset size given in the excerpt.
AI-assisted feedback does not reduce time per character (i.e., it does not increase time cost per unit of feedback).
Time-per-character was measured in the randomized field experiment; authors report no reduction (no increase in time per character) associated with the AI-assisted drafts. Student-level/completion-level data from the experiment (n=88); 11 TAs.
The paper evaluates the proposed architecture using the outcome metric 'time-to-insight'.
Methodological statement in the paper listing evaluation metrics.
The paper evaluates the proposed architecture using the outcome metric 'time-to-find'.
Methodological statement in the paper listing evaluation metrics.