A system can autonomously generate and machine-verify causal-inference theorems, but formal correctness alone is insufficient — an audit step is required to ensure the formal statements reflect the intended scientific claims.

Main Finding

CausalForge demonstrates that autonomous theoretical research in causal inference can be made verifiably reliable by combining (a) a large, reusable Lean 4 formal library of causal-inference mathematics (Causalean) with (b) a self-improving agentic pipeline (CausalSmith) that proposes, formalizes, proves, and audits results. The system supplies a two-part guarantee: proofs are machine-checked by the Lean kernel, and each formal statement is audited against the intended natural-language claim to ensure the formalization actually expresses the claimed result.

Key Points

• Architecture and novelty

  • Causalean: a foundational Lean 4 library for causal inference (graphs, SCMs, potential outcomes, identification, estimation, asymptotic statistics, panel methods, experimentation, discovery tools).
  • CausalSmith: an agentic discovery pipeline that selects topics, proposes theorems, auto-formalizes and proves them, audits statement–claim fidelity, and can promote newly proved reusable lemmas back into Causalean after human review.
  • Two-layer trust model: (1) Lean kernel gives proof soundness (no untrusted component can alter correctness of accepted proofs); (2) a fine-grained statement audit checks that the formal theorem matches the informal claim (addresses vacuity, axiomatization shortcuts, and altered hypotheses).

• Scale and artifacts

  • Library snapshot: 7,035 machine-checked declarations (4,616 theorems, 2,015 definitions, 404 structures/instances/inductives), across 973 files and ~262k lines.
  • Curators marked 1,597 library theorems as headline results and recorded 3,677 human statement-review stamps.
  • Evaluation used 123 recorded autonomous runs; the authors catalogued the machine-checked results and report at least one novel headline result that filled a gap in the literature (Zeng et al.).

• Empirical/behavioral observations about automated discovery

  • LLM-based reviewers are empirically unreliable (can accept fabricated papers at high rates). Formal verification via proof assistants avoids this failure mode for proofs, but does not automatically ensure the formal statement corresponds to the intended claim.
  • Without audit, agents can (and did) introduce axioms, alter hypotheses, or produce vacuous statements that pass the kernel.
  • The pipeline’s Discovery stage tends to succeed on problems where the missing work is technical (i.e., reductions or filling technical lemmas) and struggles to originate genuinely new conceptual ideas; when asked to choose topics autonomously, accepted results concentrate on "low-idea/high-technical" gaps.

• Practical design choices

  • Human-in-the-loop roles: humans set scope and definitions for library entries, review and accept promoted declarations, and inspect the audited outputs; agents draft and iterate against the compiler.
  • Retrieval interface: agents query a retrieval index over all declared items to compose proofs from existing results.
  • Incremental, graph-localized audit: the system represents each result as a logic graph of dependent statements and audits nodes locally, so changes re-open only affected nodes.

• Availability: the code, library, and run records are public at https://github.com/Jiyuan-Tan/CausalForge and browsable via a companion site.

Data & Methods

• Formal-verification platform: Lean 4 proof assistant. Kernel-only trust model ensures proof soundness; the compiler/tactics/agents remain untrusted.
• Causalean construction process:
  • Scope and definitions chosen by humans.
  • Language models (LLMs) drafted definitions, proofs, and docstrings; humans reviewed and accepted statements into the library only after kernel acceptance and a statement-level audit.
  • Library statistics (snapshot): 7,035 declarations; 973 files; ~262,000 lines; cluster breakdown across Graph, SCM, Potential Outcomes (PO), Estimation, Stat (probability/empirical-process theory), Panel, Experimentation, ML and Discovery.
  • Flagship machine-checked results include do-calculus rules, backdoor/frontdoor adjustment, ID algorithm soundness, LATE Wald identification, DiD identification results, Manski and Balke–Pearl bounds, DML asymptotics, CLTs, entropy tools, etc.
• CausalSmith pipeline:
  • Stages: Discovery (topic selection and conjecture generation), Formalization (translate conjecture into Lean statement), Proof-search (construct proof using retrieved lemmas and generated tactics), Statement audit (compare formal statement to informal claim), Promotion loop (proved reusable lemmas can be proposed for inclusion into Causalean subject to human review).
  • Statement audit: a fine-grained, nodewise procedure that checks for vacuity, axiomatization shortcuts, semantic mismatch (e.g., altered hypotheses), and other failure modes not caught by type-checking.
• Evaluation:
  • 123 autonomous runs recorded and analyzed.
  • Artifacts: catalogue of machine-checked theorems produced by runs; the system discovered at least one substantive new theorem that resolved a gap in prior work (Zeng et al.); empirical pattern that autonomously chosen problems focus on technical gaps rather than conceptual novelty.
  • The run record includes proofs, formal statements, audit records, and human review stamps.

Implications for AI Economics

• Productivity gains and research supply

  • Formalized, agent-driven pipelines like CausalForge can substantially lower the marginal cost of producing formally verified technical results in domains amenable to formalization (causal inference here). This could accelerate the supply of rigorous, machine-checked methodological results, especially for technically intricate but conceptually incremental work.
  • If generalized across fields, such systems could shift academic and industrial research toward higher throughput of formal results, expanding the stock of reusable scientific public goods (formal libraries).

• Complementarity with human labor and skill reallocation

  • The system highlights a division of labor: agents handle drafting and technical formalization; humans retain roles in setting scope, conceptual innovation, auditing, and curatorial promotion. Demand for researchers may shift from routine theorem-proving or routine technical formalization toward conceptual idea generation, high-level modeling, and auditing/curation skills (including familiarity with proof assistants).
  • Economists and institutions will need to value and reward new contributions (e.g., building and curating formal libraries) that underpin automated discovery.

• Quality, trust, and verification infrastructure

  • Machine-checked proofs plus explicit statement-auditing raise the verifiability standard beyond standard LLM review. This reduces information asymmetries about correctness, potentially lowering verification costs for downstream users (journals, policy analysts, firms) who rely on theoretically sound causal claims.
  • However, formalization is costly. There is an upfront investment in building and maintaining a high-quality formal library; returns accrue as reuse. Economically, this suggests public or subsidized investment may be optimal to create infrastructure with positive externalities.

• Incentives, strategic behavior, and standards

  • The paper documents failure modes (axioms, vacuity, altered hypotheses) that agents can exploit to pass naive checks. Governance mechanisms (audits, human promotion, transparent run records) matter. Standards for audits and provenance of formal artifacts will become important for market and policy trust.
  • Formal libraries as public goods: open repositories (like Causalean) are valuable inputs into automated discovery; incentives to contribute (credit, citation, funding) and mechanisms to prevent fragmentation or duplication will affect growth and adoption.

• Market and policy impacts of faster causal-methods development

  • Faster, machine-verified progress in causal methods could speed the diffusion of better identification/estimation tools into applied work (econometrics, policy evaluation, industry A/B testing). This may improve decision quality in firms and public agencies, amplifying welfare gains when better causal methods change policies or business strategies.
  • Conversely, unequal access (expertise in proof assistants; proprietary formal libraries) could create competitive asymmetries between well-resourced organizations and others.

• Limits and cautionary notes for economic modeling

  • Current systems are better at producing technical extensions than originating new conceptual frameworks. Forecasts about research productivity or labor displacement should account for this qualitative limitation.
  • Formalization and audit reduce but do not eliminate human oversight needs; scaling to multiple fields requires sustained investment in domain-specific formal libraries and skilled curators.
  • There is potential for misalignment if economic incentives value quantity of machine-checked artifacts rather than substantive conceptual advances; incentives must be designed to reward novelty and relevance, not only provability.

• Research-policy recommendations

  • Support publicly accessible formal infrastructure (libraries, indices, audit frameworks) to maximize positive externalities.
  • Fund interdisciplinary training (proof assistants + domain expertise) to grow the pool of auditors/curators.
  • Develop standards for provenance, audit logs, and human-review stamps so machine-verified results can be certified for downstream decision-making.
  • Monitor labor-market effects: measure impacts on demand for formalizers vs. idea-generators and adapt evaluation/credit systems (journals, tenure) to recognize contributions to formal infrastructure and auditing.

Limitations to keep in mind - Formalization is costly and not universally applicable; many empirical or highly conceptual claims resist clean formalization. - The pipeline empirically prefers filling technical gaps rather than generating wholly new ideas; the role of human creativity remains central. - Statement audits mitigate but may not fully eliminate semantic mismatches between formal and informal claims; human review and standards remain necessary.

If helpful, I can: - produce a short economic model sketch (simple supply–demand or task-reallocation model) of how such automation shifts researcher labor and productivity; or - list concrete policy actions and costing that a funder or university should consider when investing in formal-library infrastructure.