The Commonplace
Home Papers Evidence Explore Trends Syntheses Digests About 🎲 Workforce Futures
← Papers
Direction, evidence grade, and study type are AI-generated labels (gpt-5-mini), not human-verified. Syntheses are LLM-written. "Tensions" are machine-detected candidates, not confirmed contradictions. A research-acceleration tool, not peer review. How this is built →

A machine-learning screening tool can modestly identify potentially disruptive AI patents before their impact appears — an AdaBoost model trained on patent metadata flags top-5% CD disruptors with 27% precision and 43% recall. The method is best used to generate candidates for expert review, not to certify future market disruption.

A CD index guided ensemble framework for screening potentially disruptive patent candidates in artificial intelligence
Hui Li, Jie Wu, Xiaodong Xie, Liu Y, T Wang · June 17, 2026 · Scientific Reports
openalex correlational medium evidence 7/10 relevance Full text usable extracted full text DOI Source PDF
Using IncoPat AI patents (2007–2021) and early patent metadata, an AdaBoost classifier can modestly flag patents that later rank in the top 5% of CD-based disruptiveness (precision 0.271, recall 0.431), making the framework useful for candidate generation rather than definitive prediction.

Disruptive technologies can reconfigure innovation trajectories and create new market opportunities, yet their early detection remains difficult because disruptive impact is uncertain and often becomes visible only years after invention. Building on the CD disruptiveness measure derived from citation-network dynamics, this study develops an interpretable machine-learning framework to screen and prioritize potentially disruptive patent candidates ex ante. Using IncoPat patent records in the artificial intelligence domain, we construct a multidimensional indicator system spanning technological, market, and legal signals. To ensure conceptual consistency with the CD framework, the main disruption label is defined as patents falling within the top 5% of the empirical CD distribution among patents with at least one backward citation. This definition allows disruptiveness to be assessed relative to identifiable prior art and reduces reliance on extreme CD values that may be sensitive to incomplete reference information. We train models on a time-split learning set covering patents filed from 2007 to 2021 and evaluate their ability to predict this stricter disruption label using early observable patent metadata. Among benchmarked classifiers, AdaBoost provides the most competitive screening performance after feature selection, reducing the feature space from 17 to 12 indicators. Under the main top-5% specification, the model achieves an accuracy of 0.914, a precision of 0.271, a recall of 0.431, and an F1 score of 0.333, indicating modest but nontrivial early-screening ability. Feature importance analysis highlights the predictive relevance of citation- and disclosure-related signals, including family citation activity, backward citations, and document length. The framework is best interpreted as a scalable candidate-generation tool for monitoring and expert review within the patented segment of AI innovation, rather than as a definitive classifier of realized disruptive impact.

Summary

Main Finding

An interpretable ensemble framework guided by the CD disruption index can modestly screen ex ante for potentially disruptive AI patents (defined as the top 5% of CD scores among patents with ≥1 backward citation) using early patent metadata. An AdaBoost classifier, after feature selection (17 → 12 features), achieves accuracy = 0.914, precision = 0.271, recall = 0.431, F1 = 0.333 on the main specification—useful for candidate generation but not definitive classification of realized disruption.

Key Points

  • Label construction: Disruptiveness is operationalized as being in the top 5% of the empirical CD distribution restricted to patents that cite at least one prior patent. This focuses the target on patents with identifiable prior art and reduces sensitivity to extreme CD values from poorly referenced patents.
  • Data scope: AI patents from the IncoPat database. Time-split design: training/learning period = patents filed 2007–2021; identification (scoring) period = 2022–2024, approximating realistic forecasting conditions.
  • Feature set: Multidimensional indicators across three domains:
    • Technological: backward citations, non-patent literature references, IPC breadth, inventor team size, document length, family citation activity.
    • Market-oriented: simple & extended family size, transfer/licensing/pledging flags, litigation, number of applicants.
    • Legal: claim counts and first-claim length (independent/dependent claims).
  • Modeling approach: Ensemble learning with adaptive boosting (AdaBoost) benchmarked against other classifiers (e.g., Random Forest). Feature selection reduced predictors from 17 to 12.
  • Best-performing model: AdaBoost with selected features; performance indicates modest predictive power—higher accuracy driven by class imbalance; precision (27.1%) implies many false positives, recall (43.1%) shows some ability to recover true disruptive cases.
  • Interpretable drivers: Citation- and disclosure-related signals are the most predictive (family citation activity, number of backward citations, document length among top features).
  • Intended use: A scalable screening/candidate-generation tool for monitoring and expert review within the patented segment of AI innovation—not a substitute for longitudinal validation or expert judgment.

Data & Methods

  • Data source: IncoPat patent records filtered to the artificial intelligence domain.
  • Label: Top 5% of CD disruption index distribution among patents with at least one backward citation.
  • Train/test split: Time-split to mimic forecasting—models trained on 2007–2021, applied to patents filed 2022–2024.
  • Predictor variables: 17 initial indicators capturing technological positioning, market signals, and legal scope; final model used 12 after feature selection.
  • Modeling/benchmarks: Adaptive boosting (AdaBoost) as primary ensemble method; compared to Random Forest and other standard classifiers. Emphasis on interpretable feature importance rankings.
  • Evaluation metrics reported: accuracy, precision, recall, F1 (main spec: accuracy 0.914, precision 0.271, recall 0.431, F1 0.333).

Implications for AI Economics

  • Practical monitoring tool: Policymakers, R&D managers, and investors can use the framework to triage patent portfolios and surface candidate inventions that are more likely to redirect technological search—saving expert time by focusing review resources.
  • Complementarity with other signals: Given modest precision and recall, the model is best used alongside market intelligence, technical expert assessment, and firm-level context (e.g., commercialization plans, open-source disclosure) rather than as a sole decision rule.
  • Informing resource allocation: The approach provides an early-warning signal for potential regime-shifting innovations, which can inform strategic R&D investments, portfolio rebalancing, and selective support for follow-on work in AI.
  • Cautions for economic interpretation:
    • Retrospective dependence: CD is inherently defined by future citation patterns; converting it to a predictive label preserves some of that retrospective logic but cannot escape uncertainties in future citation behavior.
    • Sample and domain limits: Results pertain to patented AI inventions recorded in IncoPat; generalization to non-patented innovation, other technology domains, or jurisdictions with different citation practices may be limited.
    • Biases in patenting and citation practices: Large firms, strategic citations, or field-specific norms can distort both training labels and predictive features—risking systematic biases in who/what is surfaced as “potentially disruptive.”
    • Trade-off between false positives and misses: With precision ~27%, many flagged patents will not realize disruptive CD outcomes, so flagged sets should be treated as candidates for targeted follow-up rather than guarantees.
  • Research and policy directions:
    • Extend to additional features (text embeddings of claims/abstracts, assignee network ties, market adoption proxies) to improve signal power.
    • Cross-domain validation to test generalizability and robustness of feature importance.
    • Use as part of active monitoring systems that update models as forward citation histories accrue, creating a feedback loop between ex ante screening and ex post validation.
    • Consider policy uses (e.g., targeted funding, standard-setting vigilance) but incorporate safeguards against over-reliance on patent-based signals alone.

Short conclusion: The paper contributes an operational bridge between CD-style disruption measurement and supervised early-screening methods, producing a transparent, scalable tool for surfacing candidate disruptive AI patents—valuable for monitoring and prioritization but requiring expert curation and further refinement before being used for high-stakes allocation decisions.

Assessment

Paper Typecorrelational Evidence Strengthmedium — The paper demonstrates a reproducible, time-split predictive framework and reports standard performance metrics (accuracy, precision, recall, F1) on held-out later years, which supports moderate confidence in forecast ability; however, the outcome is a constructed top-5% CD label (not a direct economic outcome), precision/recall are modest, and results depend on citation-network quality and sample restrictions, limiting claims about real-world disruptive impact. Methods Rigormedium — The authors use a sensible time-split for training/evaluation, benchmark multiple classifiers, perform feature selection, and align labels to the CD citation framework, but the study lacks external validation on independent datasets, sensitivity analyses to key design choices (e.g., top-5% threshold, alternative CD constructions), and deeper robustness checks for potential biases in citation data and geographic/field coverage. SamplePatent-level dataset drawn from IncoPat covering patents in the artificial intelligence domain filed 2007–2021; analysis restricted to patents with at least one backward citation; initial indicator set of 17 patent-level technological, market, and legal features (reduced to 12 by feature selection); disruption label = patents in top 5% of empirical CD distribution among patents with >=1 backward citation. Themesinnovation adoption GeneralizabilityRestricted to patented innovations (excludes non-patented or open-source AI developments)., Dependent on IncoPat coverage and citation practices — potential geographic or institutional bias (e.g., over/under-representation of certain jurisdictions)., Outcome is a constructed CD-based top-5% label; may not map directly to economic impact (commercial adoption, productivity, market disruption)., Excludes patents without backward citations, omitting possibly novel inventions with sparse references., Temporal limits: trained on 2007–2021 filings; changing citation, patenting, and AI development practices may reduce future accuracy.

Claims (11)

ClaimDirectionOutcomeConfidence & EvidenceDetails
Early detection of disruptive technologies is difficult because disruptive impact is uncertain and often becomes visible only years after invention. Innovation Output negative time-to-visible-disruptive-impact (conceptual)
Reading fidelity high
Study strength speculative
not reported
0.05
This study develops an interpretable machine-learning framework to screen and prioritize potentially disruptive patent candidates ex ante. Innovation Output positive ability to screen/prioritize disruptive patent candidates
Reading fidelity high
Study strength speculative
not reported
0.05
The paper uses IncoPat patent records in the artificial intelligence domain to construct a multidimensional indicator system spanning technological, market, and legal signals. Innovation Output positive construction of indicator system from patent metadata
Reading fidelity high
Study strength medium
not reported
0.3
To ensure conceptual consistency with the CD framework, the main disruption label is defined as patents falling within the top 5% of the empirical CD distribution among patents with at least one backward citation. Innovation Output positive disruption label assignment (top-5% CD among patents with backward citations)
Reading fidelity high
Study strength high
top 5% of the empirical CD distribution among patents with at least one backward citation
0.5
Restricting the disruption label to patents with at least one backward citation and using the top-5% cutoff reduces reliance on extreme CD values that may be sensitive to incomplete reference information. Innovation Output positive robustness of disruption labeling to incomplete reference information
Reading fidelity high
Study strength speculative
not reported
0.05
Models were trained on a time-split learning set covering patents filed from 2007 to 2021 and evaluated for their ability to predict the disruption label using early observable patent metadata. Adoption Rate positive predictive performance of models trained on 2007–2021 patent data
Reading fidelity high
Study strength medium
not reported
0.3
Among benchmarked classifiers, AdaBoost provides the most competitive screening performance after feature selection, reducing the feature space from 17 to 12 indicators. Innovation Output positive classifier comparative performance and feature-space reduction
Reading fidelity high
Study strength medium
reduced the feature space from 17 to 12 indicators
0.3
Under the main top-5% specification, the model achieves an accuracy of 0.914, a precision of 0.271, a recall of 0.431, and an F1 score of 0.333, indicating modest but nontrivial early-screening ability. Task Completion Time positive predictive performance metrics (accuracy, precision, recall, F1)
Reading fidelity high
Study strength medium
accuracy of 0.914, precision of 0.271, recall of 0.431, F1 score of 0.333
0.3
Feature importance analysis highlights the predictive relevance of citation- and disclosure-related signals, including family citation activity, backward citations, and document length. Innovation Output positive importance of specific patent metadata features for prediction
Reading fidelity high
Study strength medium
not reported
0.3
The framework is best interpreted as a scalable candidate-generation tool for monitoring and expert review within the patented segment of AI innovation, rather than as a definitive classifier of realized disruptive impact. Adoption Rate positive appropriate use-case of the framework (candidate generation/monitoring vs definitive classification)
Reading fidelity high
Study strength speculative
not reported
0.05
The study builds on the CD disruptiveness measure, which is derived from citation-network dynamics. Innovation Output positive use of CD metric as conceptual basis
Reading fidelity high
Study strength high
not reported
0.5

Notes