A practical six-step framework translates AI safety scenarios into quantitative economic risk estimates, enabling probabilistic claims such as the likelihood of exceeding $Y in annual cyber damages; the approach adapts established risk-management tools and is illustrated via LLM-enabled cyber offense (empirical results reported separately).

Main Finding

The paper proposes a practical six-step methodology for quantitative AI risk modeling that integrates structured scenario building with probabilistic quantification. It decomposes risk into (1) frequency of initiation, (2) probability the event sequence occurs, and (3) magnitude of harm, and shows how to estimate each piece using a mix of scenario analysis, expert elicitation (IDEA/modified-Delphi), three-point probabilistic estimates, fitted distributions, Monte Carlo propagation, and mappings from Key Risk Indicators (KRIs) such as benchmark scores to model uplift. The methodology is validated through extensive application to LLM-enabled cyber-offense (detailed empirical results in a companion paper).

Key Points

• Core decomposition: Risk = (frequency of initiating events) × (probability the sequence completes) × (harm magnitude). This gives interpretable, monetizable outputs (e.g., probability of >$Y annual cyber damages).
• Six-step workflow:
• Define representative risk scenarios (decompose by actor, target, vector).
• Construct risk models (number of actors, attempts/actor/year, required tactics and their success probabilities, damages per success).
• Quantify baseline risk (non-AI reference).
• Identify KRIs/benchmarks that can condition the model (to capture AI effects).
• Estimate AI uplift by mapping KRIs to model parameters via expert elicitation (and validated LLM estimators).
• Fit distributions to epistemic uncertainty and aggregate via Monte Carlo to produce distributions over overall risk.
• Methods drawn from high-risk industries: Fault Tree/Event Tree reasoning, probabilistic/Bayesian thinking, IDEA protocol for elicitation, three-point estimates, Monte Carlo uncertainty propagation, and Bayesian networks where needed.
• Practical design choices:
  • Use established taxonomies (e.g., RAND actor classes; critical infrastructure sectors; attack vectors) to standardize scenario selection.
  • Prefer estimating probabilities for each step (likelihoods) rather than only capability proxies.
  • Map benchmarks/KRIs to uplift so future monitoring and automated estimation are possible.
  • Explore validated use of LLMs as supplementary estimators when domain experts are scarce.
• Strengths: produces actionable, comparable, monetized risk outputs; highlights bottlenecks and evaluation priorities; supports concrete thresholds for deployment and regulation.
• Limitations acknowledged: sparse empirical data linking AI to realized harms; reliance on expert judgment and assumptions; aggregation and dependence assumptions can be challenging; not optimized for diffuse, long-tailed cascading risks (e.g., labor-market disruption).

Data & Methods

• Scenario construction: structured decomposition by actor (e.g., OC1–OC5), target (critical infrastructure taxonomy), and vector (attack types), then select representative combinations.
• Causal mapping: event sequences built using Fault Tree Analysis / Event Tree Analysis to enumerate required steps and conditional dependencies.
• Quantification approach:
  • Use expert elicitation (IDEA modified-Delphi) to obtain three-point estimates (mode + confidence intervals) for parameters with limited data.
  • Fit parameters to statistical distributions capturing epistemic uncertainty.
  • Use Monte Carlo simulation to propagate uncertainty and generate distributions over aggregate risk metrics (e.g., annual damages).
  • Apply Bayesian methods/networks for updating and capturing dependencies where appropriate.
• Uplift estimation: construct mappings from KRIs (benchmarks, red-team results, incident reports) to model parameters to quantify how LLMs change success probabilities or frequencies relative to baseline.
• Use of LLMs: trialed as estimators for elicitation when human expert coverage is limited, with validation against human experts.
• Validation context: methodology extensively applied to LLM-enabled cyber-offense risk; detailed empirical models and validation results provided in a companion paper.

Implications for AI Economics

• Monetization of AI risk: provides a framework to translate model capabilities and KRI changes into dollar-denominated expected losses—enabling direct economic comparison across risks and sectors.
• Better regulatory calibration: quantitative outputs support concrete risk thresholds (analogous to FAA safety frequencies), enabling regulators to set and enforce deployment limits or mandatory mitigations tied to measurable metrics.
• Cost–benefit and investment decisions: organizations can compare expected risk reductions from mitigations to their costs, prioritize investments (e.g., focusing on bottleneck capabilities), and set governance/operational limits based on expected losses.
• Insurance and market mechanisms: enables actuarial-style pricing of AI-related cyber and systemic risks, designing insurance products, and informing capital reserves or liability regimes for AI developers and users.
• Incentives and externalities: quantification helps internalize externalities by making expected damages explicit—informing policies like taxes, liability rules, or mandatory reporting—thus aligning private incentives with societal risk.
• Research and data priorities for economics:
  • Gather empirical incidence data linking AI use to realized harms to reduce reliance on expert priors.
  • Develop econometric models of attacker incentives and market responses that determine initiation frequency.
  • Model systemic feedbacks and macroeconomic spillovers from large expected-loss scenarios.
  • Integrate dynamic updating (Bayesian learning) to reflect evolving model capabilities and mitigation effects.
• Limitations relevant to economic application: uncertainty and expert-driven inputs mean outputs should be treated as distributions, not point truths; interdependence across scenarios and economic feedbacks require careful modeling before scaling to economy-wide policy prescriptions.

Overall, the methodology offers a structured, quantitative bridge between AI capabilities (benchmarks/KRIs) and economic risk metrics, enabling more rigorous economic analysis, regulatory design, and allocation of mitigation resources—while highlighting the need for better empirical data and careful treatment of dependencies and long-tail effects.