A new governance framework ties each automated decision to a pre-committed causal graph and cryptographic evidence, enabling a 'Causal Harm Rate' audit that detects pathway-specific discrimination missed by standard fairness metrics; prototype tooling scales to thousands of evidence packets per second.
Citation observations
Cumulative provider counts captured on specific dates; providers are never combined.
No provider observation is available for this paper.
Missing data, not a zero citation count.
Machine learning systems deployed for credit, hiring, and resource distribution are increasingly subject to regulatory oversight from policies such as the EU AI Act and GDPR. Current fairness governance practices rely on observational fairness metrics, post-hoc explainability, and immutable audit logs, but provide limited support for causal attribution and efficient evidentiary verification. We introduce Causal Evidentiary Governance (CEG), a framework in which regulated institutions commit to a versioned directed acyclic graph (DAG) that partitions causal pathways into allowable and disallowed groups. The Causal Harm Rate measures prediction variation attributable to disallowed causal pathways. Each decision is accompanied by a signed Decision-Evidence Packet (DEP), cryptographically binding the prediction to a digest of the published DAG and path-specific attributions. DEP digests can be appended to a Merkle tree to enable logarithmic-cost inclusion proofs. We validate CEG through a two-layer empirical methodology using demographic summaries from four years of PMA credit supervisory data to construct 10,000 synthetic credit applicants across four strategic DAG counterfactuals. Causal Harm Rate isolates injected causal effects more clearly than demographic parity or equalized odds. Cross-model validation and ablation studies assess robustness. Evaluation on the German Credit dataset shows that harm associated with specific causal pathways can be substantially understated by associational fairness metrics. Finally, a proof-of-concept implementation demonstrates operationally plausible throughput and highlights relevant performance tradeoffs.
Summary
Main Finding
The paper proposes Causal Evidentiary Governance (CEG): a governance stack that (1) forces institutions to pre-commit to a versioned causal DAG partitioning admissible vs. inadmissible paths, (2) quantifies path-specific harm via the Causal Harm Rate (CHR) that isolates variation attributable only to inadmissible causal pathways, and (3) binds per-decision evidence to that commitment using signed Decision‑Evidence Packets (DEPs) whose digests are anchored in an append-only Merkle ledger. Empirically, CHR detects hidden/direct discrimination more cleanly than associational metrics (demographic parity, equalized odds) and remains near-zero under admissible mediation, avoiding false positives that some counterfactual metrics produce. A proof-of-concept implementation shows operationally plausible throughput (≈4,120 DEPs/s with 32 workers) and high verifiability.
Key Points
- Motivation: Observational fairness metrics conflate admissible and inadmissible causal channels; post‑hoc explainers can be cherry‑picked; audit logs lack tamper-evidence. CEG addresses these by forcing ex-ante causal commitments and cryptographically binding attributions to them.
- Causal Harm Rate (CHR): Fraction of instances whose classifier outcome would change under an intervention on the protected attribute propagated only along the inadmissible path set. CHR = 0 implies path‑specific counterfactual fairness for the declared inadmissible paths.
- CHR vs. baselines:
- CHR remains near-zero in graphs with no injected bias (G0) and in graphs where gender effects are mediated only through admissible channels (G1), while demographic parity and equalized odds cannot distinguish these cases.
- CHR increases substantially under direct (G2) and proxy (G3) discriminatory channels: reported CHR ≈ 0.43 (G2) and ≈ 0.39 (G3) in the synthetic credit experiment.
- On the German Credit dataset CHR (direct path) = 0.204 [0.189, 0.221] while DP gap = 0.087 and EO gap = 0.072, i.e., associational metrics can substantially understate causal harm.
- Decision Evidence Packets (DEPs): contain input features, prediction, path‑specific attributions (w.r.t. the committed DAG), counterfactual narrative, DAG digest (SHA‑256), metadata, and a cryptographic signature. DEP digests are batched in Merkle trees (fanout 32) and chained.
- Robustness analyses:
- DAG misspecification: omitting a real inadmissible edge (A→Y) collapses CHR to baseline (misses discrimination); adding spurious edges has only small effects (robust to mild over‑specification).
- Sensitivity to unmeasured confounding: under a confounding grid (γ up to 1.5) the lower 95% CI for CHR in the direct effect setting stayed >0.21, well above a compliance threshold τ = 0.05.
- Implementation & ops: single-thread DEP construction reported at 122.1 ms per 10k (odd metric presentation in the paper), multi-thread throughput ≈4,120 DEPs/s, Merkle construction ≈95 ms/10k, peak memory ≈94.6 MiB, end-to-end evidence verifiability 99.3–99.4%.
- Limitations noted by the authors: correctness of DAG specification; sensitivity to unmeasured confounding; permissioned‑ledger / honest‑issuer assumption; focus on binary classification and tabular credit settings; reliance on synthetic microdata calibrated to PMA aggregates.
Data & Methods
- Data generation:
- Macro layer: aggregated supervisory snapshots from the Palestine Monetary Authority (PMA) (12,952 reported buckets across years) used to calibrate marginals.
- Micro layer: N = 10,000 synthetic applicants sampled from a parametric Structural Causal Model (SCM) whose marginals match PMA aggregate targets within ±1.5%.
- SCM and DAG variants:
- Baseline (G0): no gender effect.
- G1 (admissible mediation): Gender → DTI / CreditScore → Y (no direct effect A→Y).
- G2 (direct discrimination): explicit A→Y direct effect (∆Yg on logit scale).
- G3 (proxy discrimination): gender effect injected via an age proxy.
- Models trained: XGBoost, Logistic Regression, Random Forest (80/20 train/test splits).
- CHR estimation:
- Monte Carlo abduction‑action‑prediction using K = 10,000 exogenous draws.
- Bootstrap CI via 1,000 replicates.
- Sensitivity grid for an unobserved binary confounder with coupling γ ∈ {0.0, 0.5, 1.0, 1.5} to probe robustness to unmeasured confounding.
- DEP & ledger design:
- Per‑decision packets include path‑specific attributions and counterfactual narratives tied to the committed DAG hash.
- DEP digests batched into Merkle trees (fanout = 32); Merkle roots chained and signed (permissioned issuer model).
- Reproducibility: code and artifacts released at the authors’ GitHub repository.
Selected quantitative results (test split, XGBoost, n=2,000): - CHR [95% CI] and approval rates: - G0: CHR = 0.012 [0.008, 0.018]; male approval 32.1%, female 25.5%. - G1: CHR = 0.000 [0.000, 0.000]; male 32.1%, female 25.5%. - G2: CHR = 0.430 [0.419, 0.441]; male 45.0%, female 16.3%. - G3: CHR = 0.386 [0.374, 0.397]; male 30.6%, female 20.9%. - German Credit: CHR = 0.204 [0.189, 0.221]; DP gap = 0.087; EO gap = 0.072. - Operational: ≈4,120 DEPs/s (32 workers); Merkle root chaining and inclusion proofs require ≈log32(ν) sibling hashes (≈3 for ν=10,000).
Implications for AI Economics
- Better attribution of welfare impacts: CHR provides a causal decomposition of model-induced disparities, enabling economists and regulators to quantify how much of observed inequality in economic outcomes (e.g., credit approvals, pricing) is attributable to impermissible causal channels versus permissible mediators. This supports more precise welfare accounting and targeted remediation.
- Regulatory compliance and compliance costs: CEG operationalizes ex‑ante commitments (versioned DAGs) and per‑decision evidence, potentially lowering regulator–bank friction and litigation risk by making audits faster and more decisive. However, it also imposes upfront costs for causal modeling, expert elicitation, DEP construction and cryptographic infrastructure.
- Market signaling and competition: Institutions that publish and cryptographically bind causal governance commitments may credibly signal trustworthy practices, affecting consumer trust, market shares, and cost of capital. Conversely, the need to commit to a DAG can create strategic behavior (gaming DAG specification), requiring regulator oversight on DAG elicitation protocols.
- Incentives for model design and data collection: Because CHR depends on correct causal specification and is sensitive to omitted causal edges, firms have incentives to invest in causal data collection (mediators, instruments) and expert elicitation, improving overall data quality in markets. This may raise entry costs but also raise the baseline transparency.
- Targeted policy interventions: Regulators can use path‑specific harm estimates to design narrowly-tailored interventions (e.g., prohibit direct A→Y effects but allow mediation through education), minimizing efficiency loss from over‑broad constraints that observatonal metrics might cause.
- Macro distributional analysis: Aggregating DEPs across populations provides auditable time-series of path‑specific harm that can feed into macro models of credit access, segregation, and inequality, enabling empirical study of how causal channels evolve with policy or market changes.
- Limitations that matter economically:
- If DAG elicitation is noisy or manipulable, causal audits may miss discrimination (false negatives), with important social costs.
- Permissioned ledgers and honest issuer assumptions reduce robustness to adversarial firms; full market-wide assurance would require stronger decentralization or cryptographic multiparty attestations—these alter cost structures.
- The approach focuses on per-decision binary outcomes and tabular contexts; extending to prices, continuous treatment effects, survival outcomes, or unstructured data is necessary for many economic applications.
Overall, CEG supplies economists and policymakers with a practical, auditable way to tie observed disparities to causal mechanisms—enabling more accurate measurement of discrimination-related harms and more focused regulation—while introducing new governance costs and strategic considerations around DAG elicitation and proof infrastructures.
Assessment
Claims (10)
| Claim | Direction | Outcome | Confidence & Evidence | Details |
|---|---|---|---|---|
| In the synthetic credit-applicant experiments, Causal Harm Rate (CHR) remained near zero under baseline conditions (G0) and under admissible mediation (G1), while increasing substantially under direct discrimination (G2) and proxy discrimination (G3). Ai Safety And Ethics | positive | Path-specific causal harm attributable to inadmissible causal pathways |
Reading fidelity
high
Study strength
medium
|
n=10000
CHR = 0.000 in G1 versus 0.430 in G2 and 0.386 in G3
|
| Under the direct-discrimination graph G2, CHR was higher than demographic parity and equalized-odds metrics. Ai Safety And Ethics | positive | Detection and quantification of prohibited causal discrimination |
Reading fidelity
high
Study strength
medium
|
n=2000
CHR 0.44 versus demographic parity 0.29 and equalized odds 0.18
|
| Associational fairness metrics cannot distinguish disparities caused by admissible mediation from disparities caused by protected or impermissible pathways in the synthetic experiments. Ai Safety And Ethics | negative | Ability of fairness metrics to identify impermissible causal disparity |
Reading fidelity
high
Study strength
medium
|
n=2000
CHR = 0.000 in G1 while demographic parity and equalized odds remained nonzero
|
| CHR is highly sensitive to causal-DAG misspecification when the disallowed direct pathway is omitted, but is relatively robust to the addition of a spurious edge. Ai Safety And Ethics | mixed | Fairness-audit detection of discriminatory causal pathways under DAG misspecification |
Reading fidelity
high
Study strength
medium
|
n=2000
CHR 0.430 correct DAG, 0.012 with omitted A → Y edge, and 0.445 with a spurious edge
|
| The G2 non-compliance finding remained above the stated compliance threshold under the examined unmeasured-confounding sensitivity grid. Ai Safety And Ethics | positive | Robustness of causal-fairness compliance classification to unmeasured confounding |
Reading fidelity
high
Study strength
medium
|
n=10000
Lower 95% confidence bound approximately 0.21 at γ = 1.5, above τ = 0.05
|
| On the German Credit dataset, the reported CHR for a forbidden direct causal edge was larger than both the demographic-parity gap and the equalized-odds gap. Ai Safety And Ethics | positive | Estimated pathway-specific discriminatory harm |
Reading fidelity
high
Study strength
medium
|
n=1000
CHR 0.204 versus demographic parity gap 0.087 and equalized odds gap 0.072
|
| In the German Credit validation, the lower confidence bound of CHR remained at or above 0.172 across the examined confounding-strength grid. Ai Safety And Ethics | positive | Robustness of the estimated causal-harm measure to unmeasured confounding |
Reading fidelity
high
Study strength
medium
|
n=1000
Lower CHR bound at or above 0.172
|
| The CEG prototype achieved approximately 4,120 Decision-Evidence Packets per second with 32 workers while using 94.6 MiB of peak resident memory. Organizational Efficiency | positive | Evidence-packet construction throughput and memory footprint |
Reading fidelity
high
Study strength
low
|
4,120 DEPs/s; 94.6 MiB peak resident memory
|
| End-to-end evidence verifiability of the CEG prototype remained between 99.3% and 99.4% across repeated runs, with reported failures attributed to deliberate fault-injection scenarios. Ai Safety And Ethics | positive | Successful verification of decision evidence |
Reading fidelity
high
Study strength
low
|
99.3–99.4% evidence verifiability
|
| The domain-expert DAG elicitation process achieved Krippendorff's alpha of 0.81 for edge presence and 0.74 for edge admissibility. Governance And Regulation | positive | Inter-rater agreement in causal-graph and admissibility specification |
Reading fidelity
high
Study strength
low
|
n=2
Krippendorff's α = 0.81 for edge presence and α = 0.74 for admissibility
|