Forcing explanations on personalized targeting bites into retail profits: explainable targeting rules yield about 7.5% lower expected profits (roughly $0.23 per customer) than unconstrained black-box personalization. The paper also shows firms should estimate explainable rules directly from data rather than approximate opaque models.

Main Finding

The paper develops a practical framework for designing profit‑maximizing “comprehensible” targeting policies (sentence‑length rules that are transparent, complete, and conversational), shows how to optimize over that class, and compares the resulting policy to state‑of‑the‑art black‑box policy learning. Key empirical result: in a retailer promotion RCT (176,961 households, $10‑off promotion), the optimal comprehensible policy reduces profits by 7.5% (≈ $0.23 per customer) relative to the best black‑box policy, but outperforms a blanket targeting rule (≈ $0.38 per customer, or 16% improvement).

Key Points

• Definition of comprehensible policy: must be (i) transparent (logic is human‑readable), (ii) complete (the sentence is the full policy, not a post hoc summary), and (iii) conversational (short enough to state in ordinary speech).
• Representational class: policies as sentence(s) formed from conditional clauses combined with logical operators. Short sentence length (few clauses) trades off comprehension and predictive power; VC dimension or Rademacher complexity proxies model complexity.
• Optimization: learn the profit‑maximizing comprehensible policy directly from data by searching over clauses and logical combinations; algorithms include brute‑force search and greedy heuristics for given sentence length.
• Estimation principle: directly estimating the comprehensible policy from data strictly dominates the ex post projection approach (i.e., approximate a black‑box by an interpretable sentence afterwards). The paper provides both theoretical arguments and empirical validation.
• Black‑box benchmarks: considered three classes—indirect (outcome modeling), direct (treatment‑effect modeling), and policy‑learning methods; best performing benchmark in the application combined policy learning with deep neural nets.
• Quantified cost of explanation: ΔΠ = ΠBB − ΠComp. In the case study, ΔΠ ≈ $0.23/customer (7.5% of profits). Aggregation example: with 10M customers, monthly expected loss ≈ $2.3M; compared to an expected GDPR penalty (assumed 10% enforcement of a $20M max) ≈ $2M, implying firms may rationally weigh noncompliance depending on enforcement and penalty sizing.
• Inference: profit estimation uses inverse‑propensity weighted profit estimators; the paper adapts recentering empirical process results (Kitagawa & Tetenov) to construct inference for ex post projected rules and uses appropriate inference for the directly learned comprehensible rule.

Data & Methods

• Empirical dataset: Ni et al. (2012) RCT of a $10‑off holiday promotion mailed to 176,961 households; outcome = sales during December 2003. Standard RFM (recency, frequency, monetary) features are used and engineered into candidate clauses.
• Formal setup: observed data (X, W, Y) with binary treatment W; counterfactual profits πi(1) = m·Y_i(1) − c, πi(0) = m·Y_i(0). The optimal unconstrained policy is 1{m·(Y(1)−Y(0)) > c}.
• Profit estimation: inverse‑propensity weighted profit estimator for policy d: Π̂(d) = Σ [Wi/e(Xi) · πi(1) · d(Xi) + (1−Wi)/(1−e(Xi)) · πi(0) · (1−d(Xi))] (unbiased under randomization).
• Learning approaches compared:
  • Indirect: predict outcomes Y(1), Y(0) then form policy.
  • Direct (treatment effect): estimate conditional average treatment effect (CATE) then threshold by cost.
  • Policy learning: directly optimize a policy objective (profit) using flexible learners (including DNNs).
• Comprehensible policy learning: construct a dictionary of clauses from features (e.g., recency buckets, top/bottom half spenders, seasonal spend comparisons), enumerate/combine clauses (up to a conversational sentence length), and search (brute force or greedy) for the clause combination maximizing estimated profit. Control for overfitting (complexity vs. conversational limit).
• Theoretical contribution: formal comparison showing direct learning of interpretable rules is superior to first learning a black‑box and then projecting it down; gives methods for inference on projected rules via recentering.
• Benchmarking: compares optimal comprehensible policy to best black‑box (policy learning + DNN) and to blanket targeting; reports both relative percent changes and absolute $/customer.

Implications for AI Economics

• Regulatory tradeoffs: right‑to‑explanation style laws impose an economically measurable cost (the “cost of explanation”). Regulators and firms must consider the interaction of penalty size, enforcement probability, and the firm’s profit loss from complying when designing/complying with explainability requirements.
• Managerial recommendation: when firms must be interpretable, they should directly learn optimal comprehensible policies from data rather than approximate black‑box models post hoc. This leads to higher profits under the interpretability constraint.
• Market design and welfare: comprehensible policies reduce personalization and thereby can diminish profit capture from heterogeneity; however, they increase transparency for consumers and regulators, which has implications for trust, fairness perceptions, and long‑run brand equity—factors not fully captured by short‑term profit comparisons.
• Methodological guidance: policy learning methods can be adapted to interpretable hypothesis classes (simple logical sentences). Measuring model complexity (VC dimension, Rademacher complexity) helps formalize the comprehension–profit frontier.
• Policy implications for regulators: to induce compliance, regulators should calibrate fines and enforcement probabilities so the expected penalty exceeds the firm’s cost of complying with explainability (or otherwise accept that some firms will rationally not comply).
• Broader applicability: framework applies beyond promotions to any binary targeting/treatment decision where regulators or stakeholders require human‑readable policies (credit, hiring, lending offers, etc.). The approach gives a practical way to quantify the economic cost of explainability constraints.

If you want, I can: - produce a one‑page checklist for implementing comprehensible policy learning in practice (feature engineering for clauses, search heuristics, inference steps), or - extract the specific optimal comprehensible sentence found in the application and show which customers it targets and why.