Selective, competition-aware forwarding in a real-time ad exchange cut bidder traffic by about one-third while boosting net revenue by roughly 4.6% after an adaptation period, using distributional bid models and an offline PPO controller to tune per-DSP thresholds.

Main Finding

Selective, competition-aware forwarding of bid requests in real-time ad exchanges—using distributional bid prediction plus probabilistic dispatch and adaptive per-DSP thresholds—can substantially reduce DSP request volume while improving monetized outcomes. In a full production multi-DSP deployment (20+ billion daily requests) the policy reduced DSP request volume ≈34.2% and increased net revenue ≈4.6% (p < 0.001) in the recent 14-day window after DSP adaptation.

Key Points

• Problem: Exchanges typically forward nearly all eligible RTB requests, but <40% of forwarded requests receive bids. Over-forwarding wastes DSP compute/budget and can induce throttling, reducing effective bidding capacity and hurting auction efficiency.
• Approach: Formulate request dispatch as a competition-aware optimization problem that asks whether forwarding a request to a given DSP is likely to improve the auction outcome (marginal value), not just whether the DSP will respond.
• Predictive signals:
  • p_fill,i = probability DSP i returns a bid.
  • Distributional bid model: conditional bid value for fills modeled as a Gamma(α, β) distribution per DSP.
  • Opportunity value v_i = p_fill,i · E[bid | fill] = p_fill,i · (α/β).
• Probabilistic dispatch: compute p_comp,i = P(bid_i > adjusted threshold) and a smooth fill gate G_fill to produce forwarding probability p_fwd,i = p_min + (1 − p_min) · p_comp,i · G_fill,i, then sample Bernoulli(p_fwd,i) to forward or not (keeps exploration and avoids hard thresholds).
• Adaptive thresholds: per-DSP conservativeness and fill-filter parameters (λ_p, λ_f) are updated offline via PPO to adapt to non-stationary marketplace dynamics and complex cross-DSP interactions. Reward trades off highest internal bid and DSP request efficiency (via DSP_RPM).
• Practical considerations:
  • Model: Bias-LF-DCN (late-fusion Deep & Cross Network) for CPU-efficient multi-DSP serving; retrained daily.
  • Latency: end-to-end dispatch latency < 7 ms on CPU.
  • Safety: guardrails (min forwarding for high-value requests, bounded updates, automated rollback).
• Experimental evidence:
  • Offline replay simulations: PPO adaptation preserves or increases highest bid while cutting request volume (approx. −35%) vs. full forwarding and outperforms random/static filters.
  • Online: four sequential experiments (E1–E3 single-DSP; E4 multi-DSP full inventory). Key multi-DSP (E4) recent-14d results: net revenue +4.6%, DSP requests −34.2%, DSP responses −6.7%, fill rate +41.8%, RPM +59.0%. ( p < 0.001)
• Heterogeneity & interpretation:
  • Low-RPM traffic dominates request volume (~96.4%) but has low impression realization (~4.9%), so suppressing much Low-RPM traffic explains aggregate decreases in internal highest bid even while revenue rises overall.
  • Mid-RPM traffic is where most net revenue gains occur (Mid-RPM net revenue +10.5% in stratified recent-7d window).
  • Per-DSP effects vary: some DSPs produce fewer requests but higher response/competitive bids; others raise bid prices and billing ratios—policy surfaces comparative advantages.
• Methodological note: A/B testing in RTB is confounded by DSP budgets and cross-effects; authors use a Ratio Difference-in-Differences (Ratio-DID) estimator with permutation tests for significance.

Data & Methods

• Production environment: RTB ad exchange serving >20 billion daily requests; model inference path limited to lightweight operations.
• Bid-response model:
  • Architecture: Bias-LF-DCN (shared encoder + per-DSP late fusion) with two task heads: fill-classification (binary cross-entropy) and bid-distribution prediction (Gamma parameters) trained with Continuous Ranked Probability Score (CRPS) and uncertainty weighting.
  • Retrained daily on rolling 7-day window.
• Dispatch decision logic:
  • Opportunity valuation, competition threshold (τ = K-th highest opportunity), per-DSP conservativeness λ_p for threshold scaling, smooth fill gate controlled by λ_f, exploration floor p_min, Bernoulli sampling for forwarding.
• Threshold adaptation:
  • State st: aggregated fill rates, request volumes, bid distributions, DSP RPM, auction outcomes.
  • Action at: per-DSP {λ_p, λ_f} updates.
  • Reward Rt = HighestBid_t + β · Σ_i DSP_RPM_i,t (β chosen empirically).
  • PPO used to optimize thresholds offline using replay logs and an auction simulator.
• Evaluation:
  • Offline: replayed auction simulator to compare full forwarding, random filtering, best static thresholds, and PPO adaptation.
  • Online: four sequential production experiments. Multi-DSP experiment (E4) used persistent-slot hashing into control (A+B+C pooled) and treatment (D) buckets; pre-period diagnostics reported; Ratio-DID estimator used to infer causal effects; significance tested via permutation.
• Key metrics reported: net revenue, highest internal bid, DSP requests/responses, fill rate, impression rate, DSP RPM, impressions, clicks.

Implications for AI Economics

• Platform-side curation of supply (requests) is a powerful lever: exchanges can improve market efficiency by selectively exposing bidders to opportunities where they have marginal competitive value. This contrasts with the common volume-maximization heuristic.
• Distributional prediction and probabilistic policies: modeling full conditional bid distributions (not just point estimates or response probability) enables valuing marginal contribution and supports softer, exploration-aware policies—important where selection creates feedback loops and retraining bias.
• Incentives and strategic responses:
  • DSPs may respond strategically over time (e.g., changing bidding/pacing when seeing changed request mixes). Adaptive, periodic threshold updates (PPO) partially address this but open avenues for strategic dynamics and potential arms races between exchanges and DSPs.
  • Platform objectives matter: the reward blends auction value and request-efficiency (via DSP_RPM). Different β settings reflect different platform priorities (short-run revenue vs. long-run health). Economists should study optimal β and welfare trade-offs.
• Measurement and aggregation pitfalls:
  • Aggregate metrics (e.g., overall highest internal bid) can be misleading when traffic is dominated by low-quality volume. Stratified analyses (RPM strata, per-DSP) are necessary to interpret effects on price formation, allocations, and welfare.
• Welfare and distributional effects:
  • The approach raises questions about distribution of surplus: which bidders and advertisers win/lose when low-quality requests are suppressed? Does selective dispatch improve overall advertiser ROI and publisher yield, and how are different market participants affected?
• Research directions:
  • Game-theoretic modeling of repeated interactions between exchanges and DSPs under selective dispatch (dynamic strategies, signaling).
  • Long-run effects on entry, investment in bidder inference pipelines, and market structure (e.g., does curation favor larger/efficient bidders?).
  • Welfare analysis accounting for downstream conversion value (advertiser utility) and publisher revenue, not only internal auction metrics.
  • Robustness and fairness: how dispatch policies affect small DSPs, diverse advertisers, and potential anti-competitive concerns.
  • Methodological advances: better offline counterfactual estimators for auction systems, bandit/RL methods that account for strategic agents and budget-constrained bidders.
• Operational caution: selective dispatch changes the data distribution seen by DSPs and by the exchange itself (selection bias). Maintaining exploration floors and retraining frequently is important to avoid reinforcing errors and to preserve counterfactual coverage.

Short takeaway: Exchange-side, competition-aware request dispatch—grounded in distributional bid prediction and adaptive probabilistic policies—can reduce unnecessary traffic, improve monetization and efficiency, and meaningfully reshape competitive dynamics in programmatic ad markets. This invites deeper AI-economics study of strategic interactions, welfare impacts, and long-run market evolution.