A unified generative–discriminative retrieval model increased Kuaishou's ad revenue by 5.78% and cut inference latency by a third in company A/B tests, while substantially improving Recall@10 on public benchmarks; the gains appear driven by joint generation+relevance learning, codebook-anchored item representations, and material-specific modeling.

Main Finding

UniGD is a unified generative–discriminative retrieval model for industrial search advertising that replaces the conventional cascaded generative-retrieval + separate relevance model pipeline with a single model that both generates candidate Semantic Identifiers (SIDs) and produces explicit relevance scores. In production on Kuaishou’s search advertising system it increased ad revenue by 5.78%, cut inference latency by 33.1% (13.00 ms → 8.70 ms), and improved discriminative relevance estimation. On public benchmarks (NQ320K, MS300K) UniGD significantly improved Recall@10 over strong generative-retrieval baselines (relative improvements reported: +8.44% on NQ320K and +3.19% on MS300K; improvements are statistically significant, p < 0.05).

Key Points

• Unified architecture: a single decoder-only backbone jointly optimized for autoregressive SID generation and explicit query–ad relevance scoring, removing the need for a separate online relevance model.
• Three novel components:
  • CAGE (Conflict-Aware Gradient Enhancement): coordinates conflicting gradients between generative and discriminative objectives by measuring cosine similarity and projecting/remixing gradients to prioritize generation while retaining useful discriminative signal.
  • CAM (Codebook-Anchored Representation Module): builds ad-side representations by summing frozen hierarchical codewords (from RQ-KMeans on multimodal pretrained encoder outputs). This enables immediate, low-cost ad representations at indexing time (cold-start friendly) without per-ad encoder inference.
  • HAM (Heterogeneous Ad-material Modeling): supports material-specific codebooks, SID vocabularies, and output heads for different ad types (short-video, product, live-stream) while sharing the backbone; at inference, type-specific beam searches run in parallel and candidates are merged for scoring.
• Training scheme: three stages — (1) gen-only (Lgen), (2) disc-only (Ldisc), (3) joint training with CAGE coordinating gradients.
• Relevance supervision: pointwise MSE to human/offline teacher labels plus auxiliary pairwise hinge loss for ranking consistency.
• Serving advantages: fewer model components to serve (single model), faster per-request latency, immediate availability of new indexed ads (no embedding rebuild), and lower per-candidate compute (CAM is T codebook lookups + sum).

Data & Methods

• Model design:
  • SID construction: hierarchical SIDs via residual quantization (RQ-KMeans) over multimodal encoder representations; SIDs are autoregressively generated (level-specific token vocabularies).
  • Generative objective: standard autoregressive MLE over SID tokens (Lgen).
  • Discriminative objective: explicit relevance score r(q,a) computed from pooled query hidden states and CAM-reconstructed ad representation; Ldisc = Lpoint (MSE) + λ Lpair (pairwise hinge).
  • Gradient coordination: compute g_gen and scaled g_disc (scale η), compute cosine c; if c ≥ 0 sum gradients, else project g_disc onto orthogonal complement of g_gen and combine using coefficients α(c), β(c) that increasingly favor g_gen as conflict increases.
• CAM details:
  • Use a multimodal pretrained encoder to produce va for each ad.
  • Offline RQ-KMeans yields T hierarchical codebooks Ct; each SID level indexes a codeword; u_CAM(a) = sum_t Ct[st(a)] (frozen codebooks).
  • CAM requires no online multimodal encoding at serving and supports immediate indexing.
• HAM details:
  • For each material type m, separate codebooks C(m)_t, vocabularies V(m)_t, and output heads W(m)_t, b(m)_t are used; shared backbone still provides efficiency and cross-type transfer.
• Datasets and scale:
  • Public: NQ320K (320K train queries, 7,830 test queries from Natural Questions), MS300K (320K docs, 360K train queries, 772 test queries from MS MARCO).
  • Industrial: Kuaishou search-ad logs with 153M positive pairs for generative training, 248M pairs for discriminative training; tests include 277K pairs over 1K queries and 10K human-labeled pairs.
• Metrics:
  • Generative retrieval: Recall@1/5/10, MRR@10 (public benchmarks).
  • Relevance estimation (industrial): AUC, Spearman, Pearson; also production metrics such as ad revenue and inference latency.
• Baselines:
  • Production cascaded system (GR → separate relevance model) in industrial eval.
  • Representative GR methods on public benchmarks: DSI, NCI, Ultron, LTRGR, GenRRL, DDRO, etc.
• Results highlights:
  • Online A/B: +5.78% ad revenue, -33.1% inference latency, improved discriminative relevance estimates.
  • Public benchmarks: statistically significant improvements in Recall and MRR vs. strongest reproduced GR baselines (Recall@10 improvements reported: +8.44% on NQ320K, +3.19% on MS300K).

Implications for AI Economics

• Revenue and cost impacts:
  • Direct revenue uplift (reported +5.78%) demonstrates the monetary value of tighter alignment between candidate generation and relevance scoring.
  • Latency reduction (-33.1%) implies lower per-request compute, reduced serving cost, and better user experience; also reduces opportunity cost due to faster scoring and potentially higher throughput per server.
  • Eliminating a separate online relevance model reduces operational complexity, memory footprint, and maintenance costs (fewer model deployments and feature pipelines).
• Market efficiency and monetization of supply:
  • CAM enables immediate indexing and competitive representations for new and long-tail ads (important on platforms with high churn; paper cites ~36.9% daily new ads). This reduces cold-start frictions and accelerates advertiser monetization — increasing short-run ad inventory value.
  • Better relevance estimation improves match quality, likely increasing click-through and conversion rates, improving platform surplus and advertiser ROI.
• Auction and strategic effects:
  • Improved retrieval and scoring can change auction dynamics: tighter relevance may shift which ads enter the auction, affecting bids, clearing prices, and advertiser strategies. Platform should monitor bidder behavior and price signals post-deployment.
  • If the system favors ads with certain creative formats (via CAM/HAM priors), advertisers may adapt creatives, altering market composition.
• Investment and deployment trade-offs:
  • Upfront costs: requires a large multimodal pretrained encoder to create stable codebooks (engineering and compute costs for pretraining and offline clustering).
  • Training complexity: three-stage and conflict-aware joint optimization increase modeling complexity; maintenance of frozen codebooks constrains incremental improvements to the multimodal prior unless codebooks are periodically refreshed.
  • Risk of lock-in and bias: frozen codebooks reflect pretrained data distribution; potential risks include entrenching biases or favoring certain content styles—economists and platform designers must consider fairness/competition effects.
• Research and broader adoption:
  • UniGD suggests a practical pattern for aligning generation-based retrieval with pointwise relevance scoring, which can be applied in other marketplaces (recommendation, content discovery) to increase revenue capture and reduce serving overhead.
  • CAGE is a generalizable technique for coordinating competing objectives in multi-task industrial models; CAM shows how offline-pretrained multimodal priors can be operationalized for instant indexing.

Short takeaway: UniGD demonstrates that tightly coupling generative candidate retrieval with explicit discriminative scoring—augmented by gradient coordination, frozen multimodal codebooks, and material-aware modeling—can produce both better retrieval quality and stronger business outcomes (higher revenue, lower latency and serving cost), at the expense of higher upfront modeling/engineering complexity and the need to manage pretrained-codebook governance.