Guaranteeing initial exploration views raises creator activity—about 8.6% more videos per creator and 7.1% more creators posting—yet short-window viewer A/B tests can miss the long-run benefit because the shared content corpus evolves slowly and requires long, isolated experiments to measure total value.

Main Finding

Exploration in short-video recommenders not only affects immediate viewer metrics but meaningfully increases creator supply and expands the discoverable corpus. The paper shows a signed positive creator response to production exploration (8.55% more videos per creator; 7.10% more creators posting at least once), quantifies short-run viewer trade-offs, and proves that the shared corpus and its turnover impose strict limits on what A/B tests can observe within finite horizons. Identification of the corpus-mediated long-run value requires tailored randomizations (co-diversion / isolated cells) and sufficiently long experiments matched to corpus turnover.

Key Points

• Empirical magnitudes
  • Eight-month creator ablation: +8.55% videos posted per creator; +7.10% creators posting at least once (relative to a minimal floor).
  • Budget-matched reallocation: raises creator participation with no detectable short-run viewer-side cost.
  • Year-long viewer ablation (disablement vs enabled): +1.74% video views but −2.13% view time (viewer-side trade-off); no sustained buildup over 12 months visible via one-sided viewer test.
  • Three-week co-diverted probe: within that window, the experiment identifies the direct feed effect and detects organic lift after exploration ends, but cannot sign the long-run corpus asymptote.
• Conceptual decomposition of a delivered exploration view (Proposition 2):
  • Direct creator channel: induced future postings (marginal posting response δ times downstream value).
  • The view itself: immediate consumption value η_e.
  • Take-up channel: increased probability of organic distribution q′(B) times downstream organic reach V_org and its lifetime value.
• Supply-loop multiplier (Proposition 1): when each submission induces further submissions with expected factor R (<1 for stability), the cumulative posting amplification is 1/(1 − R). As R → 1 the multiplier blows up.
• Measurement limits from shared corpus and turnover:
  • Viewer-side (one-sided) A/B tests share the same corpus across arms, so corpus-mediated effects cancel and are unobserved.
  • Co-diversion (isolated arms each with their own corpus) is required to retain the corpus channel in contrasts, but the corpus has mechanical turnover rate ω. If an experiment runs t posting cycles, it can reveal at most ω t of the eventual corpus effect — i.e., slow stock dynamics attenuate what a finite-horizon experiment can express.
  • Before the corpus trajectory shows curvature, data cannot distinguish a small, fast effect from a large, slow one; confidence sets can therefore fail to have finite upper bounds (weak identification).
• Design and inference results:
  • Theorem 1 and related propositions formalize horizon bounds and identification limits.
  • Detection/estimation scaling laws for slow-expressing effects are derived (e.g., N^{-1/3} detection, N^{-1/5} estimation rates in the exponential-approach family).
• Practical observation: increasing sample size reduces noise but does not accelerate the corpus turnover; longer duration (matched to ω) or structural priors/creator experiments are needed to identify the long-run corpus value.

Data & Methods

• Setting: a major short-video platform (industrial recommender with budgeted exploration as practiced; authors worked with Snap Inc. data).
• Mechanism formalization:
  • Budgeted exploration: each new item in a pool receives a per-item budget B(s) with minimum B_min and maximum B_max; escalation above B_min is conditioned on early viewer response within a TTL window.
  • Ecosystem model (discrete submission–feedback cycles): states are submission rate Λ_t (new posts per period) and organic corpus K_t (items remaining in organic distribution). Key primitives: baseline Λ0, creator response g(·) with marginal δ = g′(·), take-up probability q(B) with derivative q′(B), organic reach V_org, corpus turnover ω, and per-unit viewer values η.
  • Linearized dynamics (mean-field tangent at steady state):
  • Λ_{t+1} = Λ0 + R Λ_t (R = g( E[V|B] ))
  • K_{t+1} = (1 − ω) K_t + q(B) Λ_t
• Experiments (four total):
• Eight-month creator ablation: disables production exploration in some creator cells (compared to minimal floor) to estimate posting response.
• Budget-matched reallocation: reassigns budgets at fixed nominal aggregate capacity to test whether shifting allocation increases creator participation absent viewer-side change.
• Year-long viewer ablation: one-sided disablement vs enabled to measure immediate feed trade-offs over a long horizon (measures views and view time).
• Three-week co-diverted A/B: matched creator and viewer submarkets randomized so each arm develops its own corpus (isolated cells); intended to capture corpus flow visible within a short horizon and probe the estimation floor.
• Estimation strategy:
  • One-sided designs identify immediate viewer effects and supply responses that express within the chosen horizon, but cancel shared-corpus channel.
  • Co-diverted/isolated designs retain corpus effects but require matching the horizon to corpus turnover ω to reveal asymptotic effects.
  • Cohort analyses and long-running ablations used to separate gross corpus inflow from net long-run value.

Implications for AI Economics

• Valuation of exploration must account for two-sided externalities: views produce immediate consumer value, induce organic take-up, and trigger creator supply. Failing to account for creator response understates long-run value of exposure policies.
• Mechanism design: cold-start budget objectives that ignore creator supply are incomplete. Designers should incorporate priors for creator response (δ, R) and corpus-turnover (ω) when setting per-item budgets, escalation rules, and floors/ceilings.
• Experimental practice on platforms:
  • Standard viewer-side A/B tests can miss corpus-mediated benefits; co-diversion (isolated arms) is necessary to measure corpus effects but requires long horizons matched to corpus turnover.
  • Short-duration tests (weeks) may only reveal the direct feed effect and a fraction (≤ ω t) of the eventual corpus benefit; policy decisions based on such tests risk mis-evaluating long-run welfare.
  • Sample size increases reduce variance but cannot shorten the time-scale for stock dynamics; thus experimentation budgets should trade off duration vs. sample size differently for slow-expressing effects.
• Inference and policy caution:
  • Slow-expressing two-sided feedback loops can produce weak identification: data within practical horizons may yield confidence intervals without finite upper endpoints for long-run effects. Policymakers and platform economists must combine experiments with structural priors, horizon-matched creator experiments, or very long-term isolation to obtain credible bounds.
• Broader two-sided market lessons:
  • Small changes in allocation (raising R closer to 1) can produce large multipliers for creator production — beneficial or harmful depending on downstream quality and displacement dynamics. Close-to-critical regimes require careful control because of large amplified externalities.
  • Evaluations and regulations focused solely on short-run user metrics may misjudge platform decisions that trade short-run consumption for long-run supply and diversity benefits.
• Practical recommendations:
  • Include creator-side priors and estimates (from horizon-matched creator experiments) into cold-start budget objectives.
  • Use budget-matched reallocations to isolate creator participation effects without altering nominal capacity.
  • Run co-diverted experiments over durations informed by measured or plausible ω; if impractical, supplement with structural modeling and prior information to bound the long-run effects.

Limitations noted by authors - The linear/mean-field model and local multiplier apply near steady state; opposing-sign feedbacks (crowd-out, quality dilution) could alter conclusions and require additional modeling. - Some heterogeneity (δ_c, q′_s) is not identified by these designs; within-pool re-ranking by creator responsiveness remains an open challenge. - Practical identification of the asymptotic net corpus value may require experiments much longer than typical operational windows.