Randomizing how long entire systems stay in one treatment — and letting switch rates depend on the age of a run — substantially improves switchback experiments: a spectral minimax design cuts worst-case estimation error by at least 32% versus common fixed-block schedules, by balancing contamination and time-varying baseline imbalance under finite carryover.

Main Finding

Allowing switchback run durations to be randomized (and to depend on the current run age) yields designs whose frequency-domain properties can be optimized to substantially reduce worst-case mean-squared error (MSE) for estimating the time-averaged global treatment effect under finite carryover. A simple two-rate, age-dependent random-duration rule (piecewise-exponential switching) cuts the asymptotic worst-case MSE by at least ~32% relative to the common independently randomized fixed-block switchback.

Key Points

• Design primitive: treat the distribution G of treatment-run durations as the experimental design variable. Successive run lengths are i.i.d. draws from G and treatment labels alternate at run boundaries (stationary alternating renewal process).
• Estimand: time-averaged global treatment effect τ_T = (1/T) ∫_0^T [Y_t(1) − Y_t(0)] dt.
• Estimator: continuous-time Horvitz–Thompson inverse-probability weighting using pure-exposure indicator E_a(t) (pure exposure means current assignment held for full carryover horizon m). The pure-exposure probability p_G = E_G[(R − m)+] / (2 E_G[R]).
• Error decomposition (Proposition 1): the estimation error decomposes into two additive components
  • imbalance term: baseline/common outcome u(t) interacts with X(t) (pure-treatment minus pure-control exposure normalized),
  • contamination term: treatment-contrast v(t) interacts with H(t) (degree of contamination). Concretely, bτ_T − τ_T = (1/T) ∫_0^T [u(t) X(t) + v(t) H(t)] dt, and the MSE depends on u, v and the autocovariances γ_X(h), γ_H(h).
• Spectral view: because X and H are stationary, their covariance structure is summarized by spectra. The MSE can be written (and upper-bounded) by spectral overlap integrals between outcome spectra (u and v) and design-induced imbalance/contamination spectra. Thus poor designs have spectral mass where outcomes also vary strongly.
• Design criterion & computation: the imbalance/contamination spectra are determined by G via its characteristic and truncated characteristic functions. This yields a tractable worst-case proxy that can be computed from G without modeling outcomes.
• Practical optimality: optimizing over a simple two-rate family (age-dependent switching rate: a lower early rate and a higher rate after the carryover window) gives large gains. The optimal early rate is strictly positive — occasional early switches before uncontaminated exposure are beneficial.
• Exclusions & caveats: the analysis assumes finite carryover horizon m, bounded potential outcomes, and absolutely integrable covariance (rules out perfectly periodic designs with spectral atoms, e.g., strictly alternating fixed blocks, for which adversarial periodic patterns can defeat consistency).

Data & Methods

• Design model:
  • Alternating renewal process with inter-switch distribution G (finite mean). Stationary initialization via the length-biased distribution so time 0 is uniform within its run.
  • Special cases: alternating fixed blocks (G = δ_ℓ) and blockwise independent randomization (geometric multiples of ℓ).
• Potential outcomes and assumptions:
  • Non-anticipation and finite carryover: outcomes at time t depend only on assignments in [t − m, t].
  • Bounded outcomes: |Y_t(a)| ≤ B.
• Estimator and key quantities:
  • Pure-exposure indicators E_a(t) = 1{assignment a maintained in [t − m, t]}. Horvitz–Thompson estimator bτ_T = (1/T) ∫_0^T [E_1(t) Y_t / p_G − E_0(t) Y_t / p_G] dt.
  • Decompose outcomes into common level u(t) = (Y_t(1)+Y_t(0))/2 and half-contrast v(t) = (Y_t(1)−Y_t(0))/2.
  • Define design processes X(t) = (E_1(t) − E_0(t))/p_G and H(t) = (E_1(t)+E_0(t))/p_G − 2.
• Analysis:
  • Derive exact MSE as a double integral involving u(t)u(s) γ_X(t − s) and v(t)v(s) γ_H(t − s).
  • Move to frequency domain: using the spectral densities of X and H, represent (and bound) the MSE as integrals of outcome spectral power times design spectral densities.
  • Express design spectra in closed form using the characteristic function of G (and a truncated variant accounting for the carryover window). This makes the worst-case proxy a computable functional of G.
  • Optimize G within a simple parametric family (two-rate piecewise-exponential) and compare asymptotic worst-case MSE with baseline fixed-block designs.
• Results reported: theoretical spectral decomposition, tractable worst-case proxy, and optimization showing ≥32% asymptotic improvement for the two-rate family over regular randomized fixed-block switchbacks.

Implications for AI Economics

• Better A/B testing on interactive platforms: Marketplaces, recommendation systems, and marketplaces where unit-level randomization creates interference can use randomized-duration switchbacks to guard against spurious effects caused by temporal cycles (diurnal, weekly) or adversarial/nonstationary outcome patterns.
• Design matters beyond average run length: practitioners should tune the full run-length distribution (not just mean or block length). The temporal regularity and spectral content of the assignment process determine vulnerability to alignment with outcome periodicities.
• Age-dependent switching is valuable: allowing switching probabilities to depend on the run age (e.g., a low early switching rate but a higher rate after the carryover window) can reduce worst-case MSE substantially with minimal implementation complexity (two exponential rates is simple to implement).
• Robust policy evaluation and safer rollouts: minimizing worst-case MSE helps ensure that measured treatment effects are less likely to be confounded by time-varying baselines or contamination, supporting more reliable policy decisions and safer feature rollouts.
• Integration with adaptive/learning systems: frequency-aware, random-duration designs can be combined with model-assisted or adaptive experimentation (e.g., if carryover m or partial outcome spectra are estimated from historical data) to further improve efficiency while retaining robustness.
• Practical considerations and limitations:
  • Need to choose or bound the carryover horizon m. Misspecification of m affects p_G and contamination modeling; conservative choices increase robustness but reduce pure-exposure probability.
  • The approach is worst-case (minimax) and model-free; it optimizes against adversarial temporal patterns, which may be conservative if the environment is benign.
  • Designs with spectral atoms (perfect periodicity) are excluded from the main asymptotic results: if you are forced to use perfectly periodic switching (e.g., strict alternating fixed blocks), be aware that periodic outcome patterns can exploit that and yield nonvanishing error.
  • Implementation complexity: age-dependent switching requires run-age tracking and sampling from G at switches; this is operationally simple for most online platforms but should be weighed against engineering costs.
• Actionable recommendation for practitioners in AI economics:
  • Estimate a plausible carryover horizon m (or set a conservative upper bound).
  • Avoid strictly periodic block switching that aligns with known cycles.
  • Prefer randomized-duration designs with age-dependent switching; start by implementing a two-rate piecewise-exponential rule (low early switch rate, higher post-carryover rate) and compute the design's spectral proxy to check alignment with any known outcome periodicities.
  • If prior outcome spectral information is available, use it to select G to minimize spectral overlap; otherwise use the minimax-optimal or the two-rate design as a robust default.

If you want, I can (a) translate the paper's worst-case proxy into a short code snippet to evaluate candidate G distributions numerically, or (b) outline an implementable two-rate switching procedure with recommended parameter ranges and diagnostic checks for an online experimentation platform. Which would you prefer?