Under budget risk, unpredictable AI token consumption incentivizes leaner engineering teams and higher tokens per engineer: volatility turns structural complements (humans and tokens) into marginal substitutes, while skewed usage simply shrinks the effective budget.

Main Finding

When a firm must split a fixed budget between human engineers (headcount N) and generative-AI token capacity (per-capita tokens T), accounting for (a) cognitive friction (humans must review AI output) and (b) heavy-tailed, stochastic token consumption materially changes the optimal mix. Using a chance-constrained budget constraint (CLT + Cornish–Fisher skew correction) intersected with a Cobb–Douglas production function multiplicatively penalized by per-capita cognitive overload, the paper derives closed-form N and a transcendental condition for T. Key comparative statics: greater individual token volatility (σ) raises the optimal per-capita token intensity T but reduces optimal headcount N (i.e., tokens and heads become substitutes at the margin despite being complements in production); usage skewness (γ1) behaves as a pure deadweight loss that shrinks the effective budget without changing marginal substitution dynamics. These conclusions hinge on the assumption that dispersion is exogenous (σ, γ1 do not scale with the planned mean T).

Key Points

• Production specification:
  • Q(N,T) = A N^α T^β exp(−λ (T_total / N)), and with T_total = N·T this becomes Q(N,T) = A N^{α+β} T^β e^{−λ T}.
  • α, β ∈ (0,1) (diminishing returns); λ > 0 models cognitive overload per unit token per person; saturation (unconstrained) at T_sat = β/λ.
  • Below T_sat, N and T are structural complements (positive cross-partial).
• Stochastic budget constraint:
  • Individual token consumption Ti are i.i.d., nonnegative, with mean µ, variance σ^2, standardized skew γ1. Total cost must satisfy a chance constraint P[N·S + Pt Σ Ti ≤ B] ≥ 1−ε.
  • Use CLT to approximate ΣTi ≈ Normal(Nµ, Nσ^2) and apply a Cornish–Fisher skewness correction; deterministic equivalent budget frontier: B ≥ N(S + Ptµ) + z_{1−ε} Pt σ √N + K_γ, with K_γ = γ1 Pt σ (z_{1−ε}^2 − 1) / 6 (a skewness deadweight term).
• Optimization and solutions:
  • Lagrangian optimization (production subject to binding stochastic budget) yields:
    • Closed-form expression for √N* as the positive root of a quadratic in √N (explicit formula given in paper).
    • Transcendental condition for T (polynomial terms in T on the left; σ- and √N-dependent stochastic term on the right), solved numerically for T < β/λ.
  • Second-order (bordered-Hessian) condition is satisfied for all reasonable σ/√N (fails only under pathological extreme variance on a tiny team).
• Comparative statics:
  • ∂T/∂σ > 0 and ∂N/∂σ < 0 when dispersion parameters are exogenous — rising per-engineer volatility increases per-capita tokens but reduces headcount.
  • γ1 enters only via K_γ and acts like a pure deadweight tax that reduces the feasible budget without altering the marginal substitution pattern.
  • If dispersion scales proportionally with mean (e.g., fixed coefficient of variation), the sign of substitution reverses — hence whether σ is exogenous or scales with T is an empirically critical choice.
• Practical intuition: because budget insurance against tail token spikes requires reserving tokens (or money) for risk, higher volatility consumes budget in a way that favors concentrating budget into tokens (higher T per remaining head) at the expense of headcount — even though, mechanically, more humans raise token productivity.

Data & Methods

• Type: analytical, theory/modeling paper with numerical illustrations.
• Assumptions:
  • Ti i.i.d., nonnegative; only first three moments (µ, σ^2, γ1) used — no parametric distribution assumed.
  • CLT and Cornish–Fisher expansion to convert chance constraint to deterministic equivalent; acknowledges asymptotic approximation and slower convergence for small N.
  • Volatility parameters σ, γ1 are exogenous (do not depend on T).
  • Budget fully binding because marginal product of labor > 0 across domain.
• Mathematical methods:
  • Specify cognitive-friction-adjusted Cobb–Douglas production function.
  • Formulate chance constraint on total expenditure and derive deterministic equivalent: B ≥ N(S + Ptµ) + z_{1−ε} Pt σ √N + K_γ.
  • Lagrangian optimization with two decision variables (N, T); derive FOCs, equate marginal conditions to get equilibrium relation.
  • Solve for √N in closed form; derive transcendental equation for T (requires numerical root-finding in practice).
  • Analyze bordered Hessian to verify local maximum; perform comparative statics analytically where possible and numerically for illustrative parameters.
• Numerical illustration parameters (used in figures): α=0.6, β=0.4, λ=0.008 MTok^{−1} (so T_sat ≈ 50 MTok/mo), S = $15k/mo, Pt = $300 per MTok, σ = 20 MTok, γ1 = 2, z_{0.95} = 1.645, B = $900k/mo. These show N and T movement with σ and γ1.

Implications for AI Economics

• Operational planning: deterministic budgeting underestimates the cost of heavy-tailed token usage and human cognitive costs. Firms should include a stochastic risk buffer and model cognitive-friction when choosing headcount vs AI spend.
• Marginal substitution under uncertainty: even when humans and tokens are complements in production, stochastic budget constraints can make them substitutes at the margin. That implies firms facing higher token-use volatility will optimally downsize headcount and concentrate token allocation per remaining engineer — a non-obvious effect with implications for labor policy and organizational design in AI-adopting firms.
• Skewness matters as a budgetary deadweight: heavy right tails (high γ1) directly reduce the effective budget (K_γ) and therefore can lower headcount, independent of marginal productivity considerations. This argues for engineering controls (rate limits, circuit breakers, better instrumentation) to reduce skewness and variance, not only mean usage.
• Testable empirical prediction: whether σ (and γ1) are exogenous versus scale with mean T is crucial. If dispersion is invariant to mean (e.g., driven by rare infrastructure events), the paper’s substitution result holds. If dispersion scales with mean (constant coefficient of variation), the substitution sign reverses. Empirical tests: estimate across teams the relationship between mean token use and variance/skewness; examine how hiring or token allotments respond to observed volatility.
• Policy and procurement: token pricing, insurance, or contractual capacity that reduces effective volatility (e.g., blended fixed-price token bundles, tail-risk protection) can preserve headcount and potentially increase output. Conversely, opaque per-token pricing that exposes firms to tail risk will favor headcount cuts.
• Limitations and extensions:
  • CLT + Cornish–Fisher is asymptotic; small teams require caution.
  • Model is static (single-period) and abstracts from dynamic adjustments, endogenous changes in σ/γ1 with T, multi-tasking heterogeneity, and substitution across task types.
  • Future empirical work should estimate µ, σ, γ1 for real engineering teams and test the model’s predictions about N–T tradeoffs, and extensions could endogenize dispersion or add dynamic budgeting, hiring frictions, and heterogeneity across engineers.

Summary takeaway: incorporate stochastic heavy tails and human cognitive frictions when allocating budget between AI tokens and human labor — reducing token volatility and tail risk is a lever that preserves headcount and overall production, and whether volatility is endogenous or exogenous to token intensity is an empirically crucial question.