Open-weight models and non-productivity uses dominate much of real-world LLM traffic on OpenRouter, with creative roleplay and coding assistance especially popular; a small cohort of early users shows unusually long-lived engagement — a 'Glass Slipper' retention effect.

Main Finding

Using 100+ trillion tokens of anonymized request metadata from OpenRouter (Nov 2024–Nov 2025 window, with task tagging available from May 2025), the study shows that real-world LLM usage is more diverse and economically consequential than many narratives assume: open-weight (OSS) models have grown to roughly one-third of token volume by late 2025 (driven heavily by rapid Chinese OSS gains), multi-step/agentic inference and creative roleplay/coding workloads account for outsized shares of activity, and a persistent “foundational” user cohort (the Cinderella “Glass Slipper” effect) exhibits much higher long‑term retention. These patterns imply durable multi‑model stacks, shifting cost sensitivities, and rising infrastructure demand as inference becomes more iterative and tool‑integrated.

Key Points

• Dataset scale and vantage:
  • Analysis uses metadata for billions of prompt–completion pairs totaling ≈100 trillion tokens processed on OpenRouter, spanning hundreds of models and >60 providers.
• Open vs closed source:
  • OSS share rose steadily to about ~30% of weekly token volume by late 2025.
  • Chinese OSS grew from ~1% (late 2024) to peak weeks near ~30% of total usage; averaged ≈13% weekly over the year. RoW OSS averaged ≈13.7%, while proprietary RoW models averaged ~70% of weekly tokens.
  • OSS market moved from DeepSeek dominance to a pluralistic mix; no single OSS model consistently >25% of OSS tokens.
  • Top OSS contributors by aggregate tokens (Nov 2024–Nov 2025): DeepSeek (≈14.4T), Qwen (≈5.6T), Meta LLaMA (≈4.0T), Mistral (≈2.9T), OpenAI (OSS variants ≈1.65T).
• Model-size dynamics:
  • Medium-sized models (15–70B parameters) captured growing share; “medium is the new small” — users favor cost/quality sweet spots over only the largest models.
• Workload categories:
  • Creative roleplay and coding assistance are unexpectedly large drivers of activity, alongside productivity/writing and Q&A.
  • Agentic inference (multi-step, tool-calling, chain-of-actions) rose substantially, indicating models are increasingly embedded as components in automated systems rather than only single-turn assistants.
• Retention and cohorts:
  • Early adopters form persistent cohorts with markedly higher long-term engagement (the “Glass Slipper” effect): early alignment between user needs and model characteristics yields durable stickiness.
• Cost/use sensitivity:
  • Effective cost metric (avg input+output tokens accounting for caching) correlates with usage dynamics; developers are sensitive to per‑inference costs and choose models accordingly.
• Geography:

  • 50% of platform usage originates outside the U.S.; billing-based geography shows regional model preferences and strong adoption of local/Chinese OSS models in appropriate markets.

• Data sampling and labeling:
  • Content categories come from an opt‑in GoogleTagClassifier run on ~0.25% of prompts; mappings roll classifier taxonomy into study buckets (Programming, Roleplay, Translation, etc.).

Data & Methods

• Data source:
  • OpenRouter platform metadata: per-generation records with model/provider id, prompt and completion token counts, timing, routing/latency, streaming/cancellation, tool-call flags. No raw prompt or completion text was available to the study authors.
• Scale & coverage:
  • Rolling 13-month window ending Nov 2025 for most analyses; category-level analyses use May–Nov 2025 (when consistent tagging was available).
• Content categorization:
  • 0.25% opt-in sample of prompts classified via Google Cloud Natural Language classifyText (GoogleTagClassifier); only category labels (confidence ≥0.5) used.
  • Classifier labels mapped to study-defined buckets (Programming, Roleplay, Translation, General Q&A, Productivity/Writing, Education, Literature/Creative, Others).
• Model labeling:
  • Models labeled OSS if weights public; closed/proprietary otherwise. Models tagged by origin (China vs Rest-of-World). Sizes bucketed: small <15B, medium 15–70B, large ≥70B.
• Geographic segmentation:
  • User region inferred from billing location (billing-country) to preserve privacy and get stable geography proxy.
• Aggregate computations:
  • Weekly UTC‑normalized aggregates using Hex analytics for reproducibility. Token volumes = prompt + completion (reasoning tokens counted inside completion).
• Key metrics:
  • Weekly token shares, model market share over time, cohort retention curves, effective-cost (average tokens per request with caching effects), tool-calling incidence as proxy for agentic use.
• Limitations / biases noted by authors:
  • Observational metadata from a single (albeit large and multi-model) platform → platform-specific selection effects.
  • No access to raw text; taxonomy depends on opt‑in sample and classifier mapping (sampling bias and mapping granularity limitations).
  • Billing-based geography imperfect (enterprise/third-party billing possible).
  • Classifier opt-in may favor users willing to share metadata for discounts → potential skew toward certain user segments.

Implications for AI Economics

• Competition, pricing, and bargaining power:
  • Rapid OSS uptake (particularly Chinese OSS) reduces pricing power of proprietary providers for many workloads. Multi‑model stacks and switching friction are low, so providers must compete on price, latency, features, and continuous improvements rather than one‑time dominance.
• Compute demand & cost structure:
  • Growth of agentic/multi-step inference and reasoning tokens increases average compute per request. This raises infrastructure demand (GPU-hours, memory, bandwidth) and magnifies the importance of cost-optimized inference engines, caching, and model distillation/quantization for marginal-cost reduction.
• Infrastructure & routing economics:
  • Multi‑model orchestration (proprietary + OSS) creates value for inference brokers and routers (like OpenRouter). Economic value accrues to platforms that optimize cost/performance routing, caching, and hybrid deployments; this fosters a market for inference-management services and arbitrage between providers.
• Product–market fit & user lifetime value:
  • The “Glass Slipper” retention effect implies early users who find good model–task fit generate outsized lifetime value. For startups and model teams, early alignment and rapid iteration can create persistent revenue streams and lower customer acquisition payback times.
• Model‑size strategy:
  • The rise of medium models as a dominant slice suggests a cost-performance sweet spot: building and monetizing medium-sized models may yield better ROI than pushing only for largest‑parameter models. This affects R&D allocation and capital intensity decisions for model builders.
• Geography & market segmentation:
  • Regional model leadership (e.g., Chinese OSS) underscores segmentation of demand and the importance of localized models, compliance, and pricing strategies. Market entrants should consider region-specific go‑to‑market and infrastructure policies.
• Application mix and labor effects:
  • Large share of roleplay and coding assistance indicates both entertainment and production substitution use cases. Coding assistants can alter developer productivity and labor demand in software engineering (partial substitution/augmentation); roleplay/creative uses change consumer-facing monetization opportunities.
• Monetization and product design:
  • Sensitivity to effective cost per inference motivates pricing innovations (subscription vs token billing vs hybrid), feature-tiering (tool access, streaming, priority), and opt‑in analytics for discounts. Providers can monetize value-add routing, reliability, and privacy guarantees.
• Need for continual iteration:
  • Rapid shifts in OSS market share following releases show that continuous product development matters economically — both to sustain share and to prevent churn from low switching costs.
• Policy & regulatory considerations:
  • The dataset’s finding of diversified providers and global OSS growth complicates export-control and standardization efforts; regulators and procurement officers should account for multi-source dependency risk and potential for rapid supply shifts.

If you want, I can: - Produce concise charts/reported numbers from the paper (e.g., top model token volumes and OSS share time series) summarized as tables. - Drill deeper on the economic modeling implications (e.g., expected compute cost curves, welfare effects, or a simple demand model linking effective price to token volume).