Local AI tooling widens execution access but recentralizes power: analysis of 7,681 llama.cpp pull requests shows hardware vendors, model hubs and core maintainers increasingly determine which models run well, and Hugging Face’s 2026 absorption of the project crystallizes a new locus of capture in local inference infrastructure.

Main Finding

Local inference (running open-weight models on user devices) expands who can execute models but concentrates control in the infrastructure that makes execution possible. Using llama.cpp as a case study, the authors show that hardware vendors, model distributors, and core maintainers capture strategic leverage through backend integrations, model conversion and distribution paths, and maintenance labor—while model owners and many individual contributors absorb the costs of making models runnable. Openness of weights alone does not prevent enclosure at the infrastructure layer.

Key Points

• Data scope: 7,681 merged pull requests to ggml-org/llama.cpp, Mar 2023–Mar 2026, combined with repository discussions, corporate statements, and contributor blogs.
• Project trajectory: started as a CPU-first local inference runtime (Georgi Gerganov) to enable LLaMA on ordinary hardware; evolved into a heterogeneous backend platform supporting 17+ device backends; core team and corporate participation grew over time.
• Contributor mix shifted: individual contributors fell from ~65% of merged PRs early on to ~30% by 2026, with corporate actors, hardware vendors, model makers, and core maintainers increasing their share.
• Backend modularization: PR #8006 (June 2024) and PR #10256 introduced structural changes that decoupled hardware and model code and made per-backend development easier—this lowered barriers for vendor-specific backends and accelerated hardware diversity.
• Hardware participation differs from cloud hierarchy:
  • NVIDIA CUDA had the highest PR volume (~800 merged PRs), Apple Metal ~420, Intel SYCL ~280, Huawei CANN ~130; Qualcomm and AMD present but smaller.
  • Accelerator- and GPU-related PRs dominated hardware contributions from early on, despite the project’s CPU-first rhetoric.
  • These backend investments reflect vendors’ strategies to gain footholds for local execution even if they are marginal in cloud GPU markets.
• Distribution and conversion capture: Hugging Face’s Feb 2026 absorption of the project and pull requests adding Hub loading and conversion scripts (e.g., convert_hf_to_gguf.py) illustrate how model distribution, format conversion, and execution become tightly linked, creating an “obligatory passage point” where a distributor can steer defaults.
• Costs and incentives: model owners and independent contributors perform much of the conversion and integration labor needed to make models runnable; hardware vendors and distributors gain strategic advantages from the resulting compatibility pathways.
• Central conceptual move: extend critiques of open-washing/corporate capture from models and cloud compute to the inference tooling and runtime infrastructure that mediate open models in practice.

Data & Methods

• Quantitative corpus: 7,681 merged PRs from the llama.cpp GitHub repository (through March 2026).
• PR classification:
  • Primary signal: changed file paths to categorize PRs into hardware backends, model support, conversion tools, server/example apps, and core inference code.
  • When file paths were insufficient (older PRs), title-based rules were used (e.g., model names, CPU instruction set names).
  • GitHub limits (300 changed files per PR) noted as a caveat for very large refactors.
• Contributor affiliation heuristics:
  • Signals used: ggml-org membership, commit email domain, normalized self-reported company field, raw company text; unknown if none reliable.
  • Manual review of conflicts; conservative assignment to avoid mislabeling core maintainers as third-party corporate contributors.
• Qualitative methods:
  • Assembled dossiers for major corporate actors including blogs, product pages, PRs, contribution guidelines, acquisition announcements (e.g., Hugging Face), and selected issue threads.
  • Read quantitative patterns against corporate statements and repository discussions to infer incentives and strategy.
• Key repository interventions highlighted: origin (March 2023), ggml.ai founding (June 2023), backend refactor PRs (#8006, #10256), Hugging Face transition (Feb 2026).

Implications for AI Economics

• Local execution is not by itself decentralizing: shifting compute to devices broadens execution participation but can re-concentrate economic and governance power at the infrastructure layer (backends, conversion tools, and hubs).
• New loci of capture:
  • Hardware vendors: use backend contributions to steer compatibility toward proprietary optimizations or extension points, which can create vendor lock-in or privileged performance paths on devices.
  • Model distributors/hubs: control over model file hosting, conversion utilities, and default loading behavior creates rent-extracting opportunities and standard-setting power (the “obligatory passage point” effect).
  • Core maintainers: sustainers of inference runtimes can accrue outsized influence when combined with corporate employment or acquisition.
• Distributional costs and frictions:
  • Individual model owners and community contributors bear conversion and integration costs, raising transaction costs for deploying models locally and reducing the practical benefits of open weights.
  • Compatibility and format dependencies become a source of market power: control over formats, conversion tooling, or loading APIs shapes which models run where and under what terms.
• Policy and market responses suggested:
  • Regulatory/standards actions to require or incentivize open, documented model formats and loader APIs so that multiple runtimes and hubs can interoperate.
  • Analysis of format-dependencies and vendor influence as part of AI governance and competition reviews (e.g., consider hub dominance and backend interoperability in antitrust/merger assessments).
  • Public funding and sustained support for inference tooling and open runtimes to lower reliance on corporate-maintained hubs and to underwrite the public good of runnable, interoperable infrastructure.
  • Model-compatibility requirements and tooling grants to shift conversion costs away from independent contributors and model owners.
• Broader economic effect: attention to infrastructure (not just models) changes assessments of openness, competition, and participation in AI markets—policy and research should track and intervene at the runtime, conversion, and distribution layers as much as at model-release decisions.

If you want, I can extract a short timeline of key events (PR numbers and dates), create a compact table of backend PR counts by vendor, or produce sample policy language that operationalizes the paper’s recommendations.