0 cumulative citations
View corpus contextAgent skill files are already widespread on GitHub: researchers collected 3.8 million SKILL.md files from 282,200 public repositories, grouped into 1.88 million distinct contents and enriched with folder metadata and sampled histories to support population-scale research on adoption, reuse and supply-chain risk.
Citation observations
Cumulative provider counts captured on specific dates; providers are never combined.
An agent skill is a folder containing a SKILL.md file with instructions for a language-model agent, optionally accompanied by scripts and reference files. The agent loads the skill when it judges that a task matches the skill description. Anthropic introduced the format in October 2025 as an open specification. Nine months later, we find that skill files in the millions sit in public GitHub repositories. Skills are unlike the artifacts the SE research community usually mines: they are written mainly in natural language, a model selects them probabilistically at run time, and no compiler or type checker verifies the selection. They also have no central registry or package manager, so they spread by copying folders between repositories. How developers write, reuse, and maintain skills is therefore an empirical question, and no existing dataset records this population. We present GitSkills, a dataset of 3,797,117 SKILL.md files collected from 282,200 public repositories in July 2026. The dataset retains every file occurrence with its repository, path, and content hash. It groups identical files into 1,877,981 distinct contents and enriches one representative per group with the full text, parsed front matter, folder contents, repository metadata, and, for a subset, the commit history of the file. A single self- contained SQLite file supports research on the adoption, reuse, structure, authorship, maintenance, and security of agent skills.
Summary
Main Finding
The authors release GitSkills, a large, public dataset capturing the early spread and reuse of agent "skills" (SKILL.md folders) on GitHub. Collected in July 2026, GitSkills records 3,797,117 SKILL.md occurrences across 282,200 public repositories (195,841 accounts), grouped into 1,877,981 distinct file contents. The dataset preserves every occurrence with repository/path and groups identical files by content hash; one representative per group is enriched with full text, parsed front matter, folder contents, repository metadata, and (for a subset) commit history. The dataset is provided as a single SQLite file (Zenodo), with a Parquet mirror (Hugging Face) and a GitHub sample.
Key Points
- What a skill is: a folder containing SKILL.md with YAML front matter (name, description) plus Markdown instructions; may include scripts/reference files. Introduced as an open specification by Anthropic (Oct 2025).
- Runtime model behavior: agents decide probabilistically at run time whether to load a skill by matching a task against the skill description — no compile-time checks or guarantees.
- Scale and deduplication:
- 3,797,117 SKILL.md file occurrences collected.
- 1,877,981 distinct contents after grouping by exact content hash.
- 282,200 repositories and 195,841 accounts.
- 50.5% of collected files are verbatim copies (indicating extensive copy-based reuse).
- Dataset tables and counts (SQLite):
- artifacts (core): 3,797,117 rows (file occurrences; representatives include full text/front matter/body size).
- repos: 282,200 repository metadata records (owner, stars, primary language, fork status, dates).
- artifact_siblings: 7,264,865 records for files bundled with representative skills (path, type, size, text up to a cap).
- history (columns in artifacts): 458,548 records for first/last commit dates, anonymized author accounts, commit count (for standard locations and size-stratified sample).
- mining_runs: 7 runs recorded.
- Collection pipeline:
- Discovery via GitHub code-search and REST/GraphQL APIs, partitioning queries by file-size to work around 1,000-result limits.
- Deduplication by content hash; one representative chosen (prefer .claude/skills/).
- Enrichment downloads SKILL.md, parses front matter, collects folder files (text under size cap), repo metadata, and commit history for samples.
- Anonymization: commit author accounts replaced by stable one-way codes; emails/names in commit messages redacted; bot logins preserved.
- Limitations:
- Public repositories only; limited by GitHub code-search indexing behavior (default branches, file-size caps, recent activity heuristics, fork inclusion rules); therefore a lower bound on total population.
- Representative enrichment applies only to the selected copy; other copies may have different sibling files or histories.
- Availability: full SQLite archive on Zenodo, Parquet mirror on Hugging Face, and a sample repo on GitHub.
Data & Methods
- Data sources: GitHub code-search API, REST/GraphQL APIs, and raw-content CDN.
- Discovery strategy:
- Search for files matching SKILL.md filename.
- Partition queries by file-size ranges to overcome API 1,000-result limits and unreliable reported totals.
- Retain every filename match and annotate exact basename and location class.
- Deduplication:
- Compute content hash for each file; group identical byte-wise files.
- Select a deterministic representative per content group (prefer standard skill locations).
- Keep all copies linked to the representative (repository, path).
- Enrichment:
- For each representative download and parse SKILL.md (YAML front matter + body).
- Record bundled scripts/reference files under a size cap and mark has_scripts / has_references flags.
- Collect repository metadata (stars, language, fork status, creation/last-push dates).
- Retrieve commit history for skills in standard locations and a size-stratified sample of others; store anonymized first/last commit authors and commit counts.
- Storage: single self-contained SQLite file, with table schema supporting artifact-level and repository-level analyses.
- Reproducibility/ethics:
- Collection is read-only.
- Sensitive fields redacted or one-way hashed; AI assistant co-author trailers preserved.
- The dataset documents provenance (mining_runs table) and retains raw filename matches so researchers can define inclusion criteria.
Implications for AI Economics
The GitSkills dataset opens empirically grounded work on how LLM-agent artifacts diffuse, are monetized, regulated, and affect developer labor and platform markets. Key implications and research directions for AI economics:
-
Measuring diffusion and adoption dynamics
- Quantify adoption speed across repos by language, age, popularity, and activity. Study early-adopter characteristics and diffusion patterns (contagion, hubs, cascades).
- Estimate elasticities of adoption with respect to repo characteristics (stars, language, activity), enabling models of adoption thresholds and complementarities.
-
Productivity, labor demand, and task specialization
- Use repository-level and temporal commit histories to study whether adding skills correlates with developer productivity (commit rates, issue throughput), code quality proxies, or task reallocation.
- Distinguish augmentation vs displacement: do skills substitute routine tasks (reducing labor input) or complement developers (increasing output per developer)?
- Event-study designs: treat skill addition as an intervention and measure pre/post effects on project outputs.
-
Markets, pricing, and commercialization
- The high rate of verbatim copying (50.5%) implies fast commoditization of common templates; measure concentration of widely reused skills to infer winner-take-all tendencies versus long-tail marketplaces.
- Data supports hedonic pricing/valuation: correlate repo stars or popularity with presence and characteristics of skills to estimate value of curated skills and potential willingness to pay for marketplaces or premium skill curation.
-
Standardization, vendor lock-in, and competition
- Analyze vendor-neutral vs tool-specific placement of skills; track temporal trends to measure standard adoption and coordination across agent tool vendors.
- Platform power: large vendors (Anthropic, GitHub) can shape specification and conventions; quantify network effects and entry barriers for competing agent platforms or third-party skill marketplaces.
-
Network externalities and reuse dynamics
- Trace genealogy of copies to assess whether a small set of templates dominates reuse (network concentration) or a diverse ecosystem persists (long tail).
- Measure how copy propagation interacts with updates (consistent/inconsistent propagation), relevant to public-goods and coordination problems.
-
Security and negative externalities (supply-chain risks)
- Skills can bundle executable scripts and instruct agents to run commands or access networks; dataset flags has_scripts/has_references and records sibling files, enabling measurement of bundled executables prevalence.
- Study modification patterns: do forks/edits introduce risky commands absent from originals? This informs supply-chain risk modeling in an ecosystem without registries.
- Economics of trust: quantify value and market premium for audited/curated skills vs freely copied templates.
-
Intellectual property, licensing, and governance
- Track license declarations and reuse patterns to assess IP friction in skill commodification.
- Data can inform policy debates on registration/registry needs, liability, and disclosure norms for machine-executable instruction artifacts.
-
Measurement and policy tools
- The dataset is a public good enabling reproducible research on agent-related automation externalities, industry concentration, and labor-market impacts.
- Regulators and platforms can use empirical evidence (prevalence of executable bundles, rewrite propagation patterns, concentration metrics) to design disclosure rules, registries, or verification tools.
-
Suggested empirical approaches enabled by GitSkills
- Diffusion modeling (hazard models, Cox regressions) of skill adoption across projects.
- Event studies and difference-in-differences to estimate causal impacts of skill addition on productivity outcomes.
- Network/graph analyses of content-copy networks to identify central templates and measure contagion.
- Hedonic/structural models to estimate economic value of skills and willingness to pay for curation/quality guarantees.
- Risk assessment metrics combining prevalence of executable siblings, copy depth, and lack of maintenance to prioritize audits.
Concluding note: GitSkills supplies high-resolution, longitudinal data on a new, machine-actionable software artifact that sits at the intersection of software engineering and AI deployment. For economists, it offers a concrete dataset to measure adoption, value creation, market structure, externalities, and governance questions arising from LLM agent integration into software development workflows.
Assessment
Claims (11)
| Claim | Direction | Outcome | Confidence & Evidence | Details |
|---|---|---|---|---|
| GitSkills contains 3,797,117 SKILL.md file occurrences collected from public GitHub repositories in July 2026. Other | positive | Number of collected SKILL.md file occurrences |
Reading fidelity
high
Study strength
high
|
n=3797117
3,797,117 files
|
| The collected SKILL.md files come from 282,200 public GitHub repositories owned by 195,841 accounts. Other | positive | Number of repositories and owning accounts represented |
Reading fidelity
high
Study strength
high
|
n=282200
282,200 repositories and 195,841 accounts
|
| The dataset groups the 3,797,117 file occurrences into 1,877,981 distinct file contents using content hashes. Adoption Rate | positive | Number of distinct SKILL.md contents |
Reading fidelity
high
Study strength
high
|
n=3797117
1,877,981 distinct contents
|
| Verbatim copies account for 50.5% of the collected SKILL.md files. Adoption Rate | positive | Share of SKILL.md files that are verbatim copies |
Reading fidelity
high
Study strength
high
|
n=3797117
50.5%
|
| GitSkills enriches one representative file per distinct content with the file text, parsed front matter, folder contents, and repository metadata. Other | positive | Scope of metadata and content enrichment |
Reading fidelity
high
Study strength
high
|
n=1877981
One representative per distinct content
|
| The dataset retains every file occurrence with its repository, path, exact basename, location class, and content hash. Other | positive | Traceability of individual file occurrences |
Reading fidelity
high
Study strength
high
|
n=3797117
One row per discovered file
|
| Commit-history information covers 458,548 skills, including first and last commit dates, author accounts, and commit counts. Other | positive | Number of skills with commit-history metadata |
Reading fidelity
high
Study strength
high
|
n=458548
458,548 skills
|
| The dataset is stored as a single self-contained SQLite file and has a Parquet mirror available on Hugging Face. Other | positive | Availability and format of the research dataset |
Reading fidelity
high
Study strength
high
|
not reported
|
| The collection pipeline partitions GitHub code-search queries by file size to overcome the API's 1,000-result limit and retrieve all results within each partition. Other | positive | Completeness of file discovery within searched partitions |
Reading fidelity
high
Study strength
high
|
n=7
1,000 results per query
|
| The dataset should be interpreted as a lower bound on the full population of agent skills because it covers public repositories only and GitHub code search excludes some files and repositories. Adoption Rate | mixed | Coverage of the full agent-skill population |
Reading fidelity
high
Study strength
high
|
n=3797117
|
| Agent skill selection is probabilistic at runtime, and no compiler or type checker verifies whether the selected skill is appropriate. Ai Safety And Ethics | negative | Reliability and verifiability of skill selection |
Reading fidelity
high
Study strength
medium
|
not reported
|