← All reviews · Data & RAG

data-rag/securityclaim testclaim test Rocky measures the headline claim ("10x faster!") on real tasks against a baseline. Glossary

Anthropic-Cybersecurity-Skills: are there really 817 skills across 6 frameworks?

The claim“817 structured cybersecurity skills for AI agentsAI agent An AI that takes actions in steps (runs commands, edits files, browses) instead of only chatting. Glossary · Learn more, mapped to 6 frameworks (MITRE ATT&CK, OWASP, NIST and more)”

GitHubmukul975/Anthropic-Cybersecurity-Skills34.7kStars4.2kForks63Issues + PRsApache-2.0license (Apache-2.0, MIT) The rules for using the code. Apache-2.0 and MIT both allow free use, including commercial use. Glossary · Learn moreLicenseLast pushPythonLanguage

Live stats · checked

Review lives at rockytested.com · @RockyTested

Counted. Useful? Not proven.Rocky in his Unproven outfit: verdict UNPROVENSecurity RockySecurity

With vs without

With it loadedNot tested yet

No with-skill pass count is on file.

Without itNot tested yet

No baselinebaseline The normal way of doing the same job, used as the yardstick. Rocky compares every claim against a baseline on the same machine. Glossary pass count is on file.

Usefulness is a separate question from “does the repo exist.” It needs the same task run twice. Until that A/B is published, both cells stay blank.

Unproven -- head-to-head A/B test (same task with and without the skill loaded) is queued as Phase 2.

What the test plan says

Count every SKILL.md in the repo, check each has valid YAML frontmatter with a name and description, and count how many actually name a security framework. Pure static read, no code run.

Four verdicts

One stamp is not the whole story. Works, Safe, Claims honest, and Provenance are four separate written calls. A missing call stays “not tested yet.”

WorksUNPROVENDid it do the thing when Rocky ran it?

Phase 1 only counted and parsed. The with-vs-without A/B on ~100 skills is queued as Phase 2; until that lands, usefulness is not measured.

SafeCAUTIONSafe to install and run?

No confirmed malware in the surface scan, but two README-featured agents have confirmed bugs (memory-forensics TypeError; breach-containment clock-derived password + hardcoded CONTAINED). README funnels collect leads (survey with Casky Tokenstoken The small chunks a model reads and writes. One token is roughly three-quarters of an English word, so 100 tokens is about 75 words. Glossary · Learn more, casky.ai waitlist). Not a hard Safe fail yet — no confirmed secret exfil.

Claims honestMIXEDDoes the pitch match what Rocky measured?

Claim ledger: 3 supported, 11 partly, 8 contradicted, 6 unverified. Contradictions include skill anatomy, token-cost claims, 'all 22 CSF categories', 'zero deprecated IDs', Navigator release assets, and 'production-grade' on sampled evidence.

ProvenanceCAUTIONDoes the repo's history check out?

Independent project with a buried non-affiliation disclaimer that does not travel into plugin.json / CITATION.cff / the GitHub description. Bulk history (611 skills in commitcommit One saved version of a repo's code. Rocky pins the exact commit so anyone can rerun the same code. Glossary · Learn more 1). Star-integrity sampling was blocked on our test box (environment limit, not a finding).

Safety is a hard cap. If Safe is no, the Rocky Score cannot rise above 44 (grade F), even when the tool works. A blank Safe card means not tested yet, not safe. How the four verdicts roll up →

Claim vs what Rocky measured
Claim vs what Rocky measuredThe claim: 817 structured cybersecurity skills for AI agents, mapped to 6 frameworks (MITRE ATT&CK, OWASP, NIST and more). Finding 1: The 818-skill count and the six frontmatter framework fields are real and machine-checked, and 364 of 366 framework IDs we validated exist in the official catalogs (measuring). Finding 2: But counting files can't tell you whether a skill helps an agent, and the claim ledger logs 8 contradicted README claims -- so usefulness stays unproven until the A/B lab run (measuring).THE CLAIM“817 structuredcybersecurity skillsfor AI agents,mapped to 6frameworks (MITREATT&CK, OWASP, NISTand more)• Source: X postvsWHAT ROCKY MEASURED⚗Finding 1The 818-skill count and the sixfrontmatter framework fields arereal and machine-checked, and 364 of⚗Finding 2But counting files can't tell youwhether a skill helps an agent, andthe claim ledger logs 8 contradictedClaim vs what Rocky measuredThe claim: 817 structured cybersecurity skills for AI agents, mapped to 6 frameworks (MITRE ATT&CK, OWASP, NIST and more). Finding 1: The 818-skill count and the six frontmatter framework fields are real and machine-checked, and 364 of 366 framework IDs we validated exist in the official catalogs (measuring). Finding 2: But counting files can't tell you whether a skill helps an agent, and the claim ledger logs 8 contradicted README claims -- so usefulness stays unproven until the A/B lab run (measuring).THE CLAIM“817 structuredcybersecurity skills forAI agents, mapped to 6frameworks (MITRE ATT&CK,OWASP, NIST and more)• Source: X postvsWHAT ROCKY MEASURED⚗Finding 1The 818-skill count and the sixfrontmatter framework fields are realand machine-checked, and 364 of 366⚗Finding 2But counting files can't tell youwhether a skill helps an agent, and theclaim ledger logs 8 contradicted README
Claim partMeasuredResult
Finding 1The 818-skill count and the six frontmatter framework fields are real and machine-checked, and 364 of 366 framework IDs we validated exist in the official catalogsmeasuring
Finding 2But counting files can't tell you whether a skill helps an agent, and the claim ledger logs 8 contradicted README claims -- so usefulness stays unproven until the A/B lab runmeasuring

What it is: A large bundle that claims 817 cybersecurity skills for AI agents, each tied to frameworks like MITRE ATT&CK and OWASP. Rocky counts them and checks the framework claim, rather than taking the number on faith. Claim source →

Verdict: UNPROVEN

The 818-skill count and the six frontmatter framework fields are real and machine-checked, and 364 of 366 framework IDs we validated exist in the official catalogs. But counting files can't tell you whether a skill helps an agent, and the claim ledger logs 8 contradicted README claims -- so usefulness stays unproven until the A/B lab run.

⚠️ Read this before quoting the verdict
  • Do not read UNPROVEN as fake: the structure claims largely hold (818 skills, six mapping fields, valid IDs). It means nobody -- including us, yet -- has measured whether these skills make an agent better.
  • The claim ledger (data/claims/mukul975-cyber-skills.json) has 28 rows: 3 supported, 11 partly, 8 contradicted, 6 unverified. Contradicted items include the documented skill anatomy, the token-cost claims, 'all 22 CSF categories', 'zero deprecated IDs', and 'production-grade' on sampled evidence.
  • Both scripts we hand-checked from the README's own examples have confirmed bugs: the showcase memory-forensics agent crashes on every full report run, and the breach-containment agent reports CONTAINED regardless of whether any action succeeded.
  • Star-integrity sampling was blocked at the API level from our test box (verified blocked for a control repo too), so no account-age numbers exist either way.

Claim ledger

Every distinct claim in the pitch gets a row: what was said, what the command said back. 28 claims on the ledger: 3 supported, 11 partly, 8 contradicted, 6 not measured.

❄️ Pinned for this ledgerCommit54a798831dCommit date2026-08-31Ledger built2026-10-18

Every command was run from the root of a fresh clone pinned to the commit above. Statuses: supported | partly | contradicted | unverified.

🔍 Coverage: Not stated yet. Rocky only lists the parts a run actually checked.

⚗️ Unproven usefulness. Unproven -- head-to-head A/B test (same task with and without the skill loaded) is queued as Phase 2.

Rocky's take: good uses & where it will fail you

Good uses

  • Building a broad security-skills library for an agentA security lead wiring up an AI agent wants wide coverage: 818 SKILL.md files exist, all 818 have valid frontmatter, so there's a real, structured set to pull from, not a half-finished stub.
  • Compliance work needing multiple framework tagsA compliance analyst mapping controls can lean on this: NIST appears in 817 skills, CIS in 270, PCI DSS in 39 (plus 25 as 'PCI-DSS'), and ISO 27001 in 14.
  • ATT&CK-aligned threat content for a SOCA SOC analyst wanting MITRE ATT&CK-mapped material gets real hits: 190 skills cite 'MITRE ATT&CK' directly, plus 65 more using the short 'ATT&CK' spelling.
  • Fast sanity-check before trusting a repo's claimsSomeone deciding whether to bother with this repo can get an answer fast: the full count-and-validate check ran in about 6 seconds wall time.

Where it will fail you

  • Expecting only the advertised 6 frameworksA reader who takes the '6 frameworks' claim at face value and searches for exactly six will be confused: Rocky found 11 distinct frameworks named across the skills, not 6.
  • Hunting for deep STRIDE or kill-chain coverageA threat modeler specifically wanting STRIDE content will be disappointed: only 1 skill mentions STRIDE, and Cyber Kill Chain appears in just 2.
  • Assuming structure means good adviceA beginner who sees 818 of 818 files passing validation may assume the content itself is solid, but the check only confirms structure and framework names, not advice quality.
  • Wanting ISO 27001-heavy materialA manager building an ISO 27001 training track will find thin coverage: only 14 of the skills reference ISO 27001, far fewer than NIST's 817.

🤖 Drafted by an AI model from Rocky's measured results only; every number was machine-checked against the test data. People in the examples are made up.

Where this repo comes from

❄️ Pinned for this reviewRepomukul975/Anthropic-Cybersecurity-SkillsCommit54a798831dCommit date2026-08-31T04:32:44ZTested2026-10-18Modeln/a (Phase 1 = static screening, no model)Checked2026-10-18

Facts and numbers only, each from a recorded command (see docs/cyber-skills-phase1.md). No conclusions are drawn here.

Created2026-02-25
Stars34.7k
Forks4.2k
Watchers273
Open issues63
Open PRs40
Contributors (API)15
Git author identities23
Commits on main245
Last push2026-08-31

From: gh api repos/mukul975/Anthropic-Cybersecurity-Skills; gh api search/issues; git log

History facts

Star integrity

🚧 Blocked Stargazer-list endpoints (REST with star+json and GraphQL stargazers connection) returned 404/empty from our test box for this repo AND for a control repo (microsoft/markitdown), so account-age sampling and star-burst timing could not be measured. This is an environment limitation, not a finding about the repo. Only the aggregate counts above are available.

Commands tried
  • gh api 'repos/mukul975/Anthropic-Cybersecurity-Skills/stargazers?per_page=3' -H 'Accept: application/vnd.github.star+json' -> 404
  • gh api graphql stargazers(first:3) -> totalCount 0, edges []
  • same two calls against microsoft/markitdown -> identical 404/empty

Funding links in the repo

github: mukul975 · custom: paypal.me/mahipaljangra (from .github/FUNDING.yml)

Where the README sends you

Name & disclaimer placement

Name appears in
  • Repository name (Anthropic-Cybersecurity-Skills)
  • README title, banner image alt text
  • CITATION.cff title ('Anthropic-Cybersecurity-Skills')
  • .claude-plugin/marketplace.json plugin name ('anthropic-cybersecurity-skills')
  • index.json repository URL
  • Historical per-skill LICENSE copyright line ('Anthropic Agent Skills Contributors', removed 2026-03-11)
Disclaimer appears in
  • README.md line 35 ('independent, community-created project. Not affiliated with Anthropic PBC.')
  • README.md line 463 ('Community project by @mukul975. Not affiliated with Anthropic PBC.')
Disclaimer absent from
  • GitHub repo description
  • CITATION.cff
  • .claude-plugin/marketplace.json
  • index.json

From: grep -rn -i 'affiliat|anthropic' across top-level and metadata files

Rocky's take

The files are real and the framework IDs mostly check out. The pitch oversells: anatomy diagram doesn't match the tree, 'production-grade' doesn't survive the two showcase scripts Rocky opened, and the Anthropic name rides above a disclaimer that never makes it into the machine-readable manifests. Useful? Ask Phase 2 — counting isn't testing.

Results, charted

Rocky draws these at build time from the run's own numbers. Hover or read the hidden table for exact values. Verdict colors: green holds, yellow stretched, red failed, teal measuring.

Claimed vs counted
Claimed vs countedComparison bar chart: Claimed vs counted.204409614818SkillsClaimed817 skillsFound818 skillsValid frontmatter818 skillsName a framework817 skills
Rocky counted every SKILL.md and checked its frontmatter.
GroupSeriesValue (skills)
SkillsClaimed817
SkillsFound818
SkillsValid frontmatter818
SkillsName a framework817
Framework mentions across the skills
Framework mentions across the skillsScoreboard: Framework mentions across the skillsNIST817CIS270MITRE ATT&CK255D3FEND141OWASP110PCI DSS64ISO 2700114
How many skills reference each framework (a skill can map to several). 11 distinct frameworks appeared; claim said 6.
ItemValue
NIST817
CIS270
MITRE ATT&CK255
D3FEND141
OWASP110
PCI DSS64
ISO 2700114

Score

A/BNOT YET
Grade pending A/B

The dial stays open on purpose. Usefulness has not been proven in a with-and-without run, so there is no letter grade. Subscores that were actually measured are on the right. Empty subscores stay “not measured”.

Partial rollup of the measured subscores only: 88. Not a Rocky Score and not a grade. It is not used to rank this review.

Claim holds weight 35100818 SKILL.md vs 817 claimed; 11 frameworks vs 6 claimed
Speed / quality vs normal weight 25not measured
Install friction weight 15not measured
Same result every time weight 1560deterministic count, single run (capped at 60 by spec)
README matches reality weight 5not measured
Safe to run weight 5not measured

Graded on 50 of 100 weight points. Parts marked “not measured” are left out of the math, not counted as zero.

#skills#security#count-verified

Medium confidence: claim test with one run per setup. How scores work. Scores only use measured results; parts Rocky didn't measure show as “not measured” and don't count.

Retest history

    Testing ends when the run ends. If the repo ships a new version with a bold new claim, or newer models make a fair rematch possible, Rocky reruns the same test packet and the new result lands here next to the old one, so you can compare versions and models side by side.

    Rerun it yourself

    📦 When the test is done, the exact scripts, raw results and a copy-paste prompt for your own AI agent will appear here.

    Repo & thanks

    Where the claim was posted

    Tom Dörr
    @tom_doerr ·
    The claim Rocky tested

    Equips AI agents with 818 structured cybersecurity skills mapped across six major frameworks, enabling senior-level security analysis within coding assistants. https://github.com/mukul975/Anthropic-Cybersecurity-Skills

    💬 8🔁 36❤️ 197📊 12K🔖 233

    Counts as of (Rocky's last check)

    Open on X →

    Where else this repo is talked about

    On X: 19 posts linking the repo

    Posts from to , in 6 languages. Checked . Found with X search for links to the repo; more may exist. Oldest first:

    • Earliest we found @youyuy88 At first glance, you might think this repository was released by Anthropic. The author is mukul975, and it is a community directory. It has more than eight hundred skills and uses the agentskills io format. I only looked through the headings for hunting, response, forensics, and cloud security; offensive entries are also included, but I did not open them. It can be installed in Claude Code, Cursor, and Codex. Load it only with authorization. 🔗English translation · Chinese original ❤️ 21 · 🔁 3 · 📊 1.7K open
    • @Jayson_security Anthropic-Cybersecurity-Skills: 818 structured cybersecurity skills for AI agents, mapped to MITRE ATT&CK, NIST, and more. Source:English translation · Spanish original ❤️ 1 · 🔁 0 · 📊 23 open
    • @okattm (link only)❤️ 0 · 🔁 0 · 📊 7 open
    • @srmarcmayol 817 cybersecurity skills for agents, across 29 domains, mapped to MITRE ATT&CK, NIST CSF, or D3FEND. The key: the agent follows the procedure of a senior analyst instead of improvising. Note: it is not from Anthropic and includes offensive techniques.English translation · Spanish original ❤️ 0 · 🔁 0 · 📊 28 open
    • @noahxche @tumifuego all you need❤️ 1 · 🔁 0 · 📊 27 open
    • @GYLQ520 At first glance, you might think this repository was released by Anthropic. The author is mukul975, and it is a community directory. It has more than eight hundred skills and uses the agentskills io format. I only looked through the headings for hunting, response, forensics, and cloud security; offensive entries are also included, but I did not open them. It can be installed in Claude Code, Cursor, and Codex. Load it only with authorization. 🔗English translation · Chinese original ❤️ 2 · 🔁 0 · 📊 261 open
    All 19 posts, oldest first
    • Earliest we found @youyuy88 At first glance, you might think this repository was released by Anthropic. The author is mukul975, and it is a community directory. It has more than eight hundred skills and uses the agentskills io format. I only looked through the headings for hunting, response, forensics, and cloud security; offensive entries are also included, but I did not open them. It can be installed in Claude Code, Cursor, and Codex. Load it only with authorization. 🔗English translation · Chinese original ❤️ 21 · 🔁 3 · 📊 1.7K open
    • @Jayson_security Anthropic-Cybersecurity-Skills: 818 structured cybersecurity skills for AI agents, mapped to MITRE ATT&CK, NIST, and more. Source:English translation · Spanish original ❤️ 1 · 🔁 0 · 📊 23 open
    • @okattm (link only)❤️ 0 · 🔁 0 · 📊 7 open
    • @srmarcmayol 817 cybersecurity skills for agents, across 29 domains, mapped to MITRE ATT&CK, NIST CSF, or D3FEND. The key: the agent follows the procedure of a senior analyst instead of improvising. Note: it is not from Anthropic and includes offensive techniques.English translation · Spanish original ❤️ 0 · 🔁 0 · 📊 28 open
    • @noahxche @tumifuego all you need❤️ 1 · 🔁 0 · 📊 27 open
    • @GYLQ520 At first glance, you might think this repository was released by Anthropic. The author is mukul975, and it is a community directory. It has more than eight hundred skills and uses the agentskills io format. I only looked through the headings for hunting, response, forensics, and cloud security; offensive entries are also included, but I did not open them. It can be installed in Claude Code, Cursor, and Codex. Load it only with authorization. 🔗English translation · Chinese original ❤️ 2 · 🔁 0 · 📊 261 open
    • @GYLQ520 At first glance, you might think this repository was released by Anthropic. The author is mukul975, and it is a community directory. It has more than eight hundred skills and uses the agentskills io format. I only looked through the headings for hunting, response, forensics, and cloud security; offensive entries are also included, but I did not open them. It can be installed in Claude Code, Cursor, and Codex. Load it only with authorization. 🔗English translation · Chinese original ❤️ 0 · 🔁 0 · 📊 106 open
    • @xeonai44 Found this for cyber security skills❤️ 2 · 🔁 0 · 📊 50 open
    • @xeonai44 @Teknium btw I found these skills for cyber security audit❤️ 2 · 🔁 0 · 📊 15 open
    • @Dinosn The largest open-source cybersecurity skills library for AI agents❤️ 746 · 🔁 170 · 📊 41K open
    • @tom_doerr Equips AI agents with 818 structured cybersecurity skills mapped across six major frameworks, enabling senior-level security analysis within coding assistants.❤️ 197 · 🔁 36 · 📊 12K open
    • @NeoteoCom 818 cybersecurity skills for Claude Code: senior security analysis inside your coding assistant, mapped to six frameworks.English translation · Spanish original ❤️ 0 · 🔁 0 · 📊 126 open
    • @t1gerxt1ger A collection of security skills for AI has been released. • 818 skills, 34 domains, support for 6 frameworks • Intended for use in authorized environmentsEnglish translation · Japanese original ❤️ 0 · 🔁 0 · 📊 14 open
    • @hemran_7282 Equips AI agents with 818 structured cybersecurity skills mapped across six major frameworks, enabling senior-level security analysis within coding assistants. #CyberSecurity #InfoSec #e0xsecops #TechLeadershi❤️ 0 · 🔁 0 · 📊 5 open
    • @HackerOx26 Anthropic security Skills: #Anthropic #Security❤️ 0 · 🔁 0 · 📊 16 open
    • @RangerCov_175 Most agent skills are vibes. These are mapped to MITRE ATT&CK. 817 files. Each one ties a specific capability to a framework ID. You get structure, not just prompts.❤️ 0 · 🔁 0 · 📊 57 open
    • @laogeai 😤 Security checks rely on people following checklists, and you do not know what was missed. This repository organizes 817 security skills in an agent-usable format, aligned with 6 major frameworks, for direct use by AI. Thirty-four thousand stars.English translation · Chinese original ❤️ 0 · 🔁 0 · 📊 13 open
    • @ngnicky The largest open-source cybersecurity skills library for AI agents 818 practitioner-grade cybersecurity skills · 34 security domains · 6 framework mappings · 26+ AI platformsEnglish translation · Korean original ❤️ 22 · 🔁 5 · 📊 1.3K open
    • @mobileossfinds (link only)❤️ 1 · 🔁 0 · 📊 9 open

    Ran it yourself?

    Share your rerun

    1. Download the rerun bundle above.
    2. Run it, or paste the prompt into your AI agent.
    3. Post your results.json (a gist is fine) and reply to @RockyTested with the link.

    Rocky reruns or spot-checks every submission before it counts. Verified reruns will appear here with your handle.

    🏅 Helper leaderboard

    No verified reruns yet. Be the first!

    Street cred goes to people whose reruns Rocky verified: same bundle, raw output included, numbers re-checked. How it works

    Badge & stat card

    Rocky Tested: UNPROVEN

    Put the verdict badge in a README or post. It always links back to the measured results.

    [![Rocky Tested: UNPROVEN](https://rockytested.com/reviews/mukul975-cyber-skills/badge.svg)](https://rockytested.com/reviews/mukul975-cyber-skills/)
    Rocky Tested stat card for Anthropic-Cybersecurity-Skills: are there really 817 skills across 6 frameworks?

    Stat card (1200×630). This is what shows up when the review is shared on X.

    Machine-readable: /v1/reviews/mukul975-cyber-skills · Words with a dotted underline have a quick explanation: hover or tap. Glossary