
Skill Vetter
FreeEnsure safety before installing AI skills.
Free ยท Opens the source repo
What Skill Vetter does
Skill Vetter is a security-focused tool designed to vet AI agent skills before installation. It is crucial for developers and designers who often work with various skills from platforms like ClawdHub and GitHub. The vetting process is thorough, consisting of multiple steps that help identify potential security risks associated with a skill. By following the outlined protocol, users can ensure that they do not inadvertently install malicious or poorly designed code that could compromise their systems.
The vetting protocol begins with a source check, where users assess the origin of the skill, the reputation of its author, and community feedback such as downloads and reviews. This initial step is vital for establishing trust in the skill's source. The next step involves a mandatory code review, where users must scrutinize the skill's code for any red flags, such as unauthorized network calls or requests for sensitive information. This step is crucial to prevent the execution of harmful code.
After the code review, users evaluate the skill's permission scope to determine what files it needs access to and whether those permissions are appropriate for its functionality. Finally, the skill is classified into a risk level, which helps users make informed decisions about whether to install it. The output of the vetting process is a comprehensive report that summarizes the findings and provides a clear verdict on the skill's safety.
Skill Vetter is ideal for anyone involved in deploying or using AI skills, especially in environments where security is paramount. It empowers users to make informed decisions and enhances the overall security posture of their AI agent ecosystem.
When to use it
Use Skill Vetter before installing any AI skill from third-party sources or when evaluating shared skills.
When not to use it
This tool may not be necessary for skills from trusted official sources where security is already assured.
What you can build with it
Vetting a New Skill from GitHub
Before installing a new skill from a GitHub repository, run Skill Vetter to assess its safety.
Evaluating Shared Skills
When receiving skills from other agents, use Skill Vetter to ensure they don't pose security risks.
Checking Permissions of Skills
Use Skill Vetter to analyze the permission scope of a skill before installation to avoid unnecessary risks.
How to install Skill Vetter
View source1. Install with the skills CLI
npx skills add netease-youdao/lobsterai/skill-vetter --agent claude-code2. Or install it manually
Download the skill folder and drop it into ~/.claude/skills/ for all projects, or .claude/skills/ to scope it to one repo. Restart Claude Code so it picks up the new skill.
Anthropic's agentic coding CLI, and the reference implementation of Agent Skills. Drop a skill folder into ~/.claude/skills and Claude Code loads it automatically whenever a task matches the skill's description. Claude Code docs
Inside SKILL.md
Written by netease-youdaoSkill Vetter ๐
Security-first vetting protocol for AI agent skills. Never install a skill without vetting it first.
When to Use
- Before installing any skill from ClawdHub
- Before running skills from GitHub repos
- When evaluating skills shared by other agents
- Anytime you're asked to install unknown code
Vetting Protocol
Step 1: Source Check
Questions to answer:
- [ ] Where did this skill come from?
- [ ] Is the author known/reputable?
- [ ] How many downloads/stars does it have?
- [ ] When was it last updated?
- [ ] Are there reviews from other agents?
Step 2: Code Review (MANDATORY)
Read ALL files in the skill. Check for these RED FLAGS:
๐จ REJECT IMMEDIATELY IF YOU SEE:
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โข curl/wget to unknown URLs
โข Sends data to external servers
โข Requests credentials/tokens/API keys
โข Reads ~/.ssh, ~/.aws, ~/.config without clear reason
โข Accesses MEMORY.md, USER.md, SOUL.md, IDENTITY.md
โข Uses base64 decode on anything
โข Uses eval() or exec() with external input
โข Modifies system files outside workspace
โข Installs packages without listing them
โข Network calls to IPs instead of domains
โข Obfuscated code (compressed, encoded, minified)
โข Requests elevated/sudo permissions
โข Accesses browser cookies/sessions
โข Touches credential files
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
Step 3: Permission Scope
Evaluate:
- [ ] What files does it need to read?
- [ ] What files does it need to write?
- [ ] What commands does it run?
- [ ] Does it need network access? To where?
- [ ] Is the scope minimal for its stated purpose?
Step 4: Risk Classification
| Risk Level | Examples | Action |
|---|---|---|
| ๐ข LOW | Notes, weather, formatting | Basic review, install OK |
| ๐ก MEDIUM | File ops, browser, APIs | Full code review required |
| ๐ด HIGH | Credentials, trading, system | Human approval required |
| โ EXTREME | Security configs, root access | Do NOT install |
Output Format
After vetting, produce this report:
SKILL VETTING REPORT
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
Skill: [name]
Source: [ClawdHub / GitHub / other]
Author: [username]
Version: [version]
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
METRICS:
โข Downloads/Stars: [count]
โข Last Updated: [date]
โข Files Reviewed: [count]
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
RED FLAGS: [None / List them]
PERMISSIONS NEEDED:
โข Files: [list or "None"]
โข Network: [list or "None"]
โข Commands: [list or "None"]
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
RISK LEVEL: [๐ข LOW / ๐ก MEDIUM / ๐ด HIGH / โ EXTREME]
VERDICT: [โ
SAFE TO INSTALL / โ ๏ธ INSTALL WITH CAUTION / โ DO NOT INSTALL]
NOTES: [Any observations]
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
Quick Vet Commands
For GitHub-hosted skills:
# Check repo stats
curl -s "https://api.github.com/repos/OWNER/REPO" | jq '{stars: .stargazers_count, forks: .forks_count, updated: .updated_at}'
# List skill files
curl -s "https://api.github.com/repos/OWNER/REPO/contents/skills/SKILL_NAME" | jq '.[].name'
# Fetch and review SKILL.md
curl -s "https://raw.githubusercontent.com/OWNER/REPO/main/skills/SKILL_NAME/SKILL.md"
Trust Hierarchy
- Official OpenClaw skills โ Lower scrutiny (still review)
- High-star repos (1000+) โ Moderate scrutiny
- Known authors โ Moderate scrutiny
- New/unknown sources โ Maximum scrutiny
- Skills requesting credentials โ Human approval always
Remember
- No skill is worth compromising security
- When in doubt, don't install
- Ask your human for high-risk decisions
- Document what you vet for future reference
Paranoia is a feature. ๐๐ฆ
Frequently asked questions about Skill Vetter
Similar skills
CodeQL Code Scanning
Streamline CodeQL setup and configuration for security analysis.
Security Review
AI-powered codebase security scanner for vulnerabilities.
Integrating SAST into GitHub Actions
Automate SAST scanning in GitHub Actions workflows.
Implementing Semgrep for Custom SAST Rules
Enhance code security with custom Semgrep rules.
Infrastructure as Code Security Scanning
Automate security checks for your IaC deployments.
Implementing GitHub Advanced Security
Automate code scanning and vulnerability detection at scale.
