ai-evals-course/evals-skills
Skills that guide AI coding agents to help you build product-specific AI evals.
ARCHETYPE
Pragmatist
A balanced, no-drama setup: some rules, some tools, nothing extreme.
Copy this rig
# review before running: this installs third-party code
$ npx degit ai-evals-course/evals-skills/skills ./rig-evals-skills/skills MCP servers are added to Claude Code at local scope; env vars are shown as YOUR_… placeholders — we never store values. Files are fetched with degit into a separate folder so you can review before merging.
$ npx degit ai-evals-course/evals-skills/skills/build-review-interface .claude/skills/build-review-interface $ npx degit ai-evals-course/evals-skills/skills/error-discovery .claude/skills/error-discovery $ npx degit ai-evals-course/evals-skills/skills/eval-audit .claude/skills/eval-audit $ npx degit ai-evals-course/evals-skills/skills/evals-start .claude/skills/evals-start $ npx degit ai-evals-course/evals-skills/skills/evaluate-rag .claude/skills/evaluate-rag $ npx degit ai-evals-course/evals-skills/skills/generate-synthetic-data .claude/skills/generate-synthetic-data $ npx degit ai-evals-course/evals-skills/skills/validate-evaluator .claude/skills/validate-evaluator $ npx degit ai-evals-course/evals-skills/skills/write-code-eval .claude/skills/write-code-eval $ npx degit ai-evals-course/evals-skills/skills/write-judge-prompt .claude/skills/write-judge-prompt
This rig commits no guardrails. Here is the community baseline instead — the deny/ask rules most often found across all 7,204 rigs:
{
"permissions": {
"deny": [
"Read(./.env)",
"Read(**/.env)",
"Read(~/.ssh/**)",
"Bash(rm -rf *)",
"Read(**/*.pem)",
"Bash(rm -rf /)",
"Bash(git push --force:*)",
"Bash(sudo *)",
"Read(.env)",
"Bash(rm -rf /*)",
"Read(./.env.*)",
"Read(~/.aws/**)",
"Bash(git push --force*)",
"Bash(rm -rf:*)",
"Read(**/*.key)",
"Read(**/.env.*)",
"Bash(sudo:*)",
"Bash(git reset --hard*)",
"Bash(git reset --hard:*)",
"Read(.env.*)"
],
"ask": [
"Bash(git push:*)",
"Bash(git push *)",
"Bash(git commit:*)",
"Bash(rm *)",
"Bash(rm:*)",
"Bash(git rebase *)",
"Bash(wget *)",
"Bash(npm publish:*)",
"Bash(git commit *)",
"Bash(gh pr merge *)"
]
}
} Skills (9)
Similar rigs
anomalyco/opencode
The open source coding agent.
Pragmatist 4.2k tok ·
DietrichGebert/ponytail
Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.
Pragmatist 1.6k tok ·
Shubhamsaboo/awesome-llm-apps
100+ AI Agents, Agent Skills and RAG Apps - Free and Open Source.
Pragmatist 4.2k tok ·
garrytan/gstack
Use Garry Tan's exact Claude Code setup: 23 opinionated tools that serve as CEO, Designer, Eng Manager, Release Manager, Doc Engineer, and QA
Pragmatist 8.8k tok ·