~ / rigs / 77777R7 / Octocrawl

77777R7/Octocrawl

Web scraping MCP server and API for AI agents: any public URL to clean Markdown, plus site maps. Hosted MCP works without an API key or sign-up (20 pages a day); crawls and batches with a free account. Self-host with npx. Each page comes wi

↗ GitHub ★ 5 AGPL-3.0 updated 7d ago project Claude CodeCodex Claude plugin
share on X
ARCHETYPE
Pragmatist
A balanced, no-drama setup: some rules, some tools, nothing extreme.
CONTEXT TAX · EVERY TURN
up to ~6.6k tokens
Claude Code loads MCP tools on demand, so the real cost is usually lower.
Heavy · median rig: 2.3k · breakdown
GUARDRAILS
1/5
No YOLO mode · details
Quality 20/100 Guardrails v2

Copy this rig

# review before running: this installs third-party code
$ claude mcp add --transport http octocrawl https://mcp.octocrawl.dev/mcp-oauth
$ npx degit 77777R7/Octocrawl/.claude ./rig-octocrawl  # inspect, then merge into .claude/

MCP servers are added to Claude Code at local scope; env vars are shown as YOUR_… placeholders — we never store values. Files are fetched with degit into a separate folder so you can review before merging.

$ claude mcp add --transport http octocrawl https://mcp.octocrawl.dev/mcp-oauth
$ npx degit 77777R7/Octocrawl/plugins/octocrawl-openai/skills/get-started .claude/skills/get-started

This rig commits no guardrails. Here is the community baseline instead — the deny/ask rules most often found across all 16.2k rigs:

{
  "permissions": {
    "deny": [
      "Read(./.env)",
      "Read(./.env.*)",
      "Read(**/.env)",
      "Read(~/.ssh/**)",
      "Bash(git push --force:*)",
      "Read(**/*.pem)",
      "Read(.env)",
      "Read(~/.aws/**)",
      "Read(**/*.key)",
      "Read(**/.env.*)",
      "Bash(git push --force*)",
      "Bash(rm -rf:*)",
      "Bash(rm -rf *)",
      "Bash(sudo *)",
      "Bash(sudo:*)",
      "Bash(rm -rf /)",
      "Bash(git push -f:*)",
      "Read(.env.*)",
      "Bash(git reset --hard*)",
      "Bash(rm -rf /*)"
    ],
    "ask": [
      "Bash(git push:*)",
      "Bash(git push *)",
      "Bash(gh pr merge *)",
      "Bash(git commit:*)",
      "Bash(rm *)",
      "Bash(gh pr merge:*)",
      "Bash(gh pr create *)",
      "Bash(git reset --hard:*)",
      "Bash(npm publish:*)",
      "Bash(git rebase *)"
    ]
  }
}

MCP servers (2)

serversourceest. tokens
w2l local / custom · remote 2.5k
mcp.octocrawl.dev · "octocrawl" remote · remote 2.5k

Skills (1)

Hooks (1)

eventmatcherruns
SessionStart*$CLAUDE_PROJECT_DIR/.claude/hooks/session-start.sh

Similar rigs

copied ✓