openspider: The crawler for the agentic era – open-source website crawler & technical SEO auditor for AI agents and humans

by wojcikdominik · MCP Server · ★ 12

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

Featured in: Claude SEO Skills & SEO MCP Servers

Security audit verdict: SAFE · quality 64/100

None of the 44 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 44 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

ai-agentscrawlermcprustseotauritechnical-seoweb-crawler

Quick Facts

Stars12
Forks0
LanguageRust
CategoryMCP Server
LicenseApache-2.0
Quality Score64/100
Last Updated2026-11-05
Created2026-10-13
Platformsbrowser, mcp, rust
Est. Tokens~25k

About openspider

The crawler for the agentic era – open-source website crawler & technical SEO auditor for AI agents and humans (macOS, Windows). Rust + Tauri, MCP-native.

Compatible Skills

These tools work well together with openspider for enhanced workflows:

  • seo-landing — semantic(0.39)+complementary+rare_topics+similar_pop+shared_platform (58%)

openspider alternative? Top 6 similar tools

Looking for a openspider alternative? If you're comparing openspider with other mcp server tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • screaming-frog-mcp by bzsasson · ⭐ 95

    Headless MCP server for Screaming Frog SEO Spider – run crawls, export and analyze crawl data via the CLI. Sma

  • token_proxy by mxyhi · ⭐ 94

    Local AI API gateway for OpenAI / Gemini / Anthropic. Runs on your machine, keeps tokens counted (SQLite), off

  • vibeshell by veithly · ⭐ 92

    The first SSH client built for AI agents. Let Claude Code, Codex, and other CLI agents manage your servers thr

  • AfdianToMarkdown by PhiFever · ⭐ 81

    爱发电爬虫(afdian.com)

  • mcp by supadata-ai · ⭐ 63

    Official Supadata MCP Server - Adds powerful video & web scraping to Cursor, Claude and any other LLM clients.

  • agentic-seo-skills by agencia-conversion · ⭐ 52

    Agentic SEO operating system as a Claude Code plugin: project Wiki, DataForSEO workflows, content briefs, tech

More MCP Server Tools

Explore other popular mcp server tools:

View all MCP Server tools →

Popular Rust Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 44 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse MCP Server tools