pagesift: Self-hosted web scraper, crawler and document parser for AI agents

by YOLOW92 · MCP Server · ★ 248

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install pagesift

claude mcp add --scope user --transport http pagesift http://127.0.0.1:3003/mcp

Taken from the project's README on GitHub.

Security audit verdict: SAFE · quality 68/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

ai-agentsbrowser-automationcrawl4ai-alternativedata-extractiondocument-parsingfirecrawlfirecrawl-alternativehtml-to-markdownjina-readerllm

Quick Facts

Stars248
Forks32
LanguageRust
CategoryMCP Server
LicenseAGPL-3.0
Quality Score68/100
Last Updated2026-11-07
Created2026-10-20
Platformsbrowser, mcp, rust
Est. Tokens~25k

About pagesift

pagesift 0.81.5 Turn web pages, PDFs and Office files into clean Markdown for LLMs and AI agents. One self-hosted Rust binary: CLI, Firecrawl-compatible HTTP API, Jina Reader endpoint, MCP server, Python and Node.js packages. English · 简体中文 · 日本語 · Español What it is pages

Compatible Skills

These tools work well together with pagesift for enhanced workflows:

  • crw — semantic(0.66)+rare_topics+same_lang+similar_pop+shared_platform (71%)
  • agent-fetch — semantic(0.41)+complementary+rare_topics+similar_pop+shared_platform (63%)
  • llm-reader — semantic(0.45)+complementary+rare_topics+similar_pop+shared_platform (60%)
  • chrome-agent — semantic(0.28)+complementary+same_lang+similar_pop+shared_platform (60%)

pagesift alternative? Top 6 similar tools

Looking for a pagesift alternative? If you're comparing pagesift with other mcp server tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • crw by fastcrw · ⭐ 1.2k

    Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for

  • searxNcrawl by DasDigitaleMomentum · ⭐ 184

    Open-source MCP server that gives AI agents web search (SearXNG) and clean Markdown crawling of pages, whole s

  • anymd by SylphxAI · ⭐ 1.1k

    Any file → clean Markdown for AI agents: PDF, Word, PowerPoint, Excel, EPUB, HTML and web pages, images (OCR),

  • pullmd by AeternaLabsHQ · ⭐ 517

    Self-hosted URL- and file-to-Markdown service for humans and AI agents - web pages, documents, images, audio,

  • pdfmux by NameetP · ⭐ 86

    PDF extraction that audits its own output — and certifies any other extractor's, catching pages they silently

  • pdf-mcp by jztan · ⭐ 167

    MCP server that lets Claude Code and other AI agents read and search large PDFs, one file or a whole folder: a

More MCP Server Tools

Explore other popular mcp server tools:

View all MCP Server tools →

Popular Rust Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse MCP Server tools