scrapai-cli: AI-powered web scraping CLI

by discourselab · Agent Tool · ★ 117

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install scrapai-cli

git clone https://github.com/discourselab/scrapai-cli.git

Taken from the project's README on GitHub.

Security audit verdict: SAFE · quality 70/100

None of the 44 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 44 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

aiclaude-codeclicloudflarecloudflare-bypasscloudflare-scrapercrawlerpythonscraperscrapy

Quick Facts

Stars117
Forks18
LanguagePython
CategoryAgent Tool
LicenseApache-2.0
Quality Score70/100
Open Issues20
Last Updated2026-10-26
Created2025-06-24
Platformsbrowser, claude-code, cli, python
Est. Tokens~19k

About scrapai-cli

ScrapAI A CLI where you describe what you want to scrape in plain English, an AI agent builds the scraper, and Scrapy runs it. Minutes later you have a tested, production-ready scraper stored in a database. No Python, no CSS selectors, no Scrapy knowledge. The AI agent analyzes the site, writes extraction rules, verifies quality, and saves a reusable config. Run it tomorrow or next year.

scrapai-cli alternative? Top 6 similar tools

Looking for a scrapai-cli alternative? If you're comparing scrapai-cli with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • browser-search by Johell1NS · ⭐ 545

    A skill for AI agents: search the web with SearXNG, browse with Camofox, bypass protections with CloakBrowser.

  • clanker by bgdnvk · ⭐ 381

    autonomous systems engineering cli agent for any cloud environment: AWS, GCP, Cloudflare, etc

  • sudocode by sudocode-ai · ⭐ 296

    Lightweight agent orchestration dev tool that lives in your repo

  • browser-debugger-cli by szymdzum · ⭐ 185

    Let Claude Code and other coding agents drive and debug Chrome from the shell. DOM, network, console and raw C

  • claude-code-open by kill136 · ⭐ 158

    Open source AI coding platform with Web IDE, multi-agent system, 37+ tools, MCP protocol. MIT licensed.

  • WebReaper by alex-on-ai · ⭐ 152

    AI-native web scraper. Single binary with a bundled Claude Code skill. MIT-licensed alternative to Firecrawl.

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 44 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse Agent Tool tools