Item detail

us/crw

us/crw is an AGPL-licensed Rust crawler and scraper that mirrors Firecrawl-style `/v1` and `/v2` APIs, ships as a single binary, includes an MCP server, and adds extraction, search, monitoring, and screenshot capture for agent workflows that need fast web context without a heavier browser-first stack.

Score8.6
Popularity7.6
Riskconditional
TierGold
Score breakdown
Usefulness9.0
Novelty7.0
Momentum8.0
Maturity6.8
Open-source/build8.4
Evidence7.2
Workflow potential9.7
Setup ease6.4

Popularity is tracked separately. Support, ads, sponsorships, and tips never affect these signals.

Why it matters

Useful for builders who rely on web retrieval in RAG, research, or agent pipelines and want a lighter self-hosted path than outsourcing every scrape to a managed API.

Who should use it

RAG builders collecting clean web contentagent developers replacing or complementing Firecrawl or Tavilyteams that want an MCP-capable crawler they can self-host cheaplydevelopers who need structured scrape, crawl, search, and extract endpoints from one stack

Who should skip it

Skip if the source link, docs, or setup requirements do not match your workflow.

Risk explanation

Managed API usage can send crawled content through a third-party service, while self-hosting shifts the operational and compliance burden onto your team.

Evidence links

Closest alternatives / related signals

web-scrapingmcpragrustagent-infrastructure