Self-host firecrawl
v2.11.0API for AI agents to search, scrape, and interact
- Stars
- 201 884
- Rating
- 5.0 (1)
- Port
- 3002 (Firecrawl API)
- Requires
- PostgreSQL
ghcr.io/firecrawl/firecrawlWhat is firecrawl?
Firecrawl is a web data platform built for AI agents that need to find, read, and act on live web content. It provides three core capabilities: Search (find relevant pages and get full content in one call), Scrape (convert any URL to markdown, HTML, screenshots, or structured JSON with automatic JavaScript rendering), and Interact (click, scroll, type, and navigate pages before extracting data). Additional endpoints include Crawl (scrape entire websites), Map (discover all URLs instantly), Batch Scrape (process thousands of URLs asynchronously), and Agent (autonomous multi-step research). The self-hosted version runs via Docker Compose with PostgreSQL, Redis, RabbitMQ, and a Playwright service, exposing the API on port 3002. The open-source edition (AGPL-3.0) includes core scraping, crawling, and search; advanced features like Agent, Browser, Interact, and managed anti-bot infrastructure are Cloud-only. Firecrawl offers official SDKs for Python, Node.js, Go, Rust, Java, Elixir, Ruby, .NET, and PHP, plus a CLI and MCP server for AI agent integration.
firecrawl alternatives
anakinSelf-hosted open-source web scraping API turning pages into clean markdown or JSON, with an anti-detect Camoufox browser, proxy auto-selection and a web dashboard.Compareanakin with firecrawl
searcharvesterSelf-hosted search API and deep research tool for AI agents with Tavily-compatible endpoints, SearXNG metasearch, and a live web UI.Comparesearcharvester with firecrawl
maxunSelf-hosted and open-source web data platform: build scrape, crawl, extract, search and monitor robots in a no-code recorder or with an API, SDK, CLI or MCP.Comparemaxun with firecrawl
nextgptNextGPT is a self-hosted AI chatbot with document processing, RAG search, and web search. Deploys via Docker Compose or to AWS/GCP.Comparenextgpt with firecrawl
Deep Research Web UISelf-hosted AI agent generates cited reports via web searches, browsing real sources, and verifying evidence. Supports many AI providers and search APIs via Docker.CompareDeep Research Web UI with firecrawl
TRAWLA self-hosted, open-source scraping engine that bypasses JavaScript challenges and CAPTCHAs using an adaptive tier engine with HTTP-first approach and MCP support.CompareTRAWL with firecrawl
pullmdSelf-hosted URL and file to Markdown converter for AI agents with PWA, REST API, MCP server, and Claude Code skill.Comparepullmd with firecrawl
crawler-buddySelf-hosted HTTP crawling server with unified JSON API for web scraping, RSS discovery, and metadata extraction from YouTube, Reddit, GitHub, HackerNews.Comparecrawler-buddy with firecrawl
Should you self-host firecrawl?
firecrawl scores 91/100 on selfhost.directory (how scoring works) and ranks #1 of 16 in Web Scraping. It has 201 884 GitHub stars, +11 331 in the last 30 days.
It shipped 9 stable releases in the past year. The latest, apps/go-sdk/v1.15.0, came out on 8 September 2026. New versions land roughly every 9 days.
Setup is advanced: plan for several services and some ongoing maintenance. An official Docker image is available. It is AGPL-3.0-licensed and written mostly in Typescript.
Its closest alternative on selfhost.directory is webclaw (64/100, 2 443 stars). firecrawl scores higher overall. See firecrawl vs webclaw side by side.
Features
- CLI
- JavaScript Rendering
- Media Parsing
- Token-efficient Output
firecrawl README
The API to search, scrape, and interact with the web at scale. Firecrawl is the context API for AI agents. 🔥 Open source and available as a hosted service.
Pst. Hey, you, join our stargazers :)
More in Web Scraping
flaresolverrSelf-hosted open-source proxy that drives a real Chrome browser to solve Cloudflare and DDoS-Guard challenges, returning cookies and HTML to your HTTP clients.
flight-finderSelf-hosted, open-source travel price tracker for flights, hotels, and car rentals using your own AI provider, with interactive charts and VPN price comparison.
FredyFredy monitors 29 European property portals, deduplicates listings, calculates affordability and travel times, sends notifications via Slack, Telegram, Email, Discord.
gpt-researcherSelf-hosted, open-source deep research agent: a planner splits your question, parallel researchers scan 20+ web or local sources, and it writes a cited report.
HuginnSelf-hosted, open-source automation server where agents watch websites, RSS, mail and webhooks, then act on events and post to Slack, Telegram and other services.
job-opsJobOps is a self-hosted, open-source job-search pipeline that pulls listings from 10+ job boards, scores fit with AI, rewrites your CV per role, and tracks every reply.
KibitzrKibitzr is a self-hosted, open-source web monitoring tool that checks pages for changes and sends notifications via email, Slack, Telegram, and more.
LightpandaOpen-source, self-hosted headless browser written in Zig for scraping, crawling and AI agents; serves CDP and WebDriver BiDi on port 9222 for Puppeteer and Playwright.
Marginalia SearchAn open-source internet search engine with its own crawler and index that you can self-host to rank text-heavy, non-commercial sites on a single server.
maxunSelf-hosted and open-source web data platform: build scrape, crawl, extract, search and monitor robots in a no-code recorder or with an API, SDK, CLI or MCP.
mkfdSelf-hosted, open-source tool that builds RSS feeds from websites, email inboxes, APIs and other sources without native feeds. Runs in Docker or via Bun.
ObscuraOpen-source, self-hosted headless browser engine in Rust: runs V8 JavaScript, speaks CDP for Puppeteer and Playwright, with built-in stealth and tracker blocking.


0 comments