# TRAWL

> A self-hosted, open-source scraping engine that bypasses JavaScript challenges and CAPTCHAs using an adaptive tier engine with HTTP-first approach and MCP support.

- **Category:** Web Scraping
- **Licence:** AGPL-3.0
- **Latest version:** v1.9.3
- **Open source:** oss
- **Languages:** Typescript
- **Platforms:** Docker, Docker Compose
- **Tags:** Mcp, Prowlarr, Radarr, Sonarr, Web Scraping, Jackett, Bun, Typescript, Docker, Self Hosted, Scraper, Scraping, Cloudflare, Cloudflare bypass, Anti bot, Flaresolverr, Selfhosted, Arr, Camoufox, Captcha Bypass, Captcha Solver, Flaresolverr Alternative, Byparr, Anti Detection

## Description

TRAWL is a self-hosted web scraping engine designed for applications and AI agents. It starts with HTTP requests and only opens a browser (Camoufox Firefox) when needed to solve challenges like Cloudflare, Turnstile, reCAPTCHA, hCaptcha, GeeTest, and others. It features an adaptive tier engine that reuses accepted clearance sessions for fast repeat requests, supports FlareSolverr-compatible API for *arr stack integration (Prowlarr, Jackett, Sonarr, Radarr, etc.), provides MCP (Model Context Protocol) tools for AI agents, isolated browser sessions, a local metrics dashboard, and a challenge-aware HTTP/HTTPS forward proxy. It runs via Docker with optional Redis for session caching.

## Links

- [Homepage](https://github.com/germondai/trawl)
- [Website](https://trawl.germondai.com)
- [Docker](ghcr.io/germondai/trawl)
- [Documentation](https://docs.trawl.germondai.com)
- [GitHub](https://github.com/germondai/trawl)

---
Source: https://selfhost.directory/project/trawl