selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

Sosse logo

Self-host Sosse

v1.14.2

Selenium-based search engine for web archiving and crawling

ReleaseOpen SourceAGPL-3.0
Updatedlast year
LanguagePython
Setup difficultyAdvanced
Stars
408
Port
80 (HTTP web interface)
Requires
Firefox or Chromium, PostgreSQL
Docker
biolds/sosse
Install with Docker
Search results pageOffline browsing of archived pagesFile scraping and download interfaceIndex analytics dashboardTagging and filtering interfaceReal-time crawling status queueCollections setup and managementArchive browsing home page

What is Sosse?

Sosse is a self-hosted search engine and web crawler written in Python that uses Selenium with Firefox or Chromium to crawl and index dynamically rendered web pages. It stores data in PostgreSQL and provides a web interface for searching, browsing archived pages, managing crawl jobs, and configuring automated workflows via webhooks. Key capabilities include recurring crawls with adaptive scheduling, full-page archiving with asset downloading, tag-based organization, batch file downloads, Atom feed generation for sites without feeds, and fine-grained permissions for admin and user roles. It can be deployed via Docker, Docker Compose, Debian packages, or pip, and integrates with external services like Discord or AI platforms through its flexible webhook system.

Should you self-host Sosse?

Sosse scores 52/100 on selfhost.directory (how scoring works) and ranks #25 of 41 in Search Engines. It has 408 GitHub stars.

There was no stable release in the past 12 months, so check the repository's recent activity before you rely on it.

Setup is advanced: plan for several services and some ongoing maintenance. An official Docker image is available. It is AGPL-3.0-licensed and written mostly in Python.

Its closest alternative on selfhost.directory is SearXNG (86/100, 38 940 stars). It scores higher overall, so compare the two before you pick. See Sosse vs SearXNG side by side.

Features

  • Analytics
  • Atom Feeds
  • Collections
  • Crawler authentication
  • External search shortcuts
  • File Downloads
  • Permissions System
  • Recurring crawling
  • REST API
  • Search History
  • Tagging
  • Webhooks
  • Web page archiving
  • Web page search

Sosse README

How to install Sosse

Install Sosse with Docker

Docker, PostgreSQL (included in container)

docker run -p 8005:80 --mount source=sosse_postgres,destination=/var/lib/postgresql
--mount source=sosse_var,destination=/var/lib/sosse biolds/sosse:latest

Persists data in Docker volumes sosse_postgres and sosse_var

More in Search Engines

Rate this project

Click to rate — no account needed.

0 comments

Posting as guest
Loading comments…