selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

GitHub
audio.cpp logo

Self-host audio.cpp

v0.9.5

High-performance C++ audio inference for local AI models

BetaOpen SourceApache-2.0
Updated2 days ago
LanguageC++
Setup difficultyAdvanced
Stars
4 309
Port
8080 (HTTP server and WebUI)
Docker
ghcr.io/0xshug0/audio.cpp
Install with Docker

What is audio.cpp?

This C++ inference framework builds on ggml to run modern audio AI models locally without Python. It covers over 110 model families across TTS, STT, voice cloning, conversion, music generation, separation, VAD, diarization, alignment, and codec tasks. You get a CLI, an HTTP server with OpenAI-compatible endpoints, and an embedded WebUI — all from a single binary. It works on Windows, Linux, and macOS using CUDA, AMD ROCm, Vulkan, Metal, or CPU backends. Daily Docker images are on ghcr.io. Licensed Apache-2.0 with no external service dependencies; models load from local GGUF or safetensors files. The server defaults to port 8080 and supports lazy loading, residency limits, and streaming where models allow.

audio.cpp alternatives

Should you self-host audio.cpp?

audio.cpp scores 75/100 on selfhost.directory (how scoring works) and ranks #14 of 123 in AI. It has 4 309 GitHub stars, +474 in the last 30 days.

It shipped 11 stable releases in the past year. The latest, v0.9.5, came out on 14 November 2026. New versions land roughly every 7 days.

Setup is advanced: plan for several services and some ongoing maintenance. An official Docker image is available. It is Apache-2.0-licensed and written mostly in C++.

Its closest alternative on selfhost.directory is openclaw (93/100, 394 614 stars). It scores higher overall, so compare the two before you pick. See audio.cpp vs openclaw side by side.

Features

  • GGUF Model Format
  • JSON PipelinesExperimental
  • Multi-backend Support
  • Music Generation
  • Source Separation
  • Speech-to-Text (ASR)
  • Streaming Inference
  • Text-to-Speech (TTS)
  • Voice Cloning
  • Voice Conversion

audio.cpp README

audio.cpp

0xShug0%2Faudio.cpp | Trendshift 0xShug0/audio.cpp | Trendshift

audio.cpp is a high-performance C++ audio inference framework built on top of ggml, designed to make modern local audio models practical, portable, and fast.

Tired of juggling a dozen Conda environments, hundreds of Python packages, and dependency conflicts just to try a few audio models? audio.cpp gives those paths a shared native runtime instead. Runs on Windows, Linux, and macOS, with support for NVIDIA, AMD, Apple Silicon, and CPU-only machines.

How to install audio.cpp

Install audio.cpp with Docker

Docker, NVIDIA container toolkit (for CUDA)

docker run --rm --gpus all -v ":/models:ro" ghcr.io/0xshug0/audio.cpp:full-cuda12 <cli|server> --model /models/ <...>

CUDA variant requires NVIDIA container toolkit. Also available: full-cuda13, full-vulkan, full-cpu, full-rockchip (arm64).

How to configure audio.cpp

  • host127.0.0.1Server bind address
  • port8080Server listen port
  • backendcpuInference backend

    values: cuda, cpu, hip, rocm, vulkan, metal

  • device0Backend device index
  • threads4Backend/OpenMP worker threads

audio.cpp releases & version history

@ Every self-hosted release, weekly

One Monday email with the week's stable releases across the directory.

More in AI

Rate this project

Click to rate — no account needed.

0 comments

Posting as guest
Loading comments…