Self-host AReno
v0.10.0Single-node LLM RL post-training toolkit
- Stars
- 381
- Port
- 8000 (OpenAI-compatible model serving endpoint)
- Requires
- CUDA
ghcr.io/inclusionai/arenoWhat is AReno?
AReno is a compact toolkit for training and serving large language models using reinforcement learning on a single machine. Created by engineers at Ant Group's inclusionAI team, it bundles everything needed for post-training — multiple RL algorithms, an agent loop, efficient adapter methods, and a model server — into one package that runs on NVIDIA GPUs, Huawei NPUs, or Apple Silicon. You install it via a script, Docker, or pip, then use a command-line interface or Python SDK to run training jobs. A web dashboard can track experiments locally or on Modal's cloud platform. The code is Apache-2.0 licensed and under active development.
Should you self-host AReno?
AReno scores 49/100 on selfhost.directory (how scoring works) and ranks #53 of 125 in AI. It has 381 GitHub stars.
It shipped 10 stable releases in the past year. The latest, v0.10.0, came out on 23 October 2026. New versions land roughly every 2 weeks.
Setup is advanced: plan for several services and some ongoing maintenance. An official Docker image is available. It is Apache-2.0-licensed and written mostly in Python.
Its closest alternative on selfhost.directory is ComfyUI (93/100, 143 701 stars). It scores higher overall, so compare the two before you pick. See AReno vs ComfyUI side by side.
Features
- Agentic RL
- Auto Memory Tuning
- Extensible plugin system
- JEV Decision Heads
- Multiple Hardware Backends
- Native LoRA
- OpenAI-Compatible Serving
- QLoRA
- RL Post-Training Algorithms
AReno README
FAQ
Should examples be copied from Cookbook or Reference?
Start from Cookbook for runnable recipes. Use Reference when you already know which command, SDK type, or API contract you need.
Where should I start after installation?
Run the Quickstart guide, then choose the RLVR or agentic rollout path that matches your task.
Is FlashAttention required?
FlashAttention is optional unless the selected attention backend requires it. Use --attn-backend native when debugging unsupported FlashAttention setups.
More in LLM Inference
Atomic ChatSelf-hosted desktop/mobile app for running LLMs locally with OpenAI-compatible API. 1000+ models, multiple engines, MCP, agent launching.
distributed-llamaDistributed LLM inference tool connecting home devices into clusters using tensor parallelism over Ethernet for accelerated performance.
exllamaOpen-source Python/C++/CUDA runner for 4-bit GPTQ-quantized Llama models on consumer NVIDIA GPUs, with a self-hosted chat web UI you can build and run in Docker.
exoSelf-hosted, open-source AI cluster that links your Macs and Linux boxes to run large LLMs locally via MLX, with Thunderbolt 5 RDMA and an OpenAI/Ollama-compatible API.
FastChatSelf-hosted, open-source LLM serving platform: run open chat models behind a Gradio web UI, a CLI, or an OpenAI-compatible REST API.
FreeLLMAPI7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.
GaiaNet NodeOpen-source, self-hosted GaiaNet node: pick any Hugging Face LLM, add a RAG knowledge base, serve an OpenAI-compatible API and web chat UI.
ggrunggrun is a self-hosted terminal UI for discovering, downloading, and running local GGUF models with automatic multi-GPU memory placement and an OpenAI-compatible API.
gpustackOpen-source, self-hosted GPU cluster manager that deploys LLMs on NVIDIA, AMD or Ascend hardware via vLLM, SGLang and TensorRT-LLM behind OpenAI-compatible APIs.
jevosOpen-source, self-hosted decision model answering yes/no, choice and score questions with probabilities on a laptop CPU in 28-130 ms, an alternative to Jev's cloud.
koboldcppSelf-hosted, open-source (AGPL-3.0) single-file GGUF LLM server with a bundled KoboldAI Lite web UI and OpenAI-, KoboldAI- and Ollama-compatible API endpoints.
lemonadeSelf-hosted, open-source local AI server that runs LLM, vision, image, speech, and transcription models on your own GPU or NPU and serves them through OpenAI-style APIs.
0 comments