selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

GitHub
nextjs-vllm-ui logo

Self-host nextjs-vllm-ui

0.1.0

Web UI for vLLM and Ollama LLMs

AlphaOpen SourceMIT
Updated4 months ago
LanguageTypescript
Setup difficultyModerate
MobileResponsive
ThemeDark mode
Stars
185
Port
3000 (HTTP web interface)
Requires
Node.js
Docker
ghcr.io/yoziru/nextjs-vllm-ui
Install with Docker
nextjs-vllm-ui screenshot 1

What is nextjs-vllm-ui?

nextjs-vllm-ui is a self-hosted web interface for interacting with large language models served by vLLM or Ollama. Built with Next.js, Tailwind CSS, and shadcn/ui, it offers a ChatGPT-inspired UI with features like code syntax highlighting, copy-to-clipboard for code blocks, chat history stored in localStorage, and light/dark mode switching. The project requires a running vLLM or Ollama instance and can be deployed via Docker (ghcr.io/yoziru/nextjs-vllm-ui) or run locally with Node.js 18+ and the Aube package manager. No database is needed as chats are stored in the browser's localStorage. The project is a fork of nextjs-ollama-llm-ui and is licensed under MIT.

Should you self-host nextjs-vllm-ui?

nextjs-vllm-ui scores 41/100 on selfhost.directory (how scoring works) and ranks #53 of 69 in AI Chat. It has 185 GitHub stars.

There was no stable release in the past 12 months, so check the repository's recent activity before you rely on it.

Setup is moderate: expect some configuration beyond a single command. An official Docker image is available. It is MIT-licensed and written mostly in Typescript.

Its closest alternative on selfhost.directory is LibreChat (85/100, 46 421 stars). It scores higher overall, so compare the two before you pick. See nextjs-vllm-ui vs LibreChat side by side.

Features

  • Chat History
  • Chat Interface
  • Code syntax highlighting
  • Copy code blocks
  • Local Storage

nextjs-vllm-ui README

How to install nextjs-vllm-ui

Install nextjs-vllm-ui with Docker

Environment variables
VLLM_URL, VLLM_API_KEY, VLLM_MODEL, VLLM_TOKEN_LIMIT

docker run --rm -d -p 3000:3000 -e VLLM_URL=http://host.docker.internal:8000 ghcr.io/yoziru/nextjs-vllm-ui:latest

For Ollama, also set VLLM_MODEL, VLLM_TOKEN_LIMIT

How to configure nextjs-vllm-ui

  • VLLM_API_KEYAPI key for vLLM authentication

    API key for vLLM authentication

  • VLLM_MODELModel name to use (required for Ollama)

    Model name to use (required for Ollama)

  • VLLM_TOKEN_LIMIT4096Token limit for the model

    Token limit for the model

  • VLLM_URLhttp://localhost:8000URL of the vLLM or Ollama API endpoint

    URL of the vLLM or Ollama API endpoint

More in LLM Integration

Rate this project

Click to rate — no account needed.

0 comments

Posting as guest
Loading comments…