selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

jevos logo

Self-host jevos

jevos-v5

Yes/no, choice and score decisions from a local CPU model

ReleaseOpen SourceMIT
Updatedlast week
LanguageC++
Setup difficultyEasy
Stars
926
Port
8017 (HTTP API server (POST /v1/systemone, GET /health))
Install with Linux

What is jevos?

jevos is a small decision model plus a single server binary that gives probabilistic answers to yes/no questions, multiple-choice routing and scored ratings, and it speaks the TypeSafe Jev wire format so existing Jev SDK code keeps running locally. It targets rule-driven decisions (refund eligibility, ticket routing, tone scoring) done entirely on your own hardware: inference is CPU-only, in roughly 28-130 ms per request, with an 8,192-token context and about 1 GB of memory. The server exposes POST /v1/systemone and a /health endpoint, can answer one-shot decisions from a request file without running as a service, and accepts an optional bearer key; the model also ships as GGUF for llama.cpp and as an OpenVINO INT8 build. Installation means downloading the release archive for Windows, Linux or macOS (Apple silicon), placing the model beside the binary, and launching ./jev serve. The project is MIT-licensed; in the author's own benchmarks it is much faster and free versus Jev's cloud API but less accurate on the harder tasks, so they advise validating it against your own questions first, and the score output type is still marked early.

Should you self-host jevos?

jevos scores 50/100 on selfhost.directory (how scoring works) and ranks #4 of 7 in Local AI. It has 926 GitHub stars.

It shipped 4 stable releases in the past year. The latest, jevos-v5, came out on 17 October 2026. New versions land roughly every 2 days.

Setup is easy: most people get it running in one sitting. It is MIT-licensed and written mostly in C++.

Its closest alternative on selfhost.directory is unsloth (85/100, 78 667 stars). It scores higher overall, so compare the two before you pick. See jevos vs unsloth side by side.

Features

  • 8,192-token context
  • API key protection
  • Confidence output
  • Health endpoint
  • Jev-compatible REST API
  • Local CPU inference
  • Multiple-choice classification
  • Offline CLI decisions
  • Scored ratingsListed as "✓ (early)" in the project's own comparison table.
  • Yes/no probability answers

jevos README

How to install jevos

Install jevos with Linux

Windows, Linux, macOS on Apple silicon
Environment variables
JEV_API_KEY
tar -xzf jev-linux-x64.tar.gz                 # Windows: unzip jev-windows-x64.zip
cd jev
unzip ../jevos-v5-openvino-int8.zip           # creates model/
./jev serve                                   # Windows: jev.exe serve

Archive for your system plus the OpenVINO INT8 model zip, taken from the GitHub release; the model can also be fetched with `hf download feder-cr/jev --include "model/*" --local-dir jev`.

How to configure jevos

  • --host127.0.0.1Address the server listens on.

    Address the server listens on.

  • JEV_API_KEYWhen set, every call except /health must carry an Authorization: Bearer <key> header.

    When set, every call except /health must carry an Authorization: Bearer <key> header.

  • --model-dirmodel beside the binary
  • --port8017Port the server listens on.

    Port the server listens on.

  • --threadsall logical CPUs

jevos releases & version history

More in LLM Inference

Rate this project

Click to rate — no account needed.

0 comments

Posting as guest
Loading comments…