selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

datalab-to logo

surya-ocr-2.5

datalab-to·Instruct·released 25 Oct 2026

OpenRAIL689M256K ctx ≈2.0 GB
Runs on CPU or any GPU≈1.3 GB of weights
ollama run hf.co/datalab-to/surya-ocr-2.5-gguf:Q8_0
All 6 runners ↓

We also ship smaller models for line-level text detection and ocr error detection. It works on a range of documents (see usage and benchmarks).

How much VRAM does surya-ocr-2.5 need?

At FP16 / BF16 surya-ocr-2.5 needs about 2.0 GB of GPU memory.

--vram
any
--gpus
--quant
QuantisationWeightsTotal
4-bitRecommended default for local use0.4 GB est.≈1.0 GB
8-bitLossless in practice, twice the size of Q40.6 GB file≈1.2 GB
FP16 / BF16recommendedFull precision, as released1.3 GB est.≈2.0 GB

Estimates for the weights plus runtime overhead; activations vary with resolution and batch size. Pick a GPU above and the fit column checks every row against it. Weights marked “file” use the real GGUF download size; “est.” rows are computed from the parameter count.

Can the RTX 4060 run surya-ocr-2.5? →

Run surya-ocr-2.5 locally

--quantQ8_0default; pick your GPU to tailor itdatalab-to/surya-ocr-2.5-gguf

Q8_0 straight from Hugging Facedocs
ollama run hf.co/datalab-to/surya-ocr-2.5-gguf:Q8_0

Install Ollama

OpenAI-compatible server with a web UIdocs
llama-server -hf datalab-to/surya-ocr-2.5-gguf:Q8_0

Downloads the GGUF on first run. Installed through llama.app? The same flags work with `llama serve`.

Install llama.cpp

Download with the lms CLIdocs
lms get datalab-to/surya-ocr-2.5-gguf@Q8_0

Then load it from the LM Studio app or with `lms load`.

Install LM Studio

Serve an OpenAI-compatible APIdocs
vllm serve datalab-to/surya-ocr-2.5
Docker Compose (NVIDIA)docs
yaml
services:
  vllm:
    image: vllm/vllm-openai:latest
    command: datalab-to/surya-ocr-2.5
    ports:
      - "8000:8000"
    ipc: host
    volumes:
      - ~/.cache/huggingface:/root/.cache/huggingface
    deploy:
      resources:
        reservations:
          devices:
            - driver: nvidia
              count: all
              capabilities: [gpu]

API on port 8000.

Install vLLM

Serve an OpenAI-compatible APIdocs
sglang serve datalab-to/surya-ocr-2.5 --host 0.0.0.0 --port 30000
Docker Compose (NVIDIA)docs
yaml
services:
  sglang:
    image: lmsysorg/sglang:latest
    command: sglang serve datalab-to/surya-ocr-2.5 --host 0.0.0.0 --port 30000
    ports:
      - "30000:30000"
    ipc: host
    volumes:
      - ~/.cache/huggingface:/root/.cache/huggingface
    deploy:
      resources:
        reservations:
          devices:
            - driver: nvidia
              count: all
              capabilities: [gpu]

API on port 30000.

Install SGLang

Ask about an imagedocs
python
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="datalab-to/surya-ocr-2.5", dtype="auto", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/bee.jpg"},
            {"type": "text", "text": "Describe this image."},
        ],
    }
]
out = pipe(text=messages, max_new_tokens=256)
print(out[0]["generated_text"][-1]["content"])

Install Transformers

  • Jancommunity · desktop app
  • KoboldCpp logoKoboldCppcommunity · desktop app
  • LocalAI logoLocalAIcommunity · inference server

Quantised versions and downloads

RepositoryFormatQuantSizeDownloads
datalab-to/surya-ocr-2.5-ggufGGUFQ8_00.6 GB140.4K
fwgpiyawudk/surya-ocr-2.5-mlx-4bitMLX4BIT—107
kltng/surya-ocr-2.5-mlx-8bitMLX8BIT—228
fwgpiyawudk/surya-ocr-2.5-mlx-8bitMLX8BIT—104

About surya-ocr-2.5

We also ship smaller models for line-level text detection and ocr error detection. It works on a range of documents (see usage and benchmarks). Our managed platform runs both Surya, and variants of our highest accuracy model, Chandra. Get started with $5 in free credits — sign up (takes under 30 seconds) or try our free public playground. Surya is named for the Hindu sun god, who has universal vision. Each row links to four annotated views of the same page: text-line detection, OCR, layout and reading order (Surya 2.5). The example pages are public pages from OmniParseBench. The newspaper (The Alpha, 1881), reference book and math paper are from olmOCR-bench (Ai2, ODC-BY 1.0). The government form is a US federal form (public domain). The handwritten letter is from the Library of Congress, Manuscript Division, Carrie Chapman Catt Papers (public domain). The corporate page is from ParseBench (Apache 2.0). The Japanese form is made from a form of the National Tax Agency, Japan, under the Public Data License 1.0: 「国税庁の様式」(国税庁)(https://www.nta.go.jp/)を加工して作成. The OCR column renders Surya 2.5's HTML output; layout and reading order are drawn from its blocks, and the detection image is from the text-line detector.

Full model card on Hugging Face →

Alternatives to surya-ocr-2.5

All alternatives →
datalab-to logo

surya-ocr-2

datalab-to·OCR

≈2.0 GB

It works on a range of documents (see usage and benchmarks).

686M256K ctx OpenRAIL
615.2KMay 2026gguf
ATH-MaaS logo

OvisOCR3

ATH-MaaS·OCR

≈2.4 GB

OvisOCR3 is a unified 0.8B multimodal model for OCR and document understanding. It integrates document parsing, general OCR, key information extraction, document figure captioning, and cross-page table reconstruction into a single compact model.

853M256K ctx Apache 2.0
406.6KOct 2026gguf
lightonai logo

LightOnOCR-2-1B

lightonai·OCR

≈2.8 GB

Best OCR model . LightOnOCR-2-1B is LightOn's flagship OCR model, refined with RLVR training for maximum accuracy. We recommend this variant for most OCR tasks.

1B16K ctx Apache 2.0
699.7KJan 2026gguf
lightonai logo

LightOnOCR-3-0.8B

lightonai·OCR

≈2.4 GB

Smallest model. LightOnOCR-3-0.8B is the lightest model of LightOn's LightOnOCR-3 family, with the same layout and visual understanding features.

853M256K ctx Apache 2.0
15KOct 2026gguf
ATH-MaaS logo

OvisOCR2

ATH-MaaS·OCR

≈2.4 GB

We are pleased to announce the release of OvisOCR2, a compact 0.8B end-to-end model for page-level document parsing. Given a document page image, OvisOCR2 generates a Markdown representation in natural reading order, covering text, formulas, tables, and visual regions.

853M256K ctx Apache 2.0
24.4KJul 2026gguf
PaddlePaddle logo

PaddleOCR-VL-1.6

PaddlePaddle·OCR

≈2.6 GB

PaddleOCR-VL-1.6: Expanding the Frontier of Document Parsing with Under-Optimized Region Refinement and Progressive Post-Training

959M128K ctx Apache 2.0
96.9KMay 2026gguf

surya-ocr-2.5 FAQ

How much VRAM does surya-ocr-2.5 need?
About 2.0 GB at FP16 / BF16.
Can surya-ocr-2.5 run on the RTX 4060?
Yes. It fits at FP16 / BF16 (about 2.0 GB). It fits comfortably on the Apple M4 (16 GB), Radeon RX 6700 XT, RTX 3060 12GB.
Can I use surya-ocr-2.5 commercially?
Yes, with conditions. It is released under OpenRAIL. Commercial use allowed, but with use-based restrictions that pass on to derivatives.
How do I run surya-ocr-2.5 with Ollama or llama.cpp?
With Ollama: ollama run hf.co/datalab-to/surya-ocr-2.5-gguf:Q8_0. With llama.cpp: llama-server -hf datalab-to/surya-ocr-2.5-gguf:Q8_0, which starts an OpenAI-compatible server.

Data from Hugging Face, the model card and public leaderboards. Memory and speed figures are estimates; real numbers depend on the runtime, context length and drivers. Always check the licence yourself before commercial use.