selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

ATH-MaaS logo

Can the Apple M4 (16 GB) run OvisOCR3?

OvisOCR3·853M·Apple M4 (16 GB)·16 GB unified memory

Saved in this browser, used on every model page.
Yes

Yes. The Apple M4 (16 GB) runs OvisOCR3 fully in unified memory at FP16 / BF16 (about 2.2 GB of 11 GB).

best quant
FP16 / BF16
needs
2.2 GB
usable
11 GB

Estimates from the model's size.Try other contexts on the OvisOCR3 page →

Every quantisation of OvisOCR3 on the Apple M4 (16 GB)

QuantMemoryFit
Q4_K_M 1.1 GBfits
Q8_0 1.4 GBfits
FP16 / BF16 pick2.2 GBfits

Speed is a bandwidth-based estimate for generating text (120 GB/s); prompt processing and long contexts are slower.

Run OvisOCR3 on the Apple M4 (16 GB)

Using FP16 / BF16, the best fit for Apple M4 (16 GB).

Ollama · F16 straight from Hugging Facedocs
ollama run hf.co/mradermacher/OvisOCR3-GGUF:F16
llama.cpp · OpenAI-compatible server with a web UIdocs
llama-server -hf mradermacher/OvisOCR3-GGUF:F16

brew install llama.cpp ships with Metal. Downloads the GGUF on first run.

LM Studio · Download with the lms CLIdocs
lms get mradermacher/OvisOCR3-GGUF@F16

Then load it from the LM Studio app or with `lms load`.

Transformers · Ask about an imagedocs
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="ATH-MaaS/OvisOCR3", dtype="auto", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/bee.jpg"},
            {"type": "text", "text": "Describe this image."},
        ],
    }
]
out = pipe(text=messages, max_new_tokens=256)
print(out[0]["generated_text"][-1]["content"])

OCR models that fit the Apple M4 (16 GB) comfortably

All that fit →
ModelParamsBest quantMemoryLicence
PaddlePaddle logoPaddleOCR-VL-1.6PaddlePaddle
959MFP16 / BF16≈2.6 GBFits in memoryCommercial OK
PaddlePaddle logoPaddleOCR-VLPaddlePaddle
959MFP16 / BF16≈2.6 GBFits in memoryCommercial OK
tencent logoHunyuanOCRtencent
1.1BFP16 / BF16≈3.0 GBFits in memoryConditions
1BFP16 / BF16≈2.8 GBFits in memoryCommercial OK
853MFP16 / BF16≈2.4 GBFits in memoryCommercial OK
datalab-to logosurya-ocr-2.5datalab-to
689MFP16 / BF16≈2.0 GBFits in memoryConditions

Other GPUs that run OvisOCR3

Frequently asked questions

Can the Apple M4 (16 GB) run OvisOCR3?
Yes. The Apple M4 (16 GB) runs OvisOCR3 fully in unified memory at FP16 / BF16 (about 2.2 GB of 11 GB).
Which quantisation of OvisOCR3 should I use on the Apple M4 (16 GB)?
FP16 / BF16: the largest one that fits. Expected quality: lossless compared with the full-precision weights.

Memory and speed are estimates from the model's size and the card's memory bandwidth; real numbers depend on the runtime, drivers and context length. Community figures are medians of user reports.