selfhost.directory

The index of self-hostable projects — ranked, categorized and served with live updates.
Own your data and stop giving it to big tech.

tencent logo

Can the Radeon RX 7800 XT run WeVisCut?

WeVisCut·9.4B·Radeon RX 7800 XT·16 GB VRAM

Saved in this browser, used on every model page.
Yes

Yes. The Radeon RX 7800 XT runs WeVisCut fully in VRAM at Q8_0 (about 11 GB of 16 GB), at roughly 34 tokens/s.

best quant
Q8_0
needs
11 GB
usable
16 GB
est. speed
~34 tok/s

Estimates for an 8K context; offload assumes 32 GB of system RAM.Try other contexts on the WeVisCut page →

Every quantisation of WeVisCut on the Radeon RX 7800 XT

QuantQualityMemoryFitSpeed
Q2_K Heavy loss4.5 GBfits~111 tok/s
Q3_K_M Noticeable loss6.0 GBfits~75 tok/s
Q4_K_M Small loss7.0 GBfits~60 tok/s
Q5_K_M Near-lossless7.8 GBfits~51 tok/s
Q6_K Near-lossless8.7 GBfits~44 tok/s
Q8_0 pickLossless11 GBfits~34 tok/s
FP16 / BF16 Lossless19 GBoffload~7.3 tok/s

Speed is a bandwidth-based estimate for generating text (624 GB/s); prompt processing and long contexts are slower.

Measured speed on the Radeon RX 7800 XT

No community reports for this pair yet.

Report your own speed →

Run WeVisCut on the Radeon RX 7800 XT

Using Q8_0, the best fit for Radeon RX 7800 XT.

llama.cpp · OpenAI-compatible server with a web UIdocs
llama-server -hf prithivMLmods/tencent-WeVisCut-GGUF:Q8_0

Needs a HIP (ROCm) build of llama.cpp. Downloads the GGUF on first run.

llama.cpp · Docker with ROCm (AMD)docs
docker run -d --name llama --device /dev/kfd --device /dev/dri -p 8080:8080 \
  -v ~/.cache/llama.cpp:/root/.cache/llama.cpp \
  ghcr.io/ggml-org/llama.cpp:server-rocm \
  -hf prithivMLmods/tencent-WeVisCut-GGUF:Q8_0 --host 0.0.0.0 --port 8080 -ngl 99

Server and web UI on port 8080.

vLLM · Serve an OpenAI-compatible APIdocs
vllm serve tencent/WeVisCut

Needs vLLM built for ROCm; it supports Instinct MI200/MI300 and Radeon RX 7900 / 9000 cards.

vLLM · Docker Compose (AMD ROCm)docs
services:
  vllm:
    image: rocm/vllm:latest
    command: vllm serve tencent/WeVisCut --host 0.0.0.0 --port 8000
    ports:
      - "8000:8000"
    ipc: host
    devices:
      - /dev/kfd
      - /dev/dri
    group_add:
      - video
    security_opt:
      - seccomp=unconfined
    volumes:
      - ~/.cache/huggingface:/root/.cache/huggingface

AMD’s rocm/vllm image. API on port 8000.

SGLang · Serve an OpenAI-compatible APIdocs
sglang serve tencent/WeVisCut --host 0.0.0.0 --port 30000

Needs SGLang’s ROCm build (Instinct MI300-class GPUs).

Omni models that fit the Radeon RX 7800 XT comfortably

All that fit →
ModelParamsBest quantMemorySpeedLicence
9.4BQ8_0≈10 GBFits in memory~34 tok/sCommercial OK
8BQ8_0≈9.2 GBFits in memory~40 tok/sCommercial OK
10.7BQ8_0≈8.9 GBFits in memory~30 tok/sCommercial OK
9.1BQ8_0≈10 GBFits in memory~36 tok/sCommercial OK
12BQ6_K≈13 GBFits in memory~35 tok/sCommercial OK
8.3BQ8_0≈10 GBFits in memory~39 tok/sCheck licence

Other GPUs that run WeVisCut

Frequently asked questions

Can the Radeon RX 7800 XT run WeVisCut?
Yes. The Radeon RX 7800 XT runs WeVisCut fully in VRAM at Q8_0 (about 11 GB of 16 GB), at roughly 34 tokens/s.
How fast does WeVisCut run on the Radeon RX 7800 XT?
An estimate from memory bandwidth gives about 34 tokens/s at Q8_0.
Which quantisation of WeVisCut should I use on the Radeon RX 7800 XT?
Q8_0: the largest one that fits. Expected quality: lossless compared with the full-precision weights.

Memory and speed are estimates from the model's size and the card's memory bandwidth; real numbers depend on the runtime, drivers and context length. Community figures are medians of user reports.