# GLiDE-27B

> Inference provider: Fastino — use GLiDE through Fastino's hosted API (POST https://api.fastino.ai/v1/systemone, model fastino/GLiDE). Get an API key · API documentation

- **Organisation:** fastino
- **Category:** Vision-Language Models
- **Parameters:** 26.1B
- **Context length:** 262,144 tokens
- **Licence:** fastino-community (Commercial use with conditions)
- **Released:** 2026-10-19
- **Hugging Face:** 3.7K downloads (30 days), 106 likes

## Estimated memory

| Quant | ≈ GB |
|---|---|
| Q2_K | 10.89 |
| Q3_K_M | 14.97 |
| Q4_K_M | 17.96 |
| Q5_K_M | 20.64 |
| Q6_K | 23.51 |
| Q8_0 | 29.6 |
| F16 | 53.52 |

## Runs with

- [llama.cpp](https://selfhost.directory/project/llamacpp)
- [SGLang](https://selfhost.directory/project/sglang)
- [Transformers](https://github.com/huggingface/transformers)
- [vLLM](https://selfhost.directory/project/vllm)

## About

Inference provider: Fastino — use GLiDE through Fastino's hosted API (POST https://api.fastino.ai/v1/systemone, model fastino/GLiDE). Get an API key · API documentation

GLiDE 27B is a 27B GLiDE decision model. It scores 72.49 on the Decision Index 0.3.1 public suite, measured with the official kit on one RTX PRO 6000, with a median latency of 112 ms per request on that GPU. Weights and compute are bf16.

GLiDE is a decision model from Fastino . Given a state (text or JSON, optionally with images) and one or more typed questions, it returns a probability for every option of every question.

Use GLiDE through Fastino’s hosted API for classification, routing, and scoring. Send decision requests to POST https://api.fastino.ai/v1/systemone with model fastino/GLiDE. Create an account and get an API key , or follow the API quickstart . The instructions below cover running this repository locally.

## Alternatives

- [Qwen/Qwen3.8-27B](https://selfhost.directory/models/qwen/qwen3.8-27b) (27.8B, Apache 2.0, ≈18.97 GB at Q4): Following the widespread community adoption of the Qwen3.5 and Qwen3.6 series, we are pleased to introduce Qwen3.8, the most capable generation in the Qwen open-model family to date.
- [google/gemma-4-26B-A4B-it](https://selfhost.directory/models/google/gemma-4-26b-a4b-it) (25.8B (4B active), Apache 2.0, ≈17.67 GB at Q4): Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants.
- [Qwen/Qwen3.6-27B](https://selfhost.directory/models/qwen/qwen3.6-27b) (27.8B, Apache 2.0, ≈18.97 GB at Q4): Following the February release of the Qwen3.5 series, we're pleased to share the first open-weight variant of Qwen3.6. Built on direct feedback from the community, Qwen3.6 prioritizes stability and real-world utility, offering developers a more intuitive, responsive, and genuinely productive coding…
- [google/gemma-4-31B-it](https://selfhost.directory/models/google/gemma-4-31b-it) (31.3B, Apache 2.0, ≈26.54 GB at Q4): Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants.
- [google/diffusiongemma-26B-A4B-it](https://selfhost.directory/models/google/diffusiongemma-26b-a4b-it) (25.8B (4B active), Apache 2.0, ≈17.68 GB at Q4): DiffusionGemma is a generative model built by Google DeepMind. Based on the 26B A4B Mixture-of-Experts (MoE) Gemma 4 architecture, DiffusionGemma generates tokens using discrete diffusion. This open-weights model is multimodal, handling text, image, and video inputs to generate text output.
- [Qwen/Qwen3.5-27B](https://selfhost.directory/models/qwen/qwen3.5-27b) (27.8B, Apache 2.0, ≈18.97 GB at Q4): Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance.

More: https://selfhost.directory/models/fastino/glide-27b/alternatives

## Runs well on

- [Tesla P40](https://selfhost.directory/models/fastino/glide-27b/on/tesla-p40): Q5_K_M, est. 10 tok/s
- [Radeon RX 7900 XTX](https://selfhost.directory/models/fastino/glide-27b/on/rx-7900-xtx): Q5_K_M, est. 28 tok/s
- [Instinct MI50 32GB](https://selfhost.directory/models/fastino/glide-27b/on/instinct-mi50): Q8_0, est. 20 tok/s
- [GeForce RTX 5090](https://selfhost.directory/models/fastino/glide-27b/on/rtx-5090): Q8_0, est. 36 tok/s
- [Apple M4 Pro (48 GB)](https://selfhost.directory/models/fastino/glide-27b/on/apple-m4-pro-48gb): Q8_0, est. 5.4 tok/s
- [RTX A6000](https://selfhost.directory/models/fastino/glide-27b/on/rtx-a6000): Q8_0, est. 15 tok/s

## Similar size

- [Qwen/Qwen3.8-27B](https://selfhost.directory/models/qwen/qwen3.8-27b) (27.8B)
- [google/gemma-4-31B-it](https://selfhost.directory/models/google/gemma-4-31b-it) (31.3B)
- [google/gemma-4-26B-A4B-it](https://selfhost.directory/models/google/gemma-4-26b-a4b-it) (25.8B)
- [Qwen/Qwen3.6-27B](https://selfhost.directory/models/qwen/qwen3.6-27b) (27.8B)
- [google/gemma-3-27b-it](https://selfhost.directory/models/google/gemma-3-27b-it) (27.4B)
- [meta-models/Muse-Glimmer-30B](https://selfhost.directory/models/meta-models/muse-glimmer-30b) (29.8B)

## FAQ

**How much VRAM does GLiDE-27B need?**
About 18 GB at Q4_K_M with an 8K context. Q8_0 needs about 30 GB and full precision about 54 GB. Longer contexts need more memory for the KV cache.

**Can GLiDE-27B run on the Tesla P40?**
Yes. It fits at Q5_K_M (about 21 GB), at an estimated 10 tokens/s. It fits comfortably on the Radeon RX 7900 XTX, Instinct MI50 32GB, RTX 5090.

**Can I use GLiDE-27B commercially?**
Yes, with conditions. It is released under fastino-community. Custom licence: read the model card before using it commercially.

**What is the context length of GLiDE-27B?**
262,144 tokens (256K). The full window needs far more memory than an 8K context.

**How do I run GLiDE-27B with llama.cpp?**
Run llama-server -hf seamon67/GLiDE-27B-GGUF:Q4_K_M. It downloads the GGUF and starts an OpenAI-compatible server.

## Links

- huggingface: https://huggingface.co/fastino/GLiDE-27B

---
Source: https://selfhost.directory/models/fastino/glide-27b