# Inkling-2-Mini

> Inkling 2 Mini is a general-purpose multimodal model that accepts text and image inputs and generates text outputs. It is intended for use in English and other languages, and across multiple coding languages.

- **Organisation:** thinkingmachines
- **Category:** Vision-Language Models
- **Parameters:** 26.4B total, 3.5B active (MoE)
- **Context length:** 1,048,576 tokens
- **Licence:** Apache 2.0 (Commercial use OK)
- **Released:** 2026-11-17
- **Hugging Face:** 7.9K downloads (30 days), 3.1K likes
- **Ollama:** `ollama run inkling-2-mini`

## Estimated memory

| Quant | ≈ GB |
|---|---|
| Q2_K | 9.73 |
| Q3_K_M | 13.86 |
| Q4_K_M | 16.89 |
| Q5_K_M | 19.6 |
| Q6_K | 22.51 |
| Q8_0 | 28.67 |
| F16 | 52.86 |

## Runs with

- [llama.cpp](https://selfhost.directory/project/llamacpp)
- [Ollama](https://selfhost.directory/project/ollama)
- [Transformers](https://github.com/huggingface/transformers)
- [Jan](https://jan.ai) (community)
- [KoboldCpp](https://selfhost.directory/project/koboldcpp) (community)
- [LM Studio](https://lmstudio.ai) (community)
- [LocalAI](https://selfhost.directory/project/localai) (community)
- [MLX](https://github.com/ml-explore/mlx-lm) (community)

## About

Inkling 2 Mini is a general-purpose multimodal model that accepts text and image inputs and generates text outputs. It is intended for use in English and other languages, and across multiple coding languages. The model is designed to be used by developers building AI-powered applications, including agentic and tool-use systems, coding assistants, chatbots, and retrieval-augmented generation systems, and is suitable for general-purpose conversational use, instruction-following, and other natural language and visual tasks. It is released with open weights to support research, fine-tuning and integration into third-party products by downstream developers.

Languages: English, general multilingual support

Model provider: Thinking Machines Lab, Inc.

Date of release: November 20, 2026

License: Apache 2.0

Model Acceptable Use Policy

The weights are available for download through Hugging Face here.

Developers can also access the model using the Tinker fine-tuning platform, which provides API access.

• For accessing our model via Tinker, you can get started by referring to the Tinker Cookbook here, and installing the tml-renderers package here.
• Tinker playground also provides inference-only access to the model here.

The model is distributed as a single checkpoint of about 20GB, in mixed NVFP4 and MXFP8 precisions.

Given its small size, it is possible to run this checkpoint on local AI compute for inference. We support:

## Alternatives

- [Qwen/Qwen3.8-27B](https://selfhost.directory/models/qwen/qwen3.8-27b) (27.8B, Apache 2.0, ≈18.97 GB at Q4): Following the widespread community adoption of the Qwen3.5 and Qwen3.6 series, we are pleased to introduce Qwen3.8, the most capable generation in the Qwen open-model family to date.
- [google/gemma-4-26B-A4B-it](https://selfhost.directory/models/google/gemma-4-26b-a4b-it) (25.8B (4B active), Apache 2.0, ≈17.67 GB at Q4): Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants.
- [Qwen/Qwen3.6-27B](https://selfhost.directory/models/qwen/qwen3.6-27b) (27.8B, Apache 2.0, ≈18.97 GB at Q4): Following the February release of the Qwen3.5 series, we're pleased to share the first open-weight variant of Qwen3.6. Built on direct feedback from the community, Qwen3.6 prioritizes stability and real-world utility, offering developers a more intuitive, responsive, and genuinely productive coding…
- [google/gemma-4-31B-it](https://selfhost.directory/models/google/gemma-4-31b-it) (31.3B, Apache 2.0, ≈26.54 GB at Q4): Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants.
- [google/diffusiongemma-26B-A4B-it](https://selfhost.directory/models/google/diffusiongemma-26b-a4b-it) (25.8B (4B active), Apache 2.0, ≈17.68 GB at Q4): DiffusionGemma is a generative model built by Google DeepMind. Based on the 26B A4B Mixture-of-Experts (MoE) Gemma 4 architecture, DiffusionGemma generates tokens using discrete diffusion. This open-weights model is multimodal, handling text, image, and video inputs to generate text output.
- [Qwen/Qwen3.5-27B](https://selfhost.directory/models/qwen/qwen3.5-27b) (27.8B, Apache 2.0, ≈18.97 GB at Q4): Over recent months, we have intensified our focus on developing foundation models that deliver exceptional utility and performance.

More: https://selfhost.directory/models/thinkingmachines/inkling-2-mini/alternatives

## Runs well on

- [GeForce RTX 4060](https://selfhost.directory/models/thinkingmachines/inkling-2-mini/on/rtx-4060): F16, est. 22 tok/s
- [Apple M4 (16 GB)](https://selfhost.directory/models/thinkingmachines/inkling-2-mini/on/apple-m4-16gb): F16, est. 9.5 tok/s
- [Radeon RX 6700 XT](https://selfhost.directory/models/thinkingmachines/inkling-2-mini/on/rx-6700-xt): F16, est. 31 tok/s
- [GeForce RTX 3060 12GB](https://selfhost.directory/models/thinkingmachines/inkling-2-mini/on/rtx-3060): F16, est. 29 tok/s
- [Arc B580](https://selfhost.directory/models/thinkingmachines/inkling-2-mini/on/arc-b580): F16, est. 36 tok/s
- [Tesla T4](https://selfhost.directory/models/thinkingmachines/inkling-2-mini/on/tesla-t4): F16, est. 25 tok/s

## Similar size

- [Qwen/Qwen3.8-27B](https://selfhost.directory/models/qwen/qwen3.8-27b) (27.8B)
- [google/gemma-4-31B-it](https://selfhost.directory/models/google/gemma-4-31b-it) (31.3B)
- [google/gemma-4-26B-A4B-it](https://selfhost.directory/models/google/gemma-4-26b-a4b-it) (25.8B)
- [Qwen/Qwen3.6-27B](https://selfhost.directory/models/qwen/qwen3.6-27b) (27.8B)
- [google/gemma-3-27b-it](https://selfhost.directory/models/google/gemma-3-27b-it) (27.4B)
- [meta-models/Muse-Glimmer-30B](https://selfhost.directory/models/meta-models/muse-glimmer-30b) (29.8B)

## FAQ

**How much VRAM does Inkling-2-Mini need?**
About 17 GB at Q4_K_M with an 8K context. Q8_0 needs about 29 GB and full precision about 53 GB. Longer contexts need more memory for the KV cache.

**Can Inkling-2-Mini run on the RTX 4060?**
Yes. It fits at FP16 / BF16 (about 1.9 GB), at an estimated 22 tokens/s. It fits comfortably on the Apple M4 (16 GB), Radeon RX 6700 XT, RTX 3060 12GB.

**Can I use Inkling-2-Mini commercially?**
Yes. It is released under Apache 2.0. Permissive: use, modify and sell freely; keep the notice and licence text.

**What is the context length of Inkling-2-Mini?**
1,048,576 tokens (1M). The full window needs far more memory than an 8K context.

**How do I run Inkling-2-Mini with Ollama or llama.cpp?**
With Ollama: ollama run inkling-2-mini. With llama.cpp: llama-server -hf unsloth/Inkling-2-Mini-GGUF:UD-Q4_K_M, which starts an OpenAI-compatible server.

## Links

- huggingface: https://huggingface.co/thinkingmachines/Inkling-2-Mini
- homepage: https://thinkingmachines.ai/news/inkling-2-mini/
- github: https://github.com/thinking-machines-lab/tinker-cookbook
- demo: https://tinker.thinkingmachines.ai/playground
- ollama: https://ollama.com/library/inkling-2-mini

---
Source: https://selfhost.directory/models/thinkingmachines/inkling-2-mini