# UserLM-2.0

> UserLM-2.0 is an 8-billion-parameter user simulator for user-AI conversations. Unlike typical language models trained to play the assistant, UserLM-2.0 generates the user side of a conversation. It is conditioned on a task intent that describes the user's high-level objective.

- **Organisation:** microsoft
- **Category:** Chat & Text Generation
- **Parameters:** 8B
- **Context length:** 131,072 tokens
- **Licence:** MIT (Commercial use OK)
- **Released:** 2026-10-01
- **Hugging Face:** 1.1K downloads (30 days), 15 likes

## Estimated memory

| Quant | ≈ GB |
|---|---|
| Q2_K | 4.08 |
| Q3_K_M | 5.34 |
| Q4_K_M | 6.26 |
| Q5_K_M | 7.09 |
| Q6_K | 7.97 |
| Q8_0 | 9.84 |
| F16 | 17.21 |

## Runs with

- [llama.cpp](https://selfhost.directory/project/llamacpp)
- [SGLang](https://selfhost.directory/project/sglang)
- [Text Generation Inference](https://github.com/huggingface/text-generation-inference)
- [Transformers](https://github.com/huggingface/transformers)
- [vLLM](https://selfhost.directory/project/vllm)

## About

UserLM-2.0 is an 8-billion-parameter user simulator for user-AI conversations. Unlike typical language models trained to play the assistant, UserLM-2.0 generates the user side of a conversation. It is conditioned on a task intent that describes the user's high-level objective.

UserLM-2.0 can:

• Generate an initial user utterance from a task intent.
• Generate follow-up user utterances from the conversation so far.
• Emit when it determines that the user's objective has
• been satisfied and the conversation should end.

The model is intended to support research on realistic user simulation and the development and evaluation of more robust assistant models.

Paper: The accompanying UserLM-2.0 paper is forthcoming. An arXiv link will be added when it becomes available.

• Developed by: Omer Gul (Microsoft Research intern, Spring 2026),
• Philippe Laban (Microsoft Research), Tanya Goyal (Microsoft Research), and
• Jennifer Neville (Microsoft Research)
• Model type: Generative causal language model, 8B parameters
• Language: English
• License: MIT
• Backbone: meta-llama/Llama-3.1-8B-Instruct
• Repository: microsoft/UserLM-2.0

## Alternatives

- [ornith-ai/Ornith-1.0-9B](https://selfhost.directory/models/ornith-ai/ornith-1.0-9b) (9B, MIT, ≈6.84 GB at Q4): Aloha! 🌺 Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding.
- [Qwen/Qwen3-8B](https://selfhost.directory/models/qwen/qwen3-8b) (8.2B, Apache 2.0, ≈6.48 GB at Q4): Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models.
- [ornith-ai/Ornith-1.5-9B](https://selfhost.directory/models/ornith-ai/ornith-1.5-9b) (9.7B, MIT, ≈7.22 GB at Q4): Chirp Chirp! 🐦 We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement.
- [nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16](https://selfhost.directory/models/nvidia/nvidia-nemotron-3.5-bolt-e4b-bf16) (8B, openmdw-1.1, ≈5.9 GB at Q4): NVIDIA-Nemotron-3.5-Bolt-E4B-BF16 is a small language model (SLM) further post-trained from Gemma-4-E4B-it by NVIDIA. This is the full-precision (BF16) release.
- [ibm-granite/granite-4.2-8b](https://selfhost.directory/models/ibm-granite/granite-4.2-8b) (8.8B, Apache 2.0, ≈6.96 GB at Q4): Granite is a family of open-source large language models developed by IBM, designed for enterprise and research use. Granite models are built to be versatile, safe, and efficient — covering a range of sizes and capabilities from compact edge-deployable models to large-scale reasoning systems.
- [Qwen/Qwen2.5-7B-Instruct](https://selfhost.directory/models/qwen/qwen2.5-7b-instruct) (7.6B, Apache 2.0, ≈5.45 GB at Q4): Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2:

More: https://selfhost.directory/models/microsoft/userlm-2.0/alternatives

## Runs well on

- [GeForce RTX 4060](https://selfhost.directory/models/microsoft/userlm-2.0/on/rtx-4060): Q5_K_M, est. 26 tok/s
- [Apple M4 (16 GB)](https://selfhost.directory/models/microsoft/userlm-2.0/on/apple-m4-16gb): Q8_0, est. 7.7 tok/s
- [Radeon RX 6700 XT](https://selfhost.directory/models/microsoft/userlm-2.0/on/rx-6700-xt): Q8_0, est. 25 tok/s
- [GeForce RTX 3060 12GB](https://selfhost.directory/models/microsoft/userlm-2.0/on/rtx-3060): Q8_0, est. 23 tok/s
- [Arc B580](https://selfhost.directory/models/microsoft/userlm-2.0/on/arc-b580): Q8_0, est. 29 tok/s
- [Tesla T4](https://selfhost.directory/models/microsoft/userlm-2.0/on/tesla-t4): Q8_0, est. 21 tok/s

## Similar size

- [meta-llama/Llama-3.1-8B-Instruct](https://selfhost.directory/models/meta-llama/llama-3.1-8b-instruct) (8B)
- [Qwen/Qwen3-8B](https://selfhost.directory/models/qwen/qwen3-8b) (8.2B)
- [Qwen/Qwen2.5-7B-Instruct](https://selfhost.directory/models/qwen/qwen2.5-7b-instruct) (7.6B)
- [meta-llama/Meta-Llama-3-8B-Instruct](https://selfhost.directory/models/meta-llama/meta-llama-3-8b-instruct) (8B)
- [xtools-at/DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic](https://selfhost.directory/models/xtools-at/deepseek-v4-pro-qwen3.5-9b-uncensored-heretic) (9.4B)
- [google/gemma-2-9b-it](https://selfhost.directory/models/google/gemma-2-9b-it) (9.2B)

## FAQ

**How much VRAM does UserLM-2.0 need?**
About 6.3 GB at Q4_K_M with an 8K context. Q8_0 needs about 9.8 GB and full precision about 17 GB. Longer contexts need more memory for the KV cache.

**Can UserLM-2.0 run on the RTX 4060?**
Yes. It fits at Q5_K_M (about 7.1 GB), at an estimated 26 tokens/s. It fits comfortably on the Apple M4 (16 GB), Radeon RX 6700 XT, RTX 3060 12GB.

**Can I use UserLM-2.0 commercially?**
Yes. It is released under MIT. Permissive: do almost anything as long as you keep the copyright notice.

**What is the context length of UserLM-2.0?**
131,072 tokens (128K). The full window needs far more memory than an 8K context.

**How do I run UserLM-2.0 with llama.cpp?**
Run llama-server -hf liodon-ai/UserLM-2.0-imatrix-GGUF:Q4_K_M. It downloads the GGUF and starts an OpenAI-compatible server.

## Links

- huggingface: https://huggingface.co/microsoft/UserLM-2.0

---
Source: https://selfhost.directory/models/microsoft/userlm-2.0