# plamo-3-8b-fin-instruct

> PLaMo-3-8B-Fin-Instruct is a Japanese language model for the financial domain, developed by Preferred Networks, Inc. It is fine-tuned from a PLaMo-3 base model through continued pre-training on financial corpora followed by supervised fine-tuning and direct preference optimization.

- **Organisation:** pfnet
- **Category:** Chat & Text Generation
- **Parameters:** 8.5B
- **Context length:** 262,144 tokens
- **Licence:** plamo-community-license (Commercial use with conditions)
- **Released:** 2026-11-08
- **Hugging Face:** 983 downloads (30 days), 10 likes

## Estimated memory

| Quant | ≈ GB |
|---|---|
| Q2_K | 3.74 |
| Q3_K_M | 5.08 |
| Q4_K_M | 6.06 |
| Q5_K_M | 6.93 |
| Q6_K | 7.87 |
| Q8_0 | 9.86 |
| F16 | 17.69 |

## Runs with

- [llama.cpp](https://selfhost.directory/project/llamacpp)
- [Transformers](https://github.com/huggingface/transformers)
- [vLLM](https://selfhost.directory/project/vllm)
- [Jan](https://jan.ai) (community)
- [KoboldCpp](https://selfhost.directory/project/koboldcpp) (community)
- [LM Studio](https://lmstudio.ai) (community)
- [LocalAI](https://selfhost.directory/project/localai) (community)
- [Ollama](https://selfhost.directory/project/ollama) (community)

## About

PLaMo-3-8B-Fin-Instruct is a Japanese language model for the financial domain, developed by Preferred Networks, Inc. It is fine-tuned from a PLaMo-3 base model through continued pre-training on financial corpora followed by supervised fine-tuning and direct preference optimization. This is an instruction-tuned model for the financial domain. The model follows the PLaMo-3 chat format.

The model is provided as a chat model that reasons in Japanese: it first writes its thought process in Japanese and then gives the answer. It also supports function calling (tool use). Part of the training was carried out on MN-Core 2, a deep learning accelerator developed by Preferred Networks.

## Alternatives

- [ornith-ai/Ornith-1.0-9B](https://selfhost.directory/models/ornith-ai/ornith-1.0-9b) (9B, MIT, ≈6.84 GB at Q4): Aloha! 🌺 Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding.
- [ornith-ai/Ornith-1.5-9B](https://selfhost.directory/models/ornith-ai/ornith-1.5-9b) (9.7B, MIT, ≈7.22 GB at Q4): Chirp Chirp! 🐦 We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement.
- [Qwen/Qwen3-8B](https://selfhost.directory/models/qwen/qwen3-8b) (8.2B, Apache 2.0, ≈6.48 GB at Q4): Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models.
- [ibm-granite/granite-4.2-8b](https://selfhost.directory/models/ibm-granite/granite-4.2-8b) (8.8B, Apache 2.0, ≈6.96 GB at Q4): Granite is a family of open-source large language models developed by IBM, designed for enterprise and research use. Granite models are built to be versatile, safe, and efficient — covering a range of sizes and capabilities from compact edge-deployable models to large-scale reasoning systems.
- [ibm-granite/granite-4.1-8b](https://selfhost.directory/models/ibm-granite/granite-4.1-8b) (8.8B, Apache 2.0, ≈6.96 GB at Q4): Model Summary: Granite-4.1-8B is a 8B parameter long-context instruct model finetuned from Granite-4.1-8B-Base using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets.
- [nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16](https://selfhost.directory/models/nvidia/nvidia-nemotron-3.5-bolt-e4b-bf16) (8B, openmdw-1.1, ≈5.9 GB at Q4): NVIDIA-Nemotron-3.5-Bolt-E4B-BF16 is a small language model (SLM) further post-trained from Gemma-4-E4B-it by NVIDIA. This is the full-precision (BF16) release.

More: https://selfhost.directory/models/pfnet/plamo-3-8b-fin-instruct/alternatives

## Runs well on

- [GeForce RTX 4060](https://selfhost.directory/models/pfnet/plamo-3-8b-fin-instruct/on/rtx-4060): Q5_K_M, est. 25 tok/s
- [Apple M4 (16 GB)](https://selfhost.directory/models/pfnet/plamo-3-8b-fin-instruct/on/apple-m4-16gb): Q8_0, est. 7.3 tok/s
- [Radeon RX 6700 XT](https://selfhost.directory/models/pfnet/plamo-3-8b-fin-instruct/on/rx-6700-xt): Q8_0, est. 23 tok/s
- [GeForce RTX 3060 12GB](https://selfhost.directory/models/pfnet/plamo-3-8b-fin-instruct/on/rtx-3060): Q8_0, est. 22 tok/s
- [Arc B580](https://selfhost.directory/models/pfnet/plamo-3-8b-fin-instruct/on/arc-b580): Q8_0, est. 28 tok/s
- [Tesla T4](https://selfhost.directory/models/pfnet/plamo-3-8b-fin-instruct/on/tesla-t4): Q8_0, est. 19 tok/s

## Similar size

- [meta-llama/Llama-3.1-8B-Instruct](https://selfhost.directory/models/meta-llama/llama-3.1-8b-instruct) (8B)
- [Qwen/Qwen3-8B](https://selfhost.directory/models/qwen/qwen3-8b) (8.2B)
- [Qwen/Qwen2.5-7B-Instruct](https://selfhost.directory/models/qwen/qwen2.5-7b-instruct) (7.6B)
- [meta-llama/Meta-Llama-3-8B-Instruct](https://selfhost.directory/models/meta-llama/meta-llama-3-8b-instruct) (8B)
- [xtools-at/DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic](https://selfhost.directory/models/xtools-at/deepseek-v4-pro-qwen3.5-9b-uncensored-heretic) (9.4B)
- [google/gemma-2-9b-it](https://selfhost.directory/models/google/gemma-2-9b-it) (9.2B)

## FAQ

**How much VRAM does plamo-3-8b-fin-instruct need?**
About 6.1 GB at Q4_K_M with an 8K context. Q8_0 needs about 9.9 GB and full precision about 18 GB. Longer contexts need more memory for the KV cache.

**Can plamo-3-8b-fin-instruct run on the RTX 4060?**
Yes. It fits at Q5_K_M (about 7.0 GB), at an estimated 25 tokens/s. It fits comfortably on the Apple M4 (16 GB), Radeon RX 6700 XT, RTX 3060 12GB.

**Can I use plamo-3-8b-fin-instruct commercially?**
Yes, with conditions. It is released under plamo-community-license. Custom licence: read the model card before using it commercially.

**What is the context length of plamo-3-8b-fin-instruct?**
262,144 tokens (256K). The full window needs far more memory than an 8K context.

**How do I run plamo-3-8b-fin-instruct with Ollama or llama.cpp?**
With Ollama: ollama run hf.co/mradermacher/plamo-3-8b-fin-instruct-GGUF:Q4_K_M. With llama.cpp: llama-server -hf mradermacher/plamo-3-8b-fin-instruct-GGUF:Q4_K_M, which starts an OpenAI-compatible server.

## Links

- huggingface: https://huggingface.co/pfnet/plamo-3-8b-fin-instruct

---
Source: https://selfhost.directory/models/pfnet/plamo-3-8b-fin-instruct