Can I run Ling 3.0 Flash VL locally?
Ling 3.0 Flash VL by inclusionAI has 125B parameters (5.9B active per token, 512 experts, 8 used per token). At 4-bit with an 8K context it needs about 74.3 GB of GPU memory. It fits on 22 of 65 GPUs and Macs we track.
Image input needs the vision projector file too: about 0.8 GB more (bartowski/Ling-3.0-flash-VL-GGUF), not included in the figures below, which are for text-only use.
Memory needed by quant and context length
GB of GPU memory = weights + KV cache (FP16) + runtime overhead. Weights use real file sizes from bartowski/Ling-3.0-flash-VL-GGUF where available (marked •), otherwise parameter count × bits per weight. How we calculate.
| Quant | Quality | 4K ctx | 8K ctx | 32K ctx | 128K ctx |
|---|---|---|---|---|---|
| 2-bit (Q2_K) • | rough | 45.4 GB | 45.6 GB | 46.7 GB | 51.1 GB |
| 3-bit (Q3_K_M) • | usable | 56.5 GB | 56.7 GB | 57.8 GB | 62.3 GB |
| 4-bit (Q4_K_M) • | good, most popular | 74.1 GB | 74.3 GB | 75.4 GB | 79.9 GB |
| 5-bit (Q5_K_M) • | very good | 90.2 GB | 90.4 GB | 91.5 GB | 95.9 GB |
| 6-bit (Q6_K) • | near lossless | 103 GB | 103 GB | 104 GB | 109 GB |
| 8-bit (Q8_0) • | effectively lossless | 124 GB | 124 GB | 125 GB | 130 GB |
| 16-bit (F16/BF16) • | original weights | 233 GB | 233 GB | 234 GB | 238 GB |
Which GPUs and Macs run Ling 3.0 Flash VL?
Best quality quant that fits at 8K context. "Tight" = within 10% of usable memory. Speed is a ceiling from memory bandwidth (real speed is typically 50–80% of it).
Prefer an API?
inclusionAI: Ling 3.0 Flash VL is on OpenRouter at $0.06 per 1M input tokens and $0.18 per 1M output tokens. Price details and history →
Questions
How much VRAM does Ling 3.0 Flash VL need?
About 74.3 GB at 4-bit (Q4_K_M) with an 8K context: 73.3 GB of weights (real GGUF file size), 0.4 GB of KV cache and 0.7 GB of runtime overhead. At 8-bit it needs about 124 GB.
What is the smallest GPU that runs Ling 3.0 Flash VL?
No single consumer GPU in our table fits it at Q4_K_M with 8K context; the smallest option that does is the RTX PRO 6000 Blackwell (96 GB).
Can I run Ling 3.0 Flash VL on a Mac?
Yes. At Q4_K_M with 8K context it fits on a Mac M3 Max 128GB or larger, using the default macOS GPU memory limit.
Similar models
Same family or a similar parameter count, with the VRAM each needs at Q4_K_M and 8K context.
Ling 3.0 Flash Sante
127B · 75.9 GB at 4-bitLing 3.0 Flash
127B · 73.5 GB at 4-bitLing 2.6 Flash
107B · 62.2 GB at 4-bitgpt-oss 120B
117B · 59.6 GB at 4-bitgpt-oss Safeguard 120B
117B · 59.5 GB at 4-bitGLM 4.5 Air
110B · 70.6 GB at 4-bitEmbed this
Free badge and "Will it run on my GPU?" widget for model cards, READMEs and blogs. No cookies, no tracking. All options.
Copy a snippet
Markdown badge
[](https://runsonmy.com/model/ling-3-0-flash-vl/) Widget (script)
<div class="runsonmy-widget" data-model="ling-3-0-flash-vl"><a href="https://runsonmy.com/model/ling-3-0-flash-vl/">Will Ling 3.0 Flash VL run on my GPU? Check on RunsOnMy</a></div>
<script async src="https://runsonmy.com/embed.js"></script> Widget (iframe)
<iframe src="https://runsonmy.com/embed/m/ling-3-0-flash-vl/" width="100%" height="220" style="max-width:440px;border:0" loading="lazy" title="Will Ling 3.0 Flash VL run on my GPU? (RunsOnMy)"></iframe> Model facts
| Hugging Face repo | inclusionAI/Ling-3.0-flash-VL |
| Parameters | 124,848,460,496 (125B) · ~5.9B active (computed from config) |
| Layers / hidden size | 42 / 2560 |
| Attention | MLA; 32 heads, 32 KV heads, head dim 128 |
| KV cache per token (FP16) | 47.3 KiB |
| Max context | 131,072 tokens |
| License | mit |
| Released on HF | Sep 4, 2026 |
| Downloads (30d) / likes | 7,162 / 128 |
Sources: Hugging Face model API · config.json (inclusionAI/Ling-3.0-flash-VL) · GGUF files · GPU specs from vendor pages (list). Data fetched Nov 17, 2026. Spot an error? Report it.