RunsOnMy ModelsGPUs & MacsBy VRAMAPI pricesVRAM calculatorNew

Can Kimi K3.1 Pro run on the RTX 4070 Super?

No. Even at 2-bit with 8K context, Kimi K3.1 Pro needs about 972 GB, more than the 11.4 GB usable on the RTX 4070 Super.

Memory by quant and context

Quant4K ctx8K ctx32K ctx128K ctxMax tok/s (est., 8K)
2-bit (Q2_K)972 GB No972 GB No975 GB No985 GB No—
3-bit (Q3_K_M)1267 GB No1267 GB No1269 GB No1279 GB No—
4-bit (Q4_K_M)1584 GB No1584 GB No1587 GB No1596 GB No—
5-bit (Q5_K_M)1846 GB No1846 GB No1849 GB No1859 GB No—
6-bit (Q6_K)2124 GB No2125 GB No2127 GB No2137 GB No—
8-bit (Q8_0)2752 GB No2753 GB No2755 GB No2765 GB No—
16-bit (F16/BF16)5179 GB No5180 GB No5182 GB No5192 GB No—

• real GGUF file size. Speed is a bandwidth ceiling (504 GB/s), not a benchmark. Methodology.

More

Kimi K3.1 Pro on every GPU and Mac · Every model that runs on the RTX 4070 Super · Other models that fit 12 GB VRAM · Try other settings in the calculator

Data: Hugging Face Hub (moonshotai/Kimi-K3.1-Pro), NVIDIA specs. Data as of 2026-11-17.