RunsOnMy ModelsGPUs & MacsBy VRAMAPI pricesVRAM calculatorNew

Can Kimi Dev 72B run on the RTX 4060 Ti 16GB?

No. Even at 2-bit with 8K context, Kimi Dev 72B needs about 28.6 GB, more than the 15.2 GB usable on the RTX 4060 Ti 16GB.

Memory by quant and context

Quant4K ctx8K ctx32K ctx128K ctxMax tok/s (est., 8K)
2-bit (Q2_K)27.3 GB No28.6 GB No36.1 GB No66.1 GB No—
3-bit (Q3_K_M) •37.0 GB No38.3 GB No45.8 GB No75.8 GB No—
4-bit (Q4_K_M)43.3 GB No44.6 GB No52.1 GB No82.1 GB No—
5-bit (Q5_K_M)50.2 GB No51.4 GB No58.9 GB No88.9 GB No—
6-bit (Q6_K) •61.9 GB No63.1 GB No70.6 GB No101 GB No—
8-bit (Q8_0) •73.9 GB No75.1 GB No82.6 GB No113 GB No—
16-bit (F16/BF16) •137 GB No139 GB No146 GB No176 GB No—

• real GGUF file size from unsloth/Kimi-Dev-72B-GGUF. Speed is a bandwidth ceiling (288 GB/s), not a benchmark. Methodology.

Hardware that does fit it

RTX 5090A100 40GBRTX A6000RTX 6000 AdaL40SMac M4 Pro 48GB

More

Kimi Dev 72B on every GPU and Mac · Every model that runs on the RTX 4060 Ti 16GB · Other models that fit 16 GB VRAM · Try other settings in the calculator

Data: Hugging Face Hub (moonshotai/Kimi-Dev-72B), NVIDIA specs. Data as of 2026-11-17.