RunsOnMy ModelsGPUs & MacsBy VRAMAPI pricesVRAM calculatorNew

Can Intern S1 run on the RTX 3090 Ti?

No. Even at 2-bit with 8K context, Intern S1 needs about 86.2 GB, more than the 22.8 GB usable on the RTX 3090 Ti.

Memory by quant and context

Quant4K ctx8K ctx32K ctxMax tok/s (est., 8K)
2-bit (Q2_K)85.5 GB No86.2 GB No90.6 GB No—
3-bit (Q3_K_M)111 GB No112 GB No116 GB No—
4-bit (Q4_K_M)138 GB No139 GB No144 GB No—
5-bit (Q5_K_M)161 GB No162 GB No166 GB No—
6-bit (Q6_K)185 GB No186 GB No190 GB No—
8-bit (Q8_0) •234 GB No235 GB No239 GB No—
16-bit (F16/BF16) •439 GB No440 GB No445 GB No—

• real GGUF file size from internlm/Intern-S1-GGUF. Speed is a bandwidth ceiling (1008 GB/s), not a benchmark. Methodology.

Hardware that does fit it

RTX PRO 6000 BlackwellDGX SparkRyzen AI Max+ 395 128GBMac M3 Max 128GBMac M4 Max 128GBH200

More

Intern S1 on every GPU and Mac · Every model that runs on the RTX 3090 Ti · Other models that fit 24 GB VRAM · Try other settings in the calculator

Data: Hugging Face Hub (internlm/Intern-S1), NVIDIA specs. Data as of 2026-11-17.