Skip to content
RfRigFit

What LLMs can the GeForce RTX 3060 Ti (8 GB) run?

GPU

Data updated . Last reviewed the same day, when this catalog snapshot was written.

NVIDIA cards usually run local models through CUDA. Usable VRAM is 95% of the sticker figure, leaving a little for the driver.

VRAM
8.0 GB
Usable
7.6 GB
Bandwidth
448 GB/s
List price
$399
Year
2020
Q4 models
14/49

NVIDIA launch MSRP.

Check price on Amazon for GeForce RTX 3060 TiOpen in the checker

Amazon links are affiliate searches, not live prices.

Models

Sorted with Q4 fits first. Memory figures already include the 20% overhead.

Models GeForce RTX 3060 Ti can run
ModelParamsQ4Q8FP16
Llama 3.2 1B Instruct
Llama
1.24BFits0.8 GBFits1.3 GBFits3.0 GB
Llama 3.2 3B Instruct
Llama
3.21BFits2.0 GBFits3.4 GBNo7.7 GB
Phi-3.5 mini
Phi
3.82BTight5.6 GBTight7.3 GBNo9.2 GB
Phi-4 mini
Phi
3.84BFits3.6 GBFits5.2 GBNo9.2 GB
Gemma 3 4B
Gemma
4.3BFits2.5 GBFits4.1 GBNo10.3 GB
Mistral 7B Instruct v0.3
Mistral
7.25BFits5.4 GBNo8.8 GBNo17.4 GB
Qwen2.5 7B Instruct
Qwen
7.62BFits5.2 GBNo8.6 GBNo18.3 GB
Gemma 4 E4B
Gemma
8BFits5.1 GBNo8.3 GBNo19.2 GB
DeepSeek R1 Distill Llama 8B
DeepSeek
8.03BTight6.0 GBNo9.6 GBNo19.3 GB
Llama 3.1 8B Instruct
Llama
8.03BFits4.9 GBNo9.6 GBNo19.3 GB
Qwen3 8B
Qwen
8.19BTight6.2 GBNo9.9 GBNo19.7 GB
Ministral 3 8B
Mistral
8.92BTight6.3 GBNo10.2 GBNo21.4 GB
Gemma 2 9B
Gemma
9.24BTight6.8 GBNo10.7 GBNo22.2 GB
Gemma 3 12B
Gemma
12.2BTight7.3 GBNo12.5 GBNo29.2 GB
Gemma 4 12B
Gemma
12BNo7.7 GBNo13.2 GBNo28.7 GB
Mistral Nemo 12B
Mistral
12.2BNo8.8 GBNo14.4 GBNo29.4 GB
Ministral 3 14B
Mistral
13.9BNo9.6 GBNo15.7 GBNo33.5 GB
Phi-4
Phi
14.7BNo10.6 GBNo17.3 GBNo35.2 GB
Qwen3 14B
Qwen
14.8BNo10.3 GBNo17.0 GBNo35.4 GB
Qwen2.5 14B Instruct
Qwen
14.8BNo10.6 GBNo17.3 GBNo35.4 GB
gpt-oss-20b
gpt-oss
20.9B
3.6B active
No11.8 GBNo12.3 GBNo50.2 GB
Mistral Small 3.2 24B
Mistral
24BNo15.7 GBNo26.4 GBNo57.6 GB
Gemma 4 26B-A4B
Gemma
25.8B
3.8B active
No17.3 GBNo27.2 GBNo61.9 GB
Gemma 2 27B
Gemma
27.2BNo16.6 GBNo30.0 GBNo65.3 GB
Gemma 3 27B
Gemma
27.4BNo16.5 GBNo28.7 GBNo65.8 GB
Qwen3.6 27B
Qwen
27.8BNo17.4 GBNo29.1 GBNo66.7 GB
Qwen3.8 27B
Qwen
27.8BNo17.0 GBNo29.6 GBNo66.7 GB
Qwen3 30B-A3B
Qwen
30.5B
3B active
No19.4 GBNo33.3 GBNo73.3 GB
GLM-4.7-Flash
GLM
31.2B
3B active
No18.8 GBNo32.3 GBNo74.9 GB
Gemma 4 31B
Gemma
31.3BNo19.7 GBNo34.0 GBNo75.1 GB
Qwen3 32B
Qwen
32.8BNo21.9 GBNo37.0 GBNo78.6 GB
DeepSeek R1 Distill Qwen 32B
DeepSeek
32.8BNo22.0 GBNo37.0 GBNo78.6 GB
Qwen2.5 32B Instruct
Qwen
32.8BNo22.0 GBNo37.0 GBNo78.6 GB
Qwen3.6 35B-A3B
Qwen
36B
3B active
No22.3 GBNo37.1 GBNo86.3 GB
Mixtral 8x7B
Mistral
46.7B
12.9B active
No27.5 GBNo50.7 GBNo112 GB
DeepSeek R1 Distill Llama 70B
DeepSeek
70.6BNo45.2 GBNo77.7 GBNo169 GB
Llama 3.3 70B Instruct
Llama
70.6BNo42.5 GBNo75.0 GBNo169 GB
Qwen2.5 72B Instruct
Qwen
72.7BNo46.7 GBNo80.2 GBNo174 GB
Llama 4 Scout
Llama
109B
17B active
No65.4 GBNo115 GBNo261 GB
gpt-oss-120b
gpt-oss
117B
5.1B active
No63.1 GBNo63.7 GBNo280 GB
Mistral Small 4
Mistral
119B
6.5B active
No74.0 GBNo127 GBNo287 GB
Mixtral 8x22B
Mistral
141B
39B active
No87.5 GBNo151 GBNo338 GB
Qwen3 235B-A22B
Qwen
235B
22B active
No144 GBNo252 GBNo564 GB
DeepSeek V4 Flash
DeepSeek
291B
13B active
No175 GBFits4.5 GBNo698 GB
Llama 4 Maverick
Llama
402B
17B active
No243 GBNo426 GBNo964 GB
Llama 3.1 405B Instruct
Llama
406BNo244 GBNo487 GBNo974 GB
Mistral Large 3
Mistral
675B
41B active
No407 GBNo716 GBNo1620 GB
DeepSeek R1
DeepSeek
684B
37B active
No405 GBNo714 GBNo1643 GB
DeepSeek V4 Pro
DeepSeek
1599B
49B active
No959 GBNo1673 GBNo3837 GB