Skip to content
RfRigFit

What fits in 24 GB of unified memory

Data updated . Last reviewed the same day, when this catalog snapshot was written.

4 catalog machines have 24 GB unified. Models are ranked against the Mac mini M4 24GB, the tightest usable pool at this sticker size (16.8 GB). The tok/s estimate uses Mac mini M4 Pro 24GB bandwidth (273 GB/s) and is not a benchmark. 4 of these fits do not clear the 16 GB tier.

Models

Models that fit in 24 GB unified memory
ModelBest quantEstimateHeadroomEst. tok/s
Llama 3.2 1B InstructFP163.0 GB13.8 GB110 tok/s
Llama 3.2 3B InstructFP167.7 GB9.1 GB42.5 tok/s
Phi-3.5 miniFP169.2 GB7.6 GB35.7 tok/s
Phi-4 miniFP169.2 GB7.6 GB35.6 tok/s
Gemma 3 4BFP1610.3 GB6.5 GB31.7 tok/s
DeepSeek V4 FlashQ84.5 GB12.3 GB1605 tok/s
Gemma 4 E4BQ88.3 GB8.5 GB33.3 tok/s
Qwen2.5 7B InstructQ88.6 GB8.2 GB33.7 tok/s
Mistral 7B Instruct v0.3Q88.8 GB8.0 GB35.4 tok/s
DeepSeek R1 Distill Llama 8BQ89.6 GB7.2 GB32.0 tok/s
Llama 3.1 8B InstructQ89.6 GB7.2 GB34.0 tok/s
Qwen3 8BQ89.9 GB6.9 GB31.3 tok/s
Ministral 3 8BQ810.2 GB6.6 GB30.2 tok/s
Gemma 2 9BQ810.7 GB6.1 GB25.5 tok/s
gpt-oss-20bQ812.3 GB4.5 GB131 tok/s
Gemma 3 12BQ812.5 GB4.3 GB21.8 tok/s
Gemma 4 12BQ813.2 GB3.6 GB21.5 tok/s
Mistral Nemo 12BQ814.4 GB2.4 GB21.0 tok/s
Ministral 3 14BQ815.7 GB1.1 GB19.0 tok/s
Qwen3 14BQ410.3 GB6.5 GB30.3 tok/s
Phi-4Q410.6 GB6.2 GB30.7 tok/s
Qwen2.5 14B InstructQ410.6 GB6.2 GB30.4 tok/s
Mistral Small 3.2 24BQ415.7 GB1.1 GB19.0 tok/s
Gemma 3 27BQ416.5 GB0.3 GB16.5 tok/s
Gemma 2 27BQ416.6 GB0.2 GB16.4 tok/s

Machines at 24 GB

Questions

How many models fit in 24 GB of unified memory?
25 of 49 fit on the tightest config at this size, the Mac mini M4 24GB, which keeps 16.8 GB usable.
Which catalog machines have 24 GB unified?
Mac mini M4 24GB (70% usable), MacBook Air M4 24GB (70% usable), Mac mini M4 Pro 24GB (70% usable), MacBook Pro 14-inch M4 Pro 24GB (70% usable).
Why is the ranking based on the tightest config?
So a model listed as fitting works on every 24 GB machine here, including ones that reserve more memory for the OS. A looser machine has more headroom than the table shows.