How fast will DeepSeek V4 Flash feel on the Mac Studio M5 Ultra 512GB?

DeepSeek V4 Flash on the Mac Studio M5 Ultra 512GB

DeepSeek V4 Flash is a 304.18B-parameter mixture-of-experts model (13B active per token). At UD-Q4_K_XL it needs about 155.8 GB of memory. The Mac Studio M5 Ultra 512GB has 384 GB usable, so it fits entirely in memory. Expect about 87 tokens/sec (74–100), with the first token after 0.3 s for a short prompt. This estimate is projected from the hardware specs; no benchmarks exist yet.

Speed by quantization

QuantizationFile sizeMemoryGenerationFirst tokenSource
UD-IQ1_S82.5 GBFits164 tok/s0.3 sProjected
UD-IQ1_M86.9 GBFits155 tok/s0.3 sProjected
UD-IQ2_XXS90.9 GBFits149 tok/s0.3 sProjected
UD-IQ2_M90.9 GBFits148 tok/s0.3 sProjected
UD-Q2_K_XL96.8 GBFits139 tok/s0.3 sProjected
UD-IQ3_XXS104.2 GBFits130 tok/s0.3 sProjected
UD-IQ3_S116.1 GBFits116 tok/s0.3 sProjected
UD-Q3_K_M128.1 GBFits105 tok/s0.3 sProjected
UD-Q3_K_XL128.2 GBFits105 tok/s0.3 sProjected
UD-IQ4_XS136.7 GBFits99 tok/s0.3 sProjected
UD-IQ4_NL136.7 GBFits99 tok/s0.3 sProjected
UD-Q4_K_XL155.1 GBFits87 tok/s0.3 sProjected
UD-Q8_K_XL161.9 GBFits83 tok/s0.3 sProjected

DeepSeek V4 Flash on other hardware

Other models on the Mac Studio M5 Ultra 512GB

All models on the Mac Studio M5 Ultra 512GB · DeepSeek V4 Flash on all hardware

Estimates for a short prompt on a single device. Measured numbers come from community benchmarks (r/LocalLLaMA, localscore.ai and more); others are derived from similar setups or projected from specs. Open source on GitHub.