How fast will local models feel on the Mac Studio M5 Ultra 512GB?

Local LLM speed on the Mac Studio M5 Ultra 512GB

The Mac Studio M5 Ultra 512GB has 512 GB of unified memory and 1200 GB/s of memory bandwidth, which is what mostly decides generation speed. Below is the expected speed for each model at the best quantization that fits.

ModelQuantizationMemoryGenerationFirst token
Qwen 3.6/3.8 27BQ4_K_MFits34 tok/s0.4 s
Qwen 3.8 Flash-NextQ4_K_MFits145 tok/s0.3 s
GLM-5.3 FlashUD-Q4_K_XLFits52 tok/s0.3 s
Gemma 4 26B A4BQ4_K_MFits231 tok/s0.3 s
GPT-OSS 20BMXFP4Fits277 tok/s0.3 s
Qwen 3.5/3.6 35B A3BQ4_K_MFits312 tok/s0.3 s
Gemma 4 31BQ4_K_MFits31 tok/s0.4 s
Qwen 3.5 9BQ4_K_MFits102 tok/s0.3 s
DeepSeek V4 FlashUD-Q4_K_XLFits87 tok/s0.3 s
DeepSeek V4.1 FlashQ3_K_MFits78 tok/s0.3 s
GPT-OSS 120BMXFP4Fits208 tok/s0.3 s
Llama 3.1 8BQ4_K_MFits117 tok/s0.3 s
Gemma 4 12BQ4_K_MFits81 tok/s0.3 s
GLM-5.3UD-IQ4_XSFits31 tok/s0.4 s
Nemotron 3.5 Lightning 30B A3BQ4_K_MFits240 tok/s0.3 s

Other hardware

Estimates for a short prompt on a single device. Measured numbers come from community benchmarks (r/LocalLLaMA, localscore.ai and more); others are derived from similar setups or projected from specs. Open source on GitHub.