How fast will local models feel on the MacBook Pro M5 Max 128GB?

Local LLM speed on the MacBook Pro M5 Max 128GB

The MacBook Pro M5 Max 128GB has 128 GB of unified memory and 614 GB/s of memory bandwidth, which is what mostly decides generation speed. Below is the expected speed for each model at the best quantization that fits.

ModelQuantizationMemoryGenerationFirst token
Qwen 3.6/3.8 27BQ4_K_MFits19 tok/s0.4 s
Qwen 3.8 Flash-NextQ3_K_MFits107 tok/s0.3 s
GLM-5.3 FlashUD-IQ1_SFits60 tok/s0.4 s
Gemma 4 26B A4BQ4_K_MFits87 tok/s0.3 s
GPT-OSS 20BMXFP4Fits139 tok/s0.3 s
Qwen 3.5/3.6 35B A3BQ4_K_MFits95 tok/s0.3 s
Gemma 4 31BQ4_K_MFits18 tok/s0.4 s
Qwen 3.5 9BQ4_K_MFits58 tok/s0.3 s
DeepSeek V4 FlashUD-IQ2_MFits83 tok/s0.4 s
DeepSeek V4.1 FlashQ2_KDoesn't fitWon't run—
GPT-OSS 120BMXFP4Fits118 tok/s0.3 s
Llama 3.1 8BQ4_K_MFits67 tok/s0.3 s
Gemma 4 12BQ4_K_MFits46 tok/s0.4 s
GLM-5.3UD-IQ1_SDoesn't fitWon't run—
Nemotron 3.5 Lightning 30B A3BQ4_K_MFits137 tok/s0.3 s

Other hardware

Estimates for a short prompt on a single device. Measured numbers come from community benchmarks (r/LocalLLaMA, localscore.ai and more); others are derived from similar setups or projected from specs. Open source on GitHub.