How fast will GPT-OSS 20B feel on your hardware?

GPT-OSS 20B speed on GPUs and Macs

GPT-OSS 20B is a 20.91B-parameter mixture-of-experts model (3.6B active per token). Smaller quantizations need less memory and run faster, at some cost in quality. Below is the expected speed on each piece of hardware at the best quantization that fits.

Other models

• Qwen 3.6/3.8 27B
• GLM-5.3 Flash
• Gemma 4 26B A4B
• Qwen 3.5/3.6 35B A3B
• Ornith 1.5 35B A3B
• DeepSeek V4 Flash
• GPT-OSS 120B
• Gemma 4 31B
• Llama 3.1 8B
• Qwen 3.5 9B
• DeepSeek R1 Distill 14B
• Ornith 1.5 9B
• Muse Glimmer 30B
• Qwen3 30B A3B

Estimates for a short prompt on a single device. Measured numbers come from community benchmarks (r/LocalLLaMA, localscore.ai and more); others are derived from similar setups or projected from specs. Open source on GitHub.