Qwen 35B does 154 tok/s on 2024 Macbook M4 Pro 48GB with Kapitsa: Open-source Apple Silicon optimized custom Metal engine built for Qwen. See benchmarks of Qwen 3.8 27B, Qwen3.6 35B, 3.8 Flash-Next on M1 Pro (16GB), M4 Pro (48GB) and M5 Max (128GB)

u/DotaMate 2026-10-19 UTC

Kapitsa is an open‑source, Metal‑accelerated inference engine for Qwen models optimized for Apple Silicon. It achieves a throughput of 154 tokens per second running the Qwen 3.6 35B model on a 2024 MacBook M4 Pro with 48 GB RAM. Benchmarks also report performance for Qwen 3.8 27B and Qwen 3.8 Flash‑Next variants on M1 Pro (16 GB), M4 Pro (48 GB) and M5 Max (128 GB) systems.

Read original

→ View original source

← Back to homepage

Qwen 35B does 154 tok/s on 2024 Macbook M4 Pro 48GB with Kapitsa: Open-source Apple Silicon optimized custom Metal engine built for Qwen. See benchmarks of Qwen 3.8 27B, Qwen3.6 35B, 3.8 Flash-Next on M1 Pro (16GB), M4 Pro (48GB) and M5 Max (128GB)

Related Articles

The Guardian's warning to "reject cheap Chinese AI" is a transparent attempt to scare developers back into the high-margin, cloud-hosted AI