I wrote a from-scratch Vulkan inference engine for one model (Qwen3.6-35B-A3B) on RDNA3 — 1.44x llama.cpp decode, token-exact parity
TL;DR — I hand-wrote a Vulkan compute engine specialized for a single model (Qwen3.6-35B-A3B) on RDNA3. It decodes at 190.7 tok/s vs llama.cpp's 132.3 on the same GGUF and the same card — 1.
→ View original source