A pull request #29864 refactors Intel XMX matrix engines in llama.cpp, dramatically accelerating speculate decoding on a B70 GPU running SYCL. The update lowers token verification cost, allowing a higher n‑max and resulting in faster token generation (e.g., ~38 tok/s versus ~36 tok/s in a 30B Muse Glimmer Q6_K test).
Read original
reddit/r/LocalLLaMA