The Qwen3.8-27B CUDA megakernel achieves ~140 tokens per second on a single RTX 3090, delivering 1.4–1.9× the speed of llama.cpp. Accuracy remains high, with a KL divergence of only 0.0009 relative to the llama.cpp benchmark. Code and benchmarks are provided in the linked GitHub repository.
Read original
reddit/r/LocalLLaMA