Telperion has released latent‑attention variants of the Qwen3.8‑27B model, quantized to FP8 KV cache, which compress the KV cache by 4×. This reduction allows nearly a 4× increase in maximum context length on consumer hardware or concurrency on server hardware. The variants deliver a statistically significant performance improvement of approximately +6 points.

Read original