Qwen3.8-27B on a 3090 @ 151tok/s single-stream, bit-exact speculative decoding, full 262k context with a 6/5-bit KV cache

u/Nice_Profession_9078 2026-10-16 UTC

The Qwen3.8‑27B model runs on an NVIDIA RTX 3090 at 151 tokens per second in single‑stream mode, using bit‑exact speculative decoding. It supports a full 262k‑token context window with a 6/5‑bit KV cache compression.