Qwen 3.6 27B MTP - Adding spec-type and spec-draft-n-max is dropping tps and reducing GPU utilization
Performance Degradation in Qwen 3.6 27B MTP: Impact of Speculative Decoding Parameters on Throughput A technical report indicates that enabling specific speculative decoding configurations—namely --spec-type draft-mtp an…
→ View original source