The Qwen3-0.6B model has been converted into a Mixture-of-Experts (MoE) model as part of an ongoing MoE-fication project. Recent attempts to refine the conversion yielded limited improvements, with GGUF compatibility identified as a major limiting factor. The author prioritized GGUF compatibility for broader usability, accepting trade-offs in potential gains, and has released another modification.
Read original
reddit/r/LocalLLaMA