A pull request to ggml-org/llama.cpp implements Qwen4Exp QSA selection without the kq_mask, saving gigabytes of VRAM. The optimization targets Qwen Flash Next and improves memory efficiency for mixture-of-experts model caches. The approach mirrors techniques used by Strata to maximize utilization of the experts' cache.

Read original