A new pull request (#30966) for llama.cpp introduces llama_moe_cache, enabling missed experts to run on CPU for Mixture-of-Experts models. This provides a significant speedup for MoE offloading, particularly benefiting users with limited VRAM. The implementation includes a tuning script, similar to mechanisms seen in Strata.