shura.cpp is a fork of llama.cpp that adds a VRAM governor, allowing a 35 B Mixture‑of‑Expert model to share a single 16 GB GPU with the host desktop. This prevents stutter when running other applications such as a web browser or video calls. The modification dynamically allocates VRAM instead of reserving a fixed extra amount.
Read original
reddit/r/LocalLLM