Reddit user u/macaronianddeeez published a roundup of inference engines enabling LLMs larger than VRAM to run on consumer hardware. The research covers projects including Strata, Maya, Xolotl, and engines from DeepSeek and MiniMax, organized with AI assistance for hardware planning purposes.

Read original