A Reddit user on r/LocalLLM contrasts Sam Altman's criticism of consumer RAM efficiency with their local AI setup running a 2-bit quantized Qwen 3.8 Flash Next model at 60 tokens/sec on a Ryzen 7 5800X, RX 9070, and 48GB DDR4. They are developing "Marika," a 3D AI desktop companion in Unity that observes the desktop, interacts with windows, and converses via a local LLM, demonstrating practical consumer-hardware inference for interactive agents.

Read original