The user successfully ran the Qwen3.8‑Flash‑Next‑GSQ‑RCO‑IQ1_M model on an AMD RX 6600M GPU with 8 GB VRAM and 32 GB DDR4 RAM by creating a custom HIP virtual environment for the gfx1030 architecture and compiling Strata themselves via a pi‑agent and Tiel Coder. After manually downloading GGUF files and extracting the necessary components, the setup achieved roughly 20 tokens / second with a 100k‑token context window. They note that, despite the accomplishment, running the model on this hardware is of little practical value.

Read original