Surprised by how easy it was to hit 24 GB VRAM with mixed AMD GPUs

Article automatically generated from technical news.

I wanted to share my setup because I was genuinely surprised by how easy it was to reach 24 GB of VRAM, just in case anyone else is interested in doing the same. I have a Ryzen 5600X CPU with 32 GB of RAM, paired with a 16 GB RX 7800 XT. While experimenting with different LLMs, I kept running just a little short on VRAM for what I wanted to achieve, which caused tokens to spill over into system RAM and slow everything down. I decided to try adding my previous GPU, even though online research s

Fonte originale