A Reddit post details a validated configuration for running DeepSeek V4 Flash-0731 using 16 RTX 5060 Ti 16GB GPUs connected via two PLX PEX88096 switches (eight GPUs per island) on an ASRock Rack SPC621D8U-2T/OVH motherboard with dual Xeon Gold 6330 CPUs. The setup runs Ubuntu 22.04.5 LTS with kernel 6.8.0-106-generic and uses an Aikitoria-patched NVIDIA open driver version 610.43.02-p2p, requiring 16,384 MiB of BAR1 memory on each GPU. The configuration prioritizes stability and scalability over performance optimization, leveraging commodity hardware and standard networking components.

Read original