User benchmarks DeepSeek-V4.1-Flash (MLX-Serve 26.11.2) on single and dual M5 Ultra 512 GB Mac Studios. The dual-node configuration uses one Thunderbolt RDMA link with expert splitting, currently limited by MLX-Serve software. Performance scales with the second node, though full 6-link Thunderbolt potential remains untapped pending software support.
Read original
reddit/r/LocalLLM