CPU inference DDR3/DDR4

Article automatically generated from technical news.

Wondering if anyone on here has actual benchmarks for CPU only inference DDR3 or DDR4 servers, im budget bound and my options are limited to legacy systems unfortunately. Heres what data I found but not sure its accuracy in real life especially how NUMA effects it (octa channel) submitted by /u/Appropriate_Duck1778 to r/LocalLLM [link] [comments]

Fonte originale