Which LLMs will run on the Mac Mini and Studio
Article automatically generated from technical news.
A mildly interesting video about which models can run on the Mac Mini and Studio. As expected current foundational models such as Kimi K3 1.4 TB, if they were even available to run locally, won't fit. Assuming it were available locally it may be possible in the next couple of years with the rapid increase in hardware capabilities - M7, M8? https://www.youtube.com/watch?v=eDoWKgFqRM4 submitted by /u/Caprichoso1 to r/LocalLLM [link]
Fonte originale