The user employed Claude and Grok to build two offline dashboards for monitoring their local AI box. One dashboard displays real‑time machine metrics such as tokens/sec from llama.cpp, hardware utilization, temperatures, fan speeds, power draw, and estimated electricity cost. The other tracks model training jobs, providing ETAs and progress details for tasks like running Qwen 3.6 35B on llama.cpp and training a custom encoder.
Read original
reddit/r/LocalLLM