A developer has open-sourced mlxtop, a Rust-based monitoring tool for local LLMs running on Mac. It displays critical system vitals including memory usage, compression, paging, and Metal GPU stats, and with oMLX support, it also tracks generation speed and request activity during model responses. The project was built entirely using Duet, a dual-model coding agent, and is available on GitHub.
reddit/r/LocalLLM