The MiMo‑2.6‑Pro model (~566 GB FP8) was executed on a Jetson AGX Thor with 128 GB of RAM, achieving a throughput of 0.646 tokens per second while tracing every decoder layer and routed expert. The run demonstrated that the model can load and operate despite the extreme memory pressure, highlighting the trade‑off between model size and inference speed on edge hardware.

Read original