Loopie introduces the most powerful looped Transformer to date, comprising two Mixture-of-Experts models: a 20‑B parameter model with 2‑B active parameters and a 6‑B parameter model with 0.6‑B active parameters. It overcomes the long