Grok 4.20 spent approximately 700 turns trapped in the starting house during a Pokémon Red benchmark, repeatedly walking into walls and triggering the mother's dialogue despite its internal reasoning explicitly identifying the persistent loop. The non-reasoning model failed to execute an exit strategy even while documenting its own futile oscillation for hundreds of turns, eventually leaving at turn 36 but not obtaining a starter Pokémon until turn 755.
Read original
reddit/r/LocalLLaMA