Liquid AI has open-sourced Antidoom, a Final Token Preference Optimization (FTPO) method designed to eliminate repetition "doom loops" in reasoning models. Unlike traditional fixes that reweight the entire output distribution, Antidoom targets the issue by retraining exactly one position. This approach distinguishes single-token failures from whole-distribution problems to improve model stability.
Read original
reddit/r/machinelearningnews