Solving the 30-Year Memory Paradox: Why Mamba Forgets, and How Lie-Group SO(2) Unitary Rotation Unlocks Lossless State Spaces (QU-SSM)

Article automatically generated from technical news.

For over thirty years, recurrent sequence modeling has been haunted by an unsolved mathematical paradox. Ever since Hochreiter (1991) and Bengio (1994) formulated the vanishing and exploding gradient problem, deep learning accepted an unspoken Faustian bargain: The Stability-Amnesia Paradox: If the spectral radius of your recurrence exceeds unity (ρ(A) > 1.0), gradients explode exponentially to infinity, crashing floating-point registers into NaN. Therefore, to guarantee mathematic