Percepta unveiled Spotlight, a novel architecture that decouples intelligence from memory by replacing traditional attention mechanisms with an unbounded memory store. Spotlight enables infinitely growing memory without raising access costs, as each token learns to index and interact with only a small subset of memory cells. This design allows the model’s knowledge and skills to expand over time without modifying its weights.

Read original