Researchers have identified a critical architectural vulnerability in how major AI providers, including OpenAI, Anthropic, and Google, handle proprietary reasoning traces. To manage the massive storage overhead of step-by-step reasoning, companies encrypt these traces on the server and return them to the client, who stores them and passes them back in subsequent requests. While the encryption itself is robust, the system utilizes a unified logical encryption scheme to ensure cross-model compatibility within a provider's ecosystem. This allows "reasoning tokens" from a frontier model like GPT-4 to be processed and decrypted by a weaker model like GPT-3.5. Attackers can exploit this by injecting a high-level reasoning token into a weaker model—which lacks rigorous output safeguards—to force it to output the proprietary reasoning in plaintext. This vulnerability has already led to significant data exposure; researchers harvested 315,320 encrypted reasoning blocks from public repositories like GitHub, uncovering 367 personally identifiable information (PII) artifacts and 182 credentials, including database passwords and API keys. The research suggests that to prevent such leakage, companies must move away from interchangeable tokens by implementing context-dependent encryption or by retaining reasoning traces exclusively on secure, server-side infrastructure.

Read original