Recent developments in the AI sector indicate a strategic shift from massive pretraining toward post-training, continual learning, and architectural consolidation. Ilya Sutskever’s Safe Superintelligence (SSI) is reportedly preparing to release its first model this month. SSI, which holds a $32B valuation, focuses on a thesis of sample-efficient and continual learning; the goal is to move away from the current paradigm of training on up to 300 trillion tokens toward a method where models pretrain on roughly 10 trillion tokens before learning efficiently in real-world deployment. Simultaneously, xAI is accelerating its release cycle, with Grok 4.6—utilizing the 1.5-trillion-parameter architecture of version 4.5—expected around August 7. This model relies on improved supervised fine-tuning and reinforcement learning rather than parameter scaling. It will be followed weeks later by Grok 4.7, a 2.1T parameter model designed for superior token efficiency. Additionally, ByteDance has launched SeedRealtime, a natively full-duplex audio-video-text model integrated into the Doubao app. Unlike traditional cascaded pipelines (ASR → LLM → TTS), SeedRealtime uses a unified architecture to process continuous multimodal streams. This approach reportedly reduces turn-taking and pacing issues by approximately 50%, facilitating proactive interaction and improved joint audio-video understanding by using visual context to disambiguate homophones.
Read original
dev.to