Sakana AI Researchers Introduce PC-ALM, a Layer-Local Alternative to Backpropagation That Trains 1000-Layer Networks

Sakana AI researchers introduced PC-ALM (Augmented Lagrangian Predictive Coding), a layer‑local training method that augments standard predictive coding with one Lagrange multiplier per layer. This approach preserves the…

→ View original source

NVIDIA Open-Sources OSMO: A Kubernetes-Native Orchestrator That Runs Physical AI Training, Simulation, and Robot Hardware Tests From One YAML File.

NVIDIA has released OSMO as an open‑source, Kubernetes‑native orchestrator that enables users to define end‑to‑end AI workflows—training, simulation, and robot hardware‑in‑the‑loop testing—in a single YAML file. The syst…

→ View original source

Can LLMs Engineer Their Own Agent Harness? ByteDance Seed’s HarnessDev Says Only 34 of 64 Changes Generalize

Most agent benchmarks freeze the harness and grade the model inside it. That hides the part of the system doing much of the work, and ByteDance Seed just built a benchmark that grades

→ View original source

Open-source fused Gated DeltaNet-2 training kernels for TPU v5e in JAX/Pallas

I released an independent open-source implementation of fused Gated DeltaNet-2 training kernels for TPU v5e using JAX/Pallas. Repository: https://github.com/Akseleu-J/atomic-op

→ View original source

Solving the 30-Year Memory Paradox: Why Mamba Forgets, and How Lie-Group SO(2) Unitary Rotation Unlocks Lossless State Spaces (QU-SSM)

For over thirty years, recurrent sequence modeling has been haunted by an unsolved mathematical paradox. Ever since Hochreiter (1991) and Bengio (1994) formulated the vanishing and exploding grad

→ View original source

DeepSeek AI Released DeepSeek-V4.1-Flash with 1M Context, FP4 KV Cache, and Cross-Layer Attention Reuse

Sparse attention already cut long-context compute. The KV cache sitting in HBM and on SSD is now the bottleneck DeepSeek AI went after, and they cut theirs to 890 bytes per token. T

→ View original source

Breaking the Transformer Memory Wall: How Isometric Associative Memory (ISOM) Achieves O(1) Inference at 128K Context (Open Weights & Benchmarks)

Researchers have developed Isometric Associative Memory (ISOM), an open-source architecture that maintains flat inference memory usage regardless of context length, addressing the transformer memory wall where Key-Value …

→ View original source

DePEFT: Crowdsourcing LLM training/fine-tuning without a centralized cloud.

A while ago, I successfully trained a tiny 80M parameter language model from scratch using the TinyStories dataset. It worked surprisingly well and could generate coherent little stories! Inspired

→ View original source

Neve - Towards a Unified Programming Model for the Complete Deep Learning Stack

  submitted by   /u/Tryingyang   to   r/machinelearningnews [link]   [comments]

→ View original source

[R] Spanda: Fast Lexical Entropy Matches DeBERTa Semantic Uncertainty—Until Frontier Models Break It

A new preprint introduces Spanda, a fast lexical entropy method for uncertainty quantification that matches DeBERTa-based Semantic Entropy performance without requiring GPU-intensive clustering. Benchmarks across 1.5B to…

→ View original source

NVIDIA Releases Personal AI Router (PAIR): An Open Source Virtual Inference Router that Distributes Local AI Requests Across RTX, DGX Spark, and Mac Nodes

NVIDIA Releases Personal AI Router (PAIR): An Open Inference Router That Turns The RTX, DGX Spark And Mac Boxes You Already Own Into One Local AI Cluster. No new cluster API. No age

→ View original source

Meta AI Released Muse Spark 1.3: An Agentic Coding Model That Uses ~20% Fewer Tool Calls and ~25% Fewer Tokens Than Muse Spark 1.2

Meta AI introduced Muse Spark 1.3, an agentic coding model that reduces tool calls by ~2

→ View original source

Perplexity Open Sources Lily: A Rust + Metal Inference Engine for Qwen3.6-35B-A3B on Apple Silicon

Perplexity has open-sourced Lily, a specialized local inference engine developed in Rust with hand-written Metal kernels. Unlike general-purpose runtimes, Lily is optimized specifically for the Qwen3.6-35B-A3B model on A…

→ View original source

Researchers from Princeton, Ant Group and Stanford Introduce AQuA: A Two-Part Agentic Framework for Autonomous Factor Discovery and Model Development in Quantitative Finance

Researchers from Princeton, Ant Group and Stanford introduced AQuA, a two‑part agentic framework for autonomous factor discovery and model development in quantitative finance. The framework separates symbolic factor disc…

→ View original source

Keenable AI Open-Sources NEEDLE: A Live Search Benchmark That Rebuilds Its Query Set Every Hour

Most search benchmarks are a fixed question set with a public answer key. That's not a benchmark for agents — because an agent with a fetch tool can just download the key mid-evaluati

→ View original source

Google AI Introduces EnvHarness: A Programmable Layer That Turns Static Agent Environments Into Adaptive Training Worlds

Google AI has introduced EnvHarness, a programmable layer that transforms static agent environments into adaptive training worlds. It wraps existing environments via standard reset/step interfaces, allowing LLM designers…

→ View original source

Ant launches Ling-3.0-flash-Fin: 124B MoE, 5.1B active, 262K context

Ant's Ling team has released Ling-3.0-flash-Fin, a finance-focused mixture-of-experts model built on Ling-3.0-flash. The model has 124B total parameters and about 5.1B active. OpenRo

→ View original source

Vercel AI Open-Sources vgpu: A TypeScript WebGPU Library for AI Agent Shaders

Vercel open-sourced the WebGPU library it built to ship the shaders on vercel.com. vgpu runs the same shader in the browser, in headless Node.js, and in your CI tests. • MIT licen

→ View original source