Blockway's Agens Volundr 32B Preview is a 32‑billion‑parameter model built on a proprietary hybrid architecture in which only 18 of the 72 transformer layers maintain a key‑value cache, reducing memory footprint for long‑context inference. Released under an Apache‑2.0 license, the model was trained on limited compute and is presented as an early preview with known shortcomings.

Read original