The author developed colibrì, a memory‑hierarchy system that unifies SSD, RAM, and GPU to run large language models—such as a 17 B‑parameter model—directly from inexpensive SSDs on ordinary consumer hardware. By treating storage as an extension of RAM/VRAM, colibrì enables models that exceed memory limits, including hundred‑billion‑parameter models, to operate without requiring costly specialized machines.

Read original