🛠️ Capy-flash – a 125B MoE model on two 16 GB consumer GPUs

Summary
Capy-flash is a 125B mixture of experts model that runs on two 16 GB consumer GPUs.

Why it’s interesting
It enables running a large 125B MoE model on standard consumer hardware.

Source metrics: Points 2 · Comments 0
HN discussion · Project
Source: #HackerNews / Show HN