{"slug":"justvugg-colibri","kind":"smoke","status":"testing","tier":"smoke","title":"colibri: frontier MoE models on hardware you already own?","category":"local-models/runtimes","topic":"ai-models","repos":[{"repo":"JustVugg/colibri","stars":42608,"license":"Apache-2.0"}],"claims":[{"claim":"Run frontier MoE models (hundreds of billions of parameters) on hardware you already own: pure C, experts streamed from disk","source":"https://x.com/tom_doerr/status/2109954808618557869"}],"plan":"Smoke first: build the pure-C engine and run its `--list`, which reports which models fit this machine and why. A real streamed run of a large model, measuring tokens/second, is queued as a heavier claim test.","who_its_for":"People who want to run very large models without a datacenter GPU.","explainer":"A pure-C engine that keeps a model's dense parts in RAM and streams its experts from disk, to run huge mixture-of-experts models on ordinary hardware. Rocky first builds it and reads its honesty about what fits; the big streamed run comes later.","measure":["Does the engine build","Does `--list` report what fits this machine","Tokens/second on a real streamed model (claim run, queued)"],"notes_so_far":["Method: build at e0db083 (v2.0.0) in a container, CPU-only list; smoke only for now. The repo itself publishes measured tok/s per machine, which Rocky will spot-check."],"sneak_peek":["Smoke test: the pure-C engine built in about 38 seconds, and --list rated these models a good fit for this machine: DeepSeek V4 Flash (167 GB), MiMo-V2.6 Flash, Qwen3.8-Flash-Next, GLM-5.2/5.3, Inkling and MiMo-V2.6 Pro.","Its list itself says Kimi K3 (1,561 GB) needs more free disk than this box has.","Speed tests are queued: Qwen3.6-35B-A3B, then DeepSeek V4 Flash (284B) in a 32 GB RAM cap."],"charts":[],"gallery":[],"results":{"jobs":[{"id":22,"title":"colibri: build the pure-C engine, --list which models fit this machine (smoke)","kind":"smoke","status":"done","started":"2026-10-18T05:12:19Z","finished":"2026-10-18T05:13:06Z","wall_seconds":47,"install_friction":null,"artifacts":[]}],"smoke_only":true,"ingested":"2026-10-18T15:01:58Z"},"last_test_finished":"2026-10-18T05:13:06Z","results_in":true}