Articles tagged "llama.cpp"

A guide to JustVugg/colibri, a pure-C engine that hit GitHub Trending by running the 744B GLM-5.2 MoE model on consumer hardware via on-demand expert streaming from disk. Covers how it works, supported models, build/usage, hardware requirements, and how it differs from llama.cpp, Ollama, Edge0, and turbo-fieldfare.

Unsloth Dynamic 3.0 is a GGUF quant method with fresh imatrix data, up to 10% higher accuracy at same size vs 2.0. Sizes, VRAM, setup. Updated Aug 2026.

Start with Q4_K_M; step up to Q5_K_M or Q6_K if you have VRAM headroom. This guide explains GGUF naming, the quality/speed/VRAM tradeoffs per level, IQ (imatrix) quants, and how to choose by task. Updated July 2026.