1 post

Posts tagged BitNet

All tags

1. 08/16/2026

   I ran Microsoft's BitNet on two CPUs: the 6x shrinks against the Q4 already on disk

   I cloned Microsoft's bitnet.cpp. The README promises 6.17x on CPU. On two machines at home the 4.2x versus f16 showed up; versus the Q4 Ollama already ships, it drops to 1.3x. And the model ships with the wrong activation.

   • #local-llm
   • #bitnet
   • #quantization
   • #cpu
   • #llama-cpp