https://ai.ngchi.online/tags/quantization/ Recent content in Quantization on AI Notes Hugo en-us Wed, 23 Sep 2026 14:35:36 +0700 https://ai.ngchi.online/posts/ternary-bonsai-2-27b-a-27b-model-in-6gb/ Wed, 23 Sep 2026 14:35:36 +0700 https://ai.ngchi.online/posts/ternary-bonsai-2-27b-a-27b-model-in-6gb/ A 27B model squeezed into 5.95GB at 1.72 bits per weight, claiming 98.2% of full-precision performance on its own benchmark suite - and what that compression actually costs.