https://ai.ngchi.online/tags/inference/ Recent content in Inference on AI Notes Hugo en-us Wed, 23 Sep 2026 14:27:17 +0700 https://ai.ngchi.online/posts/deepseek-v41-flash-and-the-kv-cache-problem/ Wed, 23 Sep 2026 14:27:17 +0700 https://ai.ngchi.online/posts/deepseek-v41-flash-and-the-kv-cache-problem/ DeepSeek-V4.1-Flash is bigger than its predecessor and cheaper to run. The savings come from cutting KV cache to 890 bytes per token - about a quarter of the previous model.