https://ai.ngchi.online/tags/distillation/ Recent content in Distillation on AI Notes Hugo en-us Fri, 02 Oct 2026 09:14:53 +0700 https://ai.ngchi.online/posts/the-peak-is-predictable-the-moment-it-arrives-is-not/ Fri, 02 Oct 2026 09:14:53 +0700 https://ai.ngchi.online/posts/the-peak-is-predictable-the-moment-it-arrives-is-not/ A distillation scaling paper predicts peak accuracy to within 0.7 of a point at held-out scales. Its own appendices record three other quantities it could not fit. Counting what it claims against what it delivers.