AI Benchmarks

Two stacked racks of plates, one row removed and set aside

One Dropped Benchmark Row Doubles d1-3B's Lead

Liquid AI published the same benchmark table twice: eight rows in the model card, seven in the launch post. The missing row is the only one the 3B model loses, and dropping it doubles its lead.

Many identical spheres funnelled through a gate, one emerging lit among dark ones

Do Not Guess: The Sentence That Cut Invented Fields by Two Thirds

A third-party benchmark finds one prompt sentence cuts invented fields from 70.7% to 20.2% across 16 models, and that a paid API on a free tier fabricated more than 13 of them.