Every Rate on This Leaderboard Is a Whole Number of Tax Returns
Surge AI’s DAYJOB: Tax leaderboard publishes pass rates to one decimal place. Every one divides into whole trials out of 250, and second and third place are one tax assignment apart.
Surge AI’s DAYJOB: Tax leaderboard publishes pass rates to one decimal place. Every one divides into whole trials out of 250, and second and third place are one tax assignment apart.
Project Zero compared a fuzzer against an LLM bug-finding agent on Chrome’s V8. Three filters produce two changes of lead, and the two overlap figures measure different things.
Cloudflare and the SGLang maintainers published coordinated reports on the same cross-request KV cache leak. Both are candid; the blast radius is in one and the twenty-month exposure window is in the other.
Cerebras published every step of fitting a 3T-parameter model onto 59 wafer-scale chips, ending at 190 concurrent requests. The architecture checks out; one disclosed cache assumption, which its own docs contradict, halves the answer.
A press release and its own preprint agree on every number. The paper’s only surviving predictor falls outside the sentence the release was making.
WhatsApp’s hidden support-AI instructions told the chatbot not to recommend regulators or cite privacy laws in cases where its public policy names those routes.
HybridAgent makes latent reasoning readable, but its evidence tests relevance and readability rather than semantic faithfulness.
Apple’s MLX post verifies on every load-bearing figure. Its best number sits in a table tab that is not server-rendered, so a fetcher-based reader never sees it. A full recount of all 32 parallelism cells.
An agent benchmark where the top performer on functional tests wrote the least secure code. Three interventions measurably help, two do not, and two weakness families stay near zero throughout.
Five elicitation methods were run against a model with a chemistry classifier encrypted into its weights. Four returned chance accuracy. The fifth recovered it by enumerating all 256 possible triggers, which the authors say themselves.