Best-practices Tag

Best-practices

Posts related to best-practices

37 posts

← Back to all posts

You Can't Delete a Hallucination

A team's model kept 'hearing' a phrase in videos with no audio. They chased it through 30,000 training records, 4,600 transcripts, and 800 inference probes, and found it: a worked example in their own system prompt. They deleted it. The model just hallucinated a different phrase. The lesson is that the model didn't learn a confabulation. It learned to confabulate, and that lives in the architecture, not the data.

Read more →

The Fifth Rule

Karpathy's four CLAUDE.md rules went viral: ask don't assume, simplest solution first, don't touch unrelated code, flag uncertainty. The most-upvoted reply added a fifth that quietly reverses the whole point: don't hesitate to suggest a better way. The four rules tame a model that wanders. The fifth one trusts a model that thinks. Which set you want depends entirely on which model you're running, and most people copy the file without checking.

Read more →

Benchmarks Are Bullshit

Berkeley just built an agent that games AI benchmarks. Karpathy called it months ago. The best coding model doesn't top the charts, the highest-ranked Chinese models disappoint in practice, and the entire leaderboard industry optimizes for the wrong thing.

Read more →