Best-practices Tag

Best-practices

Posts related to best-practices

44 posts

← Back to all posts

Amazon Admits Its AI Metrics Were Flawed. It Kept Them Anyway.

A year ago Amazon set an 80% weekly Kiro usage target. Then came a deleted production environment, a six-hour storefront outage, a petition for Claude Code, and a token leaderboard staff gamed until it died. Now an engineering memo says the AI metrics are 'deeply flawed' and not using AI can be 'a finding, not a failing.' It's the right memo. It still keeps the meter, and it never says the word Kiro.

Read more →

A Dial Worth Turning: Claude Opus 5's Prose, and the Style Guide Anthropic Wrote Against Its Own Model

Opus 5 writes 510 words where Opus 4.5 wrote 158, with 2.3 times the em dashes and twice the 'load-bearing'. Arena measured it, Hacker News named it, Reddit downgraded over it. Anthropic's answer arrived in Fable 5.1's prompting docs: a paragraph defining 'mannered prose', with the model's own tics as the examples, for you to paste into your prompt. The vendor wrote the style guide against its own model, and shipped it as your job.

Read more →

You Can't Delete a Hallucination

A team's model kept 'hearing' a phrase in videos with no audio. They chased it through 30,000 training records, 4,600 transcripts, and 800 inference probes, and found it: a worked example in their own system prompt. They deleted it. The model just hallucinated a different phrase. The lesson is that the model didn't learn a confabulation. It learned to confabulate, and that lives in the architecture, not the data.

Read more →

The Fifth Rule

Karpathy's four CLAUDE.md rules went viral: ask don't assume, simplest solution first, don't touch unrelated code, flag uncertainty. The most-upvoted reply added a fifth that quietly reverses the whole point: don't hesitate to suggest a better way. The four rules tame a model that wanders. The fifth one trusts a model that thinks. Which set you want depends entirely on which model you're running, and most people copy the file without checking.

Read more →

Benchmarks Are Bullshit

Berkeley just built an agent that games AI benchmarks. Karpathy called it months ago. The best coding model doesn't top the charts, the highest-ranked Chinese models disappoint in practice, and the entire leaderboard industry optimizes for the wrong thing.

Read more →