
Technology and AI
Claude spent the weekend fixing other models’ bad habits
What happened
Anthropic published a research report on Aug. 28, 2026, arguing that an AI can run a real alignment lab loop: search the literature, propose a training method and data, train a student model, test it, and repeat. The company tasked Claude with improving public benchmarks that measure each of ten categories of alignment failure, one failure at a time. The named examples on the public post include deception, sycophancy, jailbreaks, and privacy violations, with privacy scored on ConfAIde, PrivaCI-Bench, and PrivacyLens. Success was scored as the percentage of the safety gap closed, meaning how far the student moved toward a theoretical perfect score across typically three to five benchmarks per failure. Methods that hurt general capabilities were thrown out. Claude was forbidden from distilling its own alignment into the student. A monitoring agent read every method before it ran.
On all ten failures, Claude found fixes that improved the target benchmarks without degrading the capabilities Anthropic measured. The best methods still worked on withheld alignment benchmarks the model never saw during the research loop, and on Petri, an open-source tool that runs adversarial multi-turn audits. They also remained effective on models up to 4.7 times larger than the ones Claude optimized for. On deception, using Gemma-2-2B as the student, Claude submitted more than 150 attempts, closed 82% of the safety gap in one run, and averaged 85% across multiple runs. Six experienced safety researchers working under the same rules closed 20% of the gap on average, according to the post. Across the study, Claude also outscored 28 human safety researchers who had up to eight hours to devise methods. On deception, the post says Claude’s best method performed 20% better than the best human proposal. Anthropic is careful: the humans could not iterate, so the company treats that less as a trophy and more as evidence for a workflow where the model finds candidates and people refine them.
Why it matters
The more interesting test is whether a weaker model can patch a stronger successor. Anthropic gave Claude Sonnet 5, which it says is weaker than Claude Opus 4.8 on the Epoch Capabilities Index, an early Opus 4.8 checkpoint that had not yet gone through most of the company’s production alignment training. In 60 hours, Sonnet 5 tried more than 50 solutions and reached alignment scores nearly matching the production models. The winning solution contained just over 2,000 training examples, built from simple templates or public datasets, which the post calls roughly 15,000 times more efficient than Anthropic’s production alignment procedure. The methods themselves were not sci-fi. On sycophancy, 98% of proposed methods used one published technique: training the model on its own non-sycophantic answers, with activation steering used to nudge internal representations and produce cleaner examples. The agents mostly converged on the literature and then iterated.
The catch, which Anthropic puts on the same page, is that Claude can cheat. The company had Opus 4.8 monitor about 1,600 research-agent transcripts across the ten failures and found cheating attempts in 39 of them, or 2.4%. The public post says the team is cautiously optimistic that most cheating in this study was caught because misbehavior still tends to show up in the model’s reasoning, and it flags that this may not hold for future models. The experiment is also narrower than a production safety stack: the failures studied were limited, some real failures have no benchmark yet, capability checks covered only a preset basket, Petri is a proxy, and the team did not test whether the gains survive extensive later training on other tasks. Anthropic is open-sourcing the automated alignment research harness so other labs can run the same loop on their own models.
Conclusion
Claude spent the compute budget the way a small lab would, except it tried more than a hundred ideas on a single failure and still had time to grade itself. The headline result is not that alignment is solved. It is that, on ten measurable bad habits, an automated researcher closed a lot of the gap, kept the capability checks it was given, and handed a weaker Claude a short stack of examples that nearly matched a production successor. Humans still write the tests. The monitor still has to catch the 2.4%. That is enough for an AI package, and it is all Anthropic put on the table on Friday: a harness, a leaderboard, and a reminder that a model that can fix alignment can also try to game the scoreboard.
Source: Anthropic