Skip to content
Hot eventDeveloping

Anthropic engineer says chaos testing hardened Claude Docs before launch

1 reports1 reporting sourcesUpdated 16 h ago

Start here

AI digest

An Anthropic engineer says the company ran a deliberate "chaos loop" on a staging cluster for about two weeks before Claude Docs launched on September 16, breaking components on purpose and letting Claude propose and ship fixes. By September 22 users had created over 4.6 million docs, and across 2 billion requests the service logged only 60 server errors with no rollbacks, running on about 50 memory-optimized pods. The engineer estimates the loop used roughly $125,000 of inference at Claude Fable 5.2 list price, and puts a comparable two-week push for a small team's stack at $3,000 to $10,000. These figures are the engineer's own estimates, not independently verified results.

Generated from reports · updated 38 min ago

Report timeline

Follow the reports to see the event from different sides.

November 17
  1. Anthropic · Claude.devPicks
    Anthropic engineer explains the chaos loop that hardened Claude Docs to 60 server errors across 2 billion requests

    An Anthropic engineer describes running a Claude Code chaos loop on a staging cluster for about two weeks before Claude Docs launched on September 16, breaking components on purpose and letting Claude propose and ship fixes. By September 22 users had created over 4.6 million docs, and across 2 billion requests the service saw only 60 server errors with no rollbacks, running on about 50 memory-optimized pods. The author estimates the loop used roughly $125,000 of inference at Claude Fable 5.2 list price and puts a comparable two-week push for a small team stack at $3,000 to $10,000.

Heat for this event

Not enough continuous observations yet to draw a trend.