Skip to content
Hacker News · AI·· 3 h agoAI score58

Bitdepth tests five routine agent jobs: $258.53 on Claude Sonnet 5.5 vs $11.04 on open models

Five agent chores: $258 on a top model, $11 on open models

AI summary

Bitdepth ran five routine agent jobs on Claude Sonnet 5.5 and on gpt-oss-120b and DeepSeek V4 Pro, finding a month of that work cost $258.53 on Claude Sonnet 5.5 versus $11.04 using the cheapest setup that got every answer right, a 95.7% cut. Four of the five jobs moved without a wrong answer, while the inbox digest failed on both open models and was kept on Claude Sonnet 5.5. The test used made-up, single-call jobs with code-graded answers, and the author notes the small sample and that real agents chain calls with longer history.

Source:Hacker News · AI · bitdepth.dev