Skip to content
Epoch AI · Gradient Updates· Kelly Hong·· 18 d agoAI score58

Epoch AI tests AI on its own research tasks, top models score 65% and fail all

We tried to automate Epoch

AI summary

Epoch AI expanded its earlier effort to automate a senior researcher's job into the Epoch Automation Reports, evaluating AI on real Epoch tasks like graphic design and research planning against the same standards used for human employees. 1 and GPT-6 Astra averaged 65% on the rubric, but a 65% score still counts as a failed task, since every submission would be rejected or revised if a human had made it.

Source:Epoch AI · Gradient Updates · epochai.substack.com