Epoch AI · Gradient Updates· Kelly Hong·· 18 วันที่แล้วคะแนน AI58
Epoch AI tests AI on its own research tasks, top models score 65% and fail all
We tried to automate Epoch
เนื้อหานี้ยังไม่มีในภาษาของคุณ จึงแสดงเป็นEnglish
สรุปโดย AI
Epoch AI expanded its earlier effort to automate a senior researcher's job into the Epoch Automation Reports, evaluating AI on real Epoch tasks like graphic design and research planning against the same standards used for human employees. 1 and GPT-6 Astra averaged 65% on the rubric, but a 65% score still counts as a failed task, since every submission would be rejected or revised if a human had made it.
แหล่งข่าว:Epoch AI · Gradient Updates · epochai.substack.com