Skip to content
Import AI· Jack Clark·· 11 d agoAI score42

Import AI 479: Spacewar, low-latency tasks versus LLMs, Genie 4

Import AI 479: Spacewar; low-latency tasks versus LLMs; Genie 4

AI summary

Import AI 479 covers Realtime-Bench, a 50-task benchmark of 30 web and 20 game tasks built by researchers at UT Austin, Ohio State, UIUC, NVIDIA, Northwestern and Steadyworks to test whether frontier models can act under real-time pressure. GPT-6 Astra (high) scored the highest wall-clock pass rate at 36%, while paused-clock runs let high-reasoning models reach roughly 70% to 80%. The issue also covers the Defense Intelligence Agency's "Challenges to Security in Space" report and Genie 4.

Source:Import AI · importai.substack.com