Skip to content
Only Opinion#Benchmarks
November 13Friday
  1. Hacker News · AI30

    The Singularity Clock v1.4.0 Tracks AGI, Singularity and ASI Timelines

    The Singularity Clock v1.4.0 is a public measurement instrument that projects AGI around April 2027, the Singularity around December 2029 and ASI around December 2031, all holding flat since November. Its 14 signals include METR task horizon at 11.4 hours (+38% QoQ), SWE-bench Verified at 88.2%, Humanity's Last Exam at 38.9% and ARC-AGI-2 at 62.4%. The project reports a capability-to-safety velocity ratio of 1.77× and publishes its methodology and code on GitHub under CC-BY-4.0.

  2. Hacker News · AI68

    Have AI timelines suddenly moved? Re-examining Anthropic's acceleration and the flat frontier

    A review of METR's report on AI R&D acceleration at Anthropic and the follow-on analyses finds Anthropic's capabilities growth shifted trend around October 2025, near Opus 4.5, but competing labs did not speed up and the overall frontier has stayed on its prior trend. The author weighs compute growth, which rose about 5.7-fold at Anthropic in 2025 versus 4.5-fold at OpenAI and 3.8-fold at Google DeepMind, against AI building AI, where METR attributes roughly 80% of the acceleration using redacted data outsiders cannot verify. Depending on which scenario holds, the chance of a superhuman AI researcher in 2027 ranges from about 70% under METR's headline figure to about 20% using only public Epoch numbers and the field's earlier trajectory.

November 11Wednesday
November 10Tuesday
  1. One Useful Thing78

    Ethan Mollick tests Claude Fable 5.2 across coding, business and research, calling it almost AGI

    2 on tasks spanning hardware hacking, business planning, humanities course building, academic research and a 450-world 3D portal project, and judged it almost AGI under his definition of matching most human experts at most computer-based intellectual tasks.

    Why it matters: Ethan Mollick's hands-on tests of Claude Fable 5.2 show strong general capability across coding, business and research, while exposing a persistent gap in self-judging when work is good enough.

  2. Latent Space58

    What Frontier Labs Buy: A Data Deep Dive with Handshake AI's Garrett Lord and Team

    Handshake's AI training business went from launch to $1 billion in gross annualized revenue in roughly a year, and this Latent Space deep dive with Garrett Lord and his team walks through the reinforcement learning environments frontier labs buy. In a finance demo, an agent working a simulated bank's email and deal files carries a goodwill figure into Python and subtracts it, a mistake that shows where expert judgment still beats the model. The team also presents VIALS, its benchmark for interpreting scientific images, and traces an agent's tool calls through safety simulations including CAREBench.

October 26Monday
  1. Import AI62

    Import AI 478: Math for alignment, ProgramBench, and Mirendil's RSI signal

    Import AI 478 rounds up four developments: AI safety startup Resolution autoformalized the resolution of singularities in Lean using orchestrator agents, at an estimated $135,000 in token spend over about a week. Claude Opus 5.5 reached 18.5% resolved on ProgramBench, up from 0% for every model when the benchmark launched in May. OpenAI described agents in separate microVMs exchanging synthetic secrets via processor cache timing, and Mirendil reported one researcher pretrained a 100B-500B parameter coding model in 3.5 months for under $10m in compute.

October 20Tuesday
  1. One Useful Thing40

    Ethan Mollick's Co-Existence Charts 30 Months of AI Progress, Made by Claude Opus 5.5

    Ethan Mollick published Co-Existence, his second AI book, 30 months after Co-Intelligence, and used Claude Opus 5.5 in Claude Projects to generate the post's charts and an "otter on an airplane using wifi" video in minutes. He notes 180 models now outperform GPT-4 at release, 19 of which run on a modern smartphone, while METR's Long Horizon Benchmark rose from a four-minute task in 2024 to 17 hours of human work by April 2026 before the benchmark ran out.

October 6Tuesday
  1. LiveKit Blog38

    Retell vs. Vapi vs. LiveKit: A Developer Comparison for Voice AI Agents

    LiveKit published a developer-focused comparison of Retell, Vapi and LiveKit for building voice AI agents, framing the choice around four questions: who iterates on the agent after launch, what happens when needs fall outside defaults, whether it must run beyond phone calls, and cost at scale. Retell is a managed platform with a visual editor, Vapi a developer-oriented managed platform configured via API and dashboard, and LiveKit an Apache 2.0 open source framework with self-hosting. Estimated all-in cost per minute runs about $0.070–$0.310 for Retell, $0.070–$0.116 for Vapi and $0.037–$0.099 for LiveKit.

September 18Friday
  1. Every42

    Vibe Check: Is GPT-6 Astra a Breakthrough for Indie Filmmakers?

    Creative studio Afterimage tested GPT-6 Astra on footage from real shoots to see whether its Blender 3D skills carried over to visual effects work. Astra handled tasks ranging from replacing a dish in a moving pan to adding a building to a Brooklyn street and making a giant parade float appear outside a window in handheld iPhone footage. Some shots worked and others didn't, but the team ended up dreaming up effects they'd never have attempted before.

July 14Tuesday
  1. AI as Normal Technology34

    Princeton Researcher's ICML Keynote: What Will Be Left for Us to Work On?

    A Princeton University researcher used an ICML keynote to argue that the "AI as Normal Technology" framework holds unless a discontinuity such as recursive self-improvement arrives, and that no lab milestone will suddenly eliminate all jobs. The talk urges building complementary skills, agency and judgment rather than racing to accumulate wealth before skills become irrelevant.

July 1Wednesday
  1. One Useful Thing60

    Ethan Mollick on the twilight of chatbots and the rise of agent-run work

    Ethan Mollick argues that AI use is shifting from chatbot co-intelligence toward long-running agents that need less human intervention, and that this change is happening fast. He cites METR, the UK AI Security Institute and GDPval benchmarks rising faster than exponential, plus an Epoch finding that Opus 4.7 worked alone for 14 hours to build a software package estimated at 2-17 weeks of human engineering for $251 in tokens. An OpenAI and academic economists study found a quarter of OpenAI workers run at least four agents weekly, with legal and HR adopting at nearly the same rate as coders, and a Claude Code study found domain expertise, not profession, predicted success.

June 18, 2025Wednesday
  1. Vapi Blog22

    Claude vs ChatGPT: The Complete Comparison Guide

    Claude and ChatGPT are compared across conversational quality, context memory, speed, features, creative writing, research, pricing, and interface. Claude handles up to 200,000+ tokens for Pro users and excels at creative writing and nuanced conversation, while ChatGPT supports 128,000 tokens, responds in 2-3 seconds versus Claude's 5-10 seconds, and offers image generation and Custom GPTs. Both Pro tiers cost $20 per month, with Claude Max at $100-$200 and ChatGPT Pro at $200.

June 5, 2025Thursday
  1. Vapi Blog22

    GPT-4.1 vs Claude 3.7 Sonnet: Which AI Delivers Better Voice Agents?

    Vapi compares GPT-4.1 and Claude 3.7 Sonnet as the LLM behind voice agents, weighing conversation quality, context handling, reasoning transparency, platform integration and cost. GPT-4.1 offers a 1,000,000-token context window and 32,768-token outputs with 75% caching discounts, while Claude 3.7 provides a 200,000-token context and 128,000-token outputs. Both models are selectable on Vapi's voice agent platform.

May 30, 2025Friday
  1. Vapi Blog15

    Best Speechify Alternatives: 5 TTS Tools Compared

    A comparison of five Speechify alternatives picks NaturalReader for cross-device use and app integrations at $119 per year, Voice Dream Reader for iPhone voice control at a $14.99 one-time price, and Murf AI for professional voices from about $19 per month. ReadSpeaker focuses on reading web pages across 45 languages from $4.90 per month, while Balabolka is a free Windows-only option.