Skip to content
July 14Tuesday
  1. AI as Normal Technology34

    Princeton Researcher's ICML Keynote: What Will Be Left for Us to Work On?

    A Princeton University researcher used an ICML keynote to argue that the "AI as Normal Technology" framework holds unless a discontinuity such as recursive self-improvement arrives, and that no lab milestone will suddenly eliminate all jobs. The talk urges building complementary skills, agency and judgment rather than racing to accumulate wealth before skills become irrelevant.

July 13Monday
  1. Vapi Blog58

    Vapi Humanness Index: Grok TTS scores 95 and MiniMax Speech 2.5 scores 93 against a real human at 100

    Vapi's Humanness Index, a blind crowdsourced leaderboard where listeners pick which of two cloned voices sounds more human, places xAI's Grok TTS at 95 and MiniMax Speech 2.5 at 93 against a real human recording scored at 100 after more than 11,000 votes. Every battle uses the same cloned voice and script across models, and the real human recording is included in the comparison set, so a 95 means listeners chose Grok TTS at nearly the same rate as the human on the same quote. Vapi argues naturalness is no longer the bottleneck for voice agents, since callers experience the voice rather than the reasoning behind it.

July 1Wednesday
  1. One Useful Thing60

    Ethan Mollick on the twilight of chatbots and the rise of agent-run work

    Ethan Mollick argues that AI use is shifting from chatbot co-intelligence toward long-running agents that need less human intervention, and that this change is happening fast. He cites METR, the UK AI Security Institute and GDPval benchmarks rising faster than exponential, plus an Epoch finding that Opus 4.7 worked alone for 14 hours to build a software package estimated at 2-17 weeks of human engineering for $251 in tokens. An OpenAI and academic economists study found a quarter of OpenAI workers run at least four agents weekly, with legal and HR adopting at nearly the same rate as coders, and a Claude Code study found domain expertise, not profession, predicted success.

April 29Wednesday
  1. Factory58

    Factory benchmarks 13 models on code review, finds GPT-5.2 best and MiniMax M2.7 cheapest

    Factory built an open-source benchmark testing 13 models on 50 real pull requests from Sentry, Grafana, Keycloak, Discourse and Cal.com, with each model reviewing every PR at least three times at high reasoning effort and an LLM judge scoring findings against a human-curated golden set. GPT-5.2 led at 60.5% F1 for $1.25 per PR, ahead of Claude Opus 4.6 at 59.8% F1 and $3.11 per PR, while MiniMax M2.7 reached 45.6% F1 at $0.15 per PR and Kimi K2.5 hit 51.9% F1 at $0.41. Factory says cost explains only about 21% of quality variance, and it open-sourced the golden set, evaluation scripts and a Droid Action GitHub Action supporting all 13 models.

January 20Tuesday
  1. Factory58

    Factory launches Agent Readiness to score how well codebases support AI coding agents

    Factory launched Agent Readiness, which evaluates how well a codebase supports autonomous development across eight technical pillars and five maturity levels, runnable via /readiness-report in Droid, an organization dashboard, or an API. Each criterion is binary and a level unlocks only when 80% of its criteria and all prior levels pass; grounding each evaluation on the repository's previous report cut score variance from an average of 7% to 0.6% across 9 benchmark repositories over six weeks. Reports can trigger an agent that opens a pull request to fix failing criteria such as missing AGENTS.md, linter configuration, or pre-commit hooks.

July 2, 2025Wednesday
  1. Modal Blog40

    How Modal Used Evals and Inference-Time Compute Scaling to Generate Scannable QArt Codes

    Modal used evals and inference-time compute scaling to improve its QArt code system, boosting QR scan rate to its 95% service-level objective while improving aesthetic quality and returning codes in under 20s at p95. The work follows the standard ML playbook of collecting human judgments, aligning to them, then scaling, addressing the "it worked on my prompt" gap that leaves many generated QR codes unscannable.

June 18, 2025Wednesday
  1. Vapi Blog22

    Claude vs ChatGPT: The Complete Comparison Guide

    Claude and ChatGPT are compared across conversational quality, context memory, speed, features, creative writing, research, pricing, and interface. Claude handles up to 200,000+ tokens for Pro users and excels at creative writing and nuanced conversation, while ChatGPT supports 128,000 tokens, responds in 2-3 seconds versus Claude's 5-10 seconds, and offers image generation and Custom GPTs. Both Pro tiers cost $20 per month, with Claude Max at $100-$200 and ChatGPT Pro at $200.

June 5, 2025Thursday
  1. Vapi Blog22

    GPT-4.1 vs Claude 3.7 Sonnet: Which AI Delivers Better Voice Agents?

    Vapi compares GPT-4.1 and Claude 3.7 Sonnet as the LLM behind voice agents, weighing conversation quality, context handling, reasoning transparency, platform integration and cost. GPT-4.1 offers a 1,000,000-token context window and 32,768-token outputs with 75% caching discounts, while Claude 3.7 provides a 200,000-token context and 128,000-token outputs. Both models are selectable on Vapi's voice agent platform.

May 30, 2025Friday
  1. Vapi Blog15

    Best Speechify Alternatives: 5 TTS Tools Compared

    A comparison of five Speechify alternatives picks NaturalReader for cross-device use and app integrations at $119 per year, Voice Dream Reader for iPhone voice control at a $14.99 one-time price, and Murf AI for professional voices from about $19 per month. ReadSpeaker focuses on reading web pages across 45 languages from $4.90 per month, while Balabolka is a free Windows-only option.

August 5, 2024Monday
  1. Modal Blog62

    Modal replicates Large Language Monkeys: LLaMA 3.1 8B matches GPT-4o on HumanEval via search

    Modal's Charles Frye replicated the core claim of the Large Language Monkeys paper on a new dataset, showing that repeated sampling lifts LLaMA 3.1 8B from 66.4% pass@1 to 90.5% pass@100 and 95.1% pass@1000 on HumanEval, versus GPT-4o's reported 90.2% pass@1. The runs used vLLM on Modal serverless GPUs and Modal Sandboxes for parallel test execution, cost well under $50, and showed smooth, predictable scaling across three orders of magnitude.

    Why it matters: A hands-on replication shows how repeated sampling with a small open model can approach GPT-4o on HumanEval, offering a concrete, low-cost recipe for trading compute for accuracy.