Skip to content
Only Research#Open-source ecosystem
November 12Thursday
  1. Epoch AI · Gradient Updates64

    Epoch Brief: GLM 5.3 autonomously builds Firefox exploits from patch gaps for about $1,000 each

    Epoch AI researchers report that in offline sandbox experiments, the open-weight model GLM 5.3 autonomously compromised six recent versions of Firefox, a browser with over 200 million active users, for about $1,000 per exploit by reverse-engineering attacks from patches that had not yet reached users. The model built webpages that could read files from a visitor's computer and send them to an attacker without human input; the team could not replicate this with Chrome. The same brief notes that Anthropic's Claude Fable 5.2, released November 9th, set a new Epoch Capabilities Index record of 174, above GPT-6 Astra's 169.

November 10Tuesday
  1. Goodfire Research62

    Goodfire studies Qwen3.6-35B-A3B neurons as an interpretable basis

    Goodfire Research published a study arguing that individual MLP neurons in Qwen3.6-35B-A3B are more interpretable than assumed, based on sparsification, attribution tools and research agents. Ablating the 92.2% weakest MoE neuron activations per forward pass raised language model loss by only 2.9%, and 69% of neuron poles had a single mode responsible for at least 90% of their causal effect. Natural-language neuron descriptions let a judge model predict firing with 95% accuracy against random text and recover 73% of ablation damage through simulation.

    Why it matters: Goodfire's study of Qwen3.6-35B-A3B neurons argues that strong activations alone carry most of the model's computation, offering a concrete alternative to feature-dictionary interpretability.

November 9Monday
  1. Artificial Analysis Articles58

    Artificial Analysis releases Endpoint Accuracy Index v1.1 with tighter long-context intervals and six-model coverage

    Artificial Analysis launched Endpoint Accuracy Index v1.1, which tightens AA-LCR-25 confidence intervals and adds coverage for GLM-5.3 Flash and Muse Spark Open. Across 103 serverless endpoints benchmarked, 24 score statistically below the self-hosted reference, with causes including output token caps, reduced reasoning, tool call formatting errors and request timeouts. Raising AA-LCR-25 to 25 repeats per question narrows its average 95% confidence interval from ±4.7 to ±2.6 points, and the composite index interval from ±5.5 to ±4.3 points across the 45 endpoints scored under both versions.

November 6Friday
  1. SemiAnalysis75

    SemiAnalysis benchmarks Google TPUv7 Ironwood on agentic inference against NVIDIA GPUs

    SemiAnalysis released the first long-context, multi-turn agentic inference results on InferenceX/AgentX for Google TPUv7 Ironwood across four models, finding it competitive on performance per dollar or state-of-the-art in several cases. On GLM-5.2 in FP8, TPUv7 delivered 1.2x to 2.7x the tokens per dollar of B200, B300 and MI355X from 60 to 300 tok/s/user, while FP4 GPUs still led on GLM-5.3 because TPUv7 lacks native FP4 support until TPUv8 in Q1 2027. The piece also argues NVIDIA's bureaucracy slows driver and ecosystem contributions compared with AMD and Google.

November 2Monday
  1. Zyphra Research58

    Zyphra introduces ZHA hierarchical attention, a sparse method with subquadratic routing

    Zyphra introduced Zyphra Hierarchical Attention (ZHA), a sparse attention method that builds a tree of compressed KV-cache summaries and routes queries top-down through it, giving subquadratic complexity with suitable top-p thresholds. Existing pretrained models can be adapted via a short KL-distillation phase using only a few billion tokens; on Qwen3.6-35B-A3B, ZHA adds 81,920 trainable parameters, about 0.00024% of the base model. On RULER-13 at 256K tokens the wide-tree model scored 96.2% versus 96.0% for dense attention, and the deep six-level tree scored 63.4% on LongBench v2 versus 58.0% for dense while attending to about 1.1% of the KV cache; a GPU roofline model projects 32-35x speedup over dense attention at 10M tokens.

October 30Friday
  1. Epoch AI · Gradient Updates82

    Epoch AI finds GLM 5.3 can turn published Firefox fixes into working exploits before users update

    Epoch AI reports that GLM 5.3, an open-weight model released by Z.ai in August, autonomously built working exploits from Mozilla security fixes that had been published but not yet shipped to users, compromising all six Firefox versions released between September 17 and October 26. After roughly $100,000 in setup and API costs, each successful attack cost about $1,000 in compute, and the fastest attempt took 12 hours within a 48-hour budget. Similar attacks on Chrome did not succeed, and the researchers say no provider safeguards or refusals were triggered; a separate unpublished vulnerability they found was patched in the October 27 Firefox 159.0 release.

    Why it matters: Epoch AI's experiment shows an open-weight model autonomously weaponizing published-but-unshipped Firefox fixes, putting a concrete cost and time figure on the patch gap.

October 24Saturday
  1. Epoch AI · Gradient Updates42

    Epoch Brief: AI Work Automation Test, SpireClimb Benchmark, and Gemini 4 Argon's Frontier Push

    Epoch AI tested six leading models on 11 realistic Epoch work tasks and found none could reliably meet its quality bar, with Claude Fable 5.1 and GPT-6 Astra roughly tied for the lead. Its new SpireClimb benchmark shows frontier models went from struggling at Slay the Spire to winning over 90% of base-difficulty runs in six months, with GPT-6 Astra at 98%. Gemini 4 Argon scored 166 on the Epoch Capabilities Index, tying Claude Fable 5.1 and trailing Claude Opus 5.5 and GPT-6 Astra at 169.

October 8Thursday
  1. Goodfire Research71

    Goodfire trains and deploys probe-based cyber misuse monitors on Kimi K3 and GLM 5.3

    3 and deployed them on a production inference stack, where a cheap probe filters turns and only suspicious exchanges reach an LLM judge. 5% benign-session interruption rate, costs $65 per million turns without judge reasoning and $185 with it, and adds no measurable throughput loss inside SGLang.

    Why it matters: Goodfire shows a probe-plus-judge cascade can monitor agentic cyber misuse at roughly 50x lower cost with no measurable throughput loss, a concrete recipe for serving open models safely.