Skip to content
Only Research#Deployment / engineering
  1. Anthropic Research71

    Anthropic tests Claude Fable 5.2 on real-world electronics design

    Anthropic reports that Claude Fable 5.2 designed three electronic devices, a speakerphone, a voice-assistant hub and a handheld virtual pet, from minimal prompts, and that Diode Computers built working prototypes from its design files without circuit fixes. On Diode's internal PCB Gym benchmark, Fable 5.2 scored 69% versus 25% for Fable 5, and it reached 83.5% on the public BenchCAD 2.1, nearly double Claude Fable 5.1. The devices remain prototypes that have not been through electrical validation, antenna tuning, thermal testing or certification, and Claude was not connected to test equipment or manufacturing machines.

    Why it matters: Anthropic's own account of Claude Fable 5.2 designing three working electronic devices shows how far models have moved from partial PCB layouts to end-to-end hardware prototyping.

  1. vLLM Blog77

    REINFORCE Zero: Kernel Alignment Enables Stable Async RL at Policy Lag 64, Extends to DeepSeek-V4.1 and Kimi K3.1

    NVIDIA Research and Inferact's REINFORCE Zero paper shows that aligning rollout and trainer kernels lets unclipped token-level importance sampling correct the remaining weight lag, training stably for 20,000 updates at policy lag 64 and reaching 2.40x the training-step throughput of synchronous training with aligned kernels. With standard kernels, the median rollout-to-learner KL rises 83.33x across the run and online AIME24 pass@1 falls from 34.27% to 13.96%, while a sequence gate stabilizes training but rejects 24.48% of sequences by the last 1,000 updates. The zero-mismatch setup now covers DeepSeek-V4.1-Flash, Kimi K3.1 on release day, and DeepSeek-V4-Flash and Kimi K3.1 on AMD MI355X, with code in Inferact/zero-mismatch-rl and NVIDIA-NeMo/labs-molt.

    Why it matters: NVIDIA Research and Inferact split the async RL rollout-learner gap into weight lag and kernel mismatch, showing that aligning kernels lets unclipped importance sampling hold stable training at policy lag 64.

  1. OpenAI Alignment Blog60

    OpenAI details training activation classifiers for safety and alignment

    OpenAI describes training activation classifiers, or probes, that read a model's internal residual stream activations to flag misaligned or policy-violating assistant completions, and says it has deployed them on internal and external traffic of its most capable models starting from GPT-5.6. The probes use an Attention probe architecture with MLP plus QV-attention and an exponential moving average, are trained on up to 1M messages labeled by reasoning-model judges, and run in streaming fashion on the inference engine so a completion can be blocked mid-turn. OpenAI reports excellent probe transfer across many post-training stages but more limited transfer across pre-training checkpoints, and says probes were overall more robust to jailbreaks than content-based classifiers in its red-teaming.

    Why it matters: OpenAI details how activation probes on internal model activations serve as a streaming safety layer, including their limits on transfer across checkpoints and retraining needs.

  1. Anthropic Research70

    Anthropic releases FlashProve, an open-source zkSNARK system for provable LLM inference

    Anthropic released FlashProve, an open-source prototype that uses zkSNARKs to prove a response came from a committed model without revealing its weights. On Llama 4 Maverick (400B-parameter MoE, 4-bit weights), a single H100 generates proofs at about 110 tokens/second with ~19 MB proofs per 1,024-token request, roughly 70-95x the GPU time vLLM needs for the same work. The release includes executable prover and verifier code, a C++ fast verifier, a Lean verifier with machine-checked completeness, soundness and zero-knowledge statements, and a technical report, all under Apache 2.0.

    Why it matters: Anthropic's FlashProve shows zkSNARK-based proofs of inference are becoming practical for a 400B-parameter MoE model, with open code and Lean-checked security claims.

  1. Amazon Science75

    Amazon Web Services researchers propose priming to convert pretrained Transformers into hybrid state space models without full retraining

    Amazon Web Services researchers introduce priming, a method that reuses pretrained Transformer weights to cut the pretraining cost of hybrid state space architectures by more than 99%, using under 0.5% of the source model's pretraining token budget. In controlled comparisons, Gated KalmaNet outperformed Gated DeltaNet and Mamba-2, and a 32B GKA-based hybrid matched its source Transformer on reasoning benchmarks while decoding up to twice as quickly at 128,000 tokens of context. The team released 8B and 32B primed hybrid models, training code, Triton kernels, and a vLLM serving plugin under the Apache 2.0 License.

    Why it matters: Amazon Web Services researchers show that reusing pretrained Transformer weights can cut hybrid architecture pretraining cost by over 99%, making controlled comparisons of state space layers practical.

  1. Goodfire Research71

    Goodfire trains and deploys probe-based cyber misuse monitors on Kimi K3 and GLM 5.3

    3 and deployed them on a production inference stack, where a cheap probe filters turns and only suspicious exchanges reach an LLM judge. 5% benign-session interruption rate, costs $65 per million turns without judge reasoning and $185 with it, and adds no measurable throughput loss inside SGLang.

    Why it matters: Goodfire shows a probe-plus-judge cascade can monitor agentic cyber misuse at roughly 50x lower cost with no measurable throughput loss, a concrete recipe for serving open models safely.

You are all caught up