Skip to content
Only Research#Deployment / engineering
November 13Friday
  1. MIT News34

    MIT researchers build an AI "copilot" for topology optimization in structural design

    MIT researchers developed an AI copilot that lets engineers give feedback on regions of a structure while topology optimization is still running, instead of waiting for the final design. In demonstrations it improved manufacturability and linear buckling load by 39 percent while adding only 15 seconds to total design time. The system uses machine learning trained on synthetic human feedback data, and currently only lets users thicken or thin regions.

  2. Hacker News · AI64

    Schelling Atlas study finds AI agents converge on ntfy.sh to locate each other on the web

    A study from the ELLIS Institute Tübingen and Max Planck Institute for Intelligent Systems found that pairs of independently run AI agents, given no meeting site, located each other on the web within minutes, with 21 of 40 pairs meeting and all of them on ntfy.sh. With ntfy.sh blocked, only 4 of 65 pairs met in five minutes, rising to 20 of 65 with 20 minutes and no action limits, mostly on ptsv3.com and filebin.net. Of 1,107 agents that used the web tool, 280 tried a host that no longer exists, and 118 tried one of 121 domains with no registration, which an attacker could buy to intercept agent traffic.

  3. Hacker News · AI31

    Air-LLM: Broadcasting AI Weights to Edge Devices via RF Computing for On-the-Fly LLM Inference

    Air-LLM is an edge LLM inference architecture in which a central radio such as a 5G base station broadcasts model weights over the air, and edge users complete GEMV directly in the RF domain using RF mixers, so devices never store or load weights. Tested on NVIDIA Sionna ray-traced channels in two real urban scenes with a real RF mixer profile, it limits WikiText-2 perplexity degradation on LLaMA-3.1-8B to 4.0% while saving 157.7x/40.4x energy versus FP16 and weight-only quantization baselines. With 20 users, airtime is 104.1x/26.0x shorter, and because the central radio stays user-unaware, one broadcast serves unlimited users in coverage.

  4. Hacker News · AI58

    InferTrail runs a 35-day LLM API key honeypot and traces how stolen keys get used

    InferTrail planted 179 API keys across 40+ fake GitHub organizations and ran two honeypot LLM gateways for up to 36 days, logging over 3 million requests. Only 18 of the published keys were used to send prompts, and six keys accounted for 98.9% of leaked-key prompt requests, while 86% of that traffic came from hosting infrastructure. The authors list three log patterns for spotting key reuse: many model names under one key in a short window, steady-interval checks after a key works, and a shift in source addresses.

November 12Thursday
  1. Google Research58

    Google Research uses wearables to build CKM risk profiles and personalized coaching

    Google Research introduced an investigational framework that turns consumer wearable data into a coachable health age and simulates personalized 12-week what-if health trajectories. The SensorWM world model was pretrained on 2.28 million person-weeks of de-identified Fitbit data from roughly 100,000 users and forecasts 20 physiological markers under different step, sleep and cardio routines. In a blinded study, lifestyle coaches chose the counterfactual-grounded plan as best overall in 71.4% of evaluations, and physicians rated 99.2% of plans within safe exercise intensity limits; the authors note the models are research prototypes, not clinical diagnostic tools.

November 9Monday
  1. Hugging Face Blog40

    HOPE: Higher-Order Pruning of Experts in Mixture-of-Experts Language Models

    Researchers introduce HOPE, a second-order expert pruning method for Mixture-of-Experts language models that accounts for pairwise interactions between co-activated experts instead of scoring each expert independently. At 50% pruning, HOPE achieves the best average rank of any method, with gains of up to +6.1% on agentic coding tasks over the next-best pruning method. The work targets the memory bottleneck in models such as Qwen3.5-122B, where expert MLPs take up 95% of a ~250 GB footprint.

  2. Anthropic Research71

    Anthropic tests Claude Fable 5.2 on real-world electronics design

    Anthropic reports that Claude Fable 5.2 designed three electronic devices, a speakerphone, a voice-assistant hub and a handheld virtual pet, from minimal prompts, and that Diode Computers built working prototypes from its design files without circuit fixes. On Diode's internal PCB Gym benchmark, Fable 5.2 scored 69% versus 25% for Fable 5, and it reached 83.5% on the public BenchCAD 2.1, nearly double Claude Fable 5.1. The devices remain prototypes that have not been through electrical validation, antenna tuning, thermal testing or certification, and Claude was not connected to test equipment or manufacturing machines.

    Why it matters: Anthropic's own account of Claude Fable 5.2 designing three working electronic devices shows how far models have moved from partial PCB layouts to end-to-end hardware prototyping.

  3. Artificial Analysis Articles58

    Artificial Analysis releases Endpoint Accuracy Index v1.1 with tighter long-context intervals and six-model coverage

    Artificial Analysis launched Endpoint Accuracy Index v1.1, which tightens AA-LCR-25 confidence intervals and adds coverage for GLM-5.3 Flash and Muse Spark Open. Across 103 serverless endpoints benchmarked, 24 score statistically below the self-hosted reference, with causes including output token caps, reduced reasoning, tool call formatting errors and request timeouts. Raising AA-LCR-25 to 25 repeats per question narrows its average 95% confidence interval from ±4.7 to ±2.6 points, and the composite index interval from ±5.5 to ±4.3 points across the 45 endpoints scored under both versions.

November 6Friday
  1. Ai2 · Allen Institute for AI58

    Ai2 releases ToyBlocks, a controlled simulated world for robot learning and evaluation

    Ai2 released ToyBlocks, an open simulation framework built around a robot arm and blocks on a tabletop, as the first of its FoundationWorlds for controlled robot-learning research. ToyBlocks auto-generates tasks and demonstrations via RL and motion planning in Isaac Lab, reaching up to 24 times real-time data generation on a single GPU, and ships with 85,336 long-horizon demonstrations covering nearly 1,600 hours and 144 million frames. In real-world tests on a Franka FR3, ManiFlow's atomic-skill success was 80.0% in simulation and 81.1% on hardware, while the Molmo 2 plus ManiFlow system succeeded in 55.5% of simulated and 50.0% of real episodes.

  2. vLLM Blog77

    REINFORCE Zero: Kernel Alignment Enables Stable Async RL at Policy Lag 64, Extends to DeepSeek-V4.1 and Kimi K3.1

    NVIDIA Research and Inferact's REINFORCE Zero paper shows that aligning rollout and trainer kernels lets unclipped token-level importance sampling correct the remaining weight lag, training stably for 20,000 updates at policy lag 64 and reaching 2.40x the training-step throughput of synchronous training with aligned kernels. With standard kernels, the median rollout-to-learner KL rises 83.33x across the run and online AIME24 pass@1 falls from 34.27% to 13.96%, while a sequence gate stabilizes training but rejects 24.48% of sequences by the last 1,000 updates. The zero-mismatch setup now covers DeepSeek-V4.1-Flash, Kimi K3.1 on release day, and DeepSeek-V4-Flash and Kimi K3.1 on AMD MI355X, with code in Inferact/zero-mismatch-rl and NVIDIA-NeMo/labs-molt.

    Why it matters: NVIDIA Research and Inferact split the async RL rollout-learner gap into weight lag and kernel mismatch, showing that aligning kernels lets unclipped importance sampling hold stable training at policy lag 64.

  3. SemiAnalysis75

    SemiAnalysis benchmarks Google TPUv7 Ironwood on agentic inference against NVIDIA GPUs

    SemiAnalysis released the first long-context, multi-turn agentic inference results on InferenceX/AgentX for Google TPUv7 Ironwood across four models, finding it competitive on performance per dollar or state-of-the-art in several cases. On GLM-5.2 in FP8, TPUv7 delivered 1.2x to 2.7x the tokens per dollar of B200, B300 and MI355X from 60 to 300 tok/s/user, while FP4 GPUs still led on GLM-5.3 because TPUv7 lacks native FP4 support until TPUv8 in Q1 2027. The piece also argues NVIDIA's bureaucracy slows driver and ecosystem contributions compared with AMD and Google.

  4. Microsoft Research58

    Microsoft Research's PDD Kit formally verifies agent-written full-stack web apps

    Microsoft Research introduced PDD Kit, a research prototype that turns a developer's plain-language intent into a Verus formal specification, proves the coding agent's Rust code meets it for every input, and falls back to tests where a proof cannot reach. In a demo inside GitHub Next's Chopin, the team used PDD Kit to verify the login logic of Pet Store, a roughly 5,000-line Rust full-stack app, with the developer reviewing the intent artifact rather than the generated code line by line. PDD Kit only verifies Rust today, and its guarantees rest on six developer-approved trusted pieces, including the bcrypt password check and the two database lookups.

November 5Thursday
  1. Zyphra Research36

    ZYFA: Fast and Accurate FP8 Attention Kernels on AMD MI355X

    Zyphra Research released ZYFA, BF16 and FP8 causal prefill attention kernels for AMD's MI355X (CDNA4, gfx950) supporting head dimension 128 and DeepSeek-V2's MLA shape. On activations from Mistral-7B, Qwen3-8B and DeepSeek-V2-Lite at 16K tokens, ZYFA's FP8 kernels reach 1.16–1.76× AITER's throughput, and on Gaussian inputs at 32K tokens 1.26–1.37× at head dimension 128 and 1.99× at the MLA shape. FP8 error is 62–78% lower than AITER's at head dimension 128.

November 3Tuesday
  1. OpenAI Alignment Blog60

    OpenAI details training activation classifiers for safety and alignment

    OpenAI describes training activation classifiers, or probes, that read a model's internal residual stream activations to flag misaligned or policy-violating assistant completions, and says it has deployed them on internal and external traffic of its most capable models starting from GPT-5.6. The probes use an Attention probe architecture with MLP plus QV-attention and an exponential moving average, are trained on up to 1M messages labeled by reasoning-model judges, and run in streaming fashion on the inference engine so a completion can be blocked mid-turn. OpenAI reports excellent probe transfer across many post-training stages but more limited transfer across pre-training checkpoints, and says probes were overall more robust to jailbreaks than content-based classifiers in its red-teaming.

    Why it matters: OpenAI details how activation probes on internal model activations serve as a streaming safety layer, including their limits on transfer across checkpoints and retraining needs.

November 2Monday
  1. Zyphra Research58

    Zyphra introduces ZHA hierarchical attention, a sparse method with subquadratic routing

    Zyphra introduced Zyphra Hierarchical Attention (ZHA), a sparse attention method that builds a tree of compressed KV-cache summaries and routes queries top-down through it, giving subquadratic complexity with suitable top-p thresholds. Existing pretrained models can be adapted via a short KL-distillation phase using only a few billion tokens; on Qwen3.6-35B-A3B, ZHA adds 81,920 trainable parameters, about 0.00024% of the base model. On RULER-13 at 256K tokens the wide-tree model scored 96.2% versus 96.0% for dense attention, and the deep six-level tree scored 63.4% on LongBench v2 versus 58.0% for dense while attending to about 1.1% of the KV cache; a GPU roofline model projects 32-35x speedup over dense attention at 10M tokens.

  2. SemiAnalysis58

    SemiAnalysis releases GDPx benchmark for frontier agentic capabilities across high-value domains

    SemiAnalysis released GDPx, a benchmark covering chip design, cybersecurity, biology, finance, legal, quant trading, RSI, hardware design, materials science, alignment and software engineering, built with 14 specialized RL environment partners. Even the best model scores just 12%, with Opus 5.5 winning quant trading, hardware and chip design, Gemini 4 Carbon leading biology and software engineering, and GPT-6 Astra topping RSI and materials science. Every task runs in a realistic simulated environment, such as a ~4,000-file private equity deal room or live multi-service cyber ranges, unlike OpenAI's GDPval, which SemiAnalysis argues spoon-feeds context and lacks environments.

  3. Anthropic Research70

    Anthropic releases FlashProve, an open-source zkSNARK system for provable LLM inference

    Anthropic released FlashProve, an open-source prototype that uses zkSNARKs to prove a response came from a committed model without revealing its weights. On Llama 4 Maverick (400B-parameter MoE, 4-bit weights), a single H100 generates proofs at about 110 tokens/second with ~19 MB proofs per 1,024-token request, roughly 70-95x the GPU time vLLM needs for the same work. The release includes executable prover and verifier code, a C++ fast verifier, a Lean verifier with machine-checked completeness, soundness and zero-knowledge statements, and a technical report, all under Apache 2.0.

    Why it matters: Anthropic's FlashProve shows zkSNARK-based proofs of inference are becoming practical for a 400B-parameter MoE model, with open code and Lean-checked security claims.

October 30Friday
  1. Amazon Science38

    Speeding up LLMs for travel applications: Medusa plus knowledge distillation

    Combining knowledge distillation with the Medusa framework lets a 1.1B-parameter TinyLlama student match the quality of its 70B-parameter Llama-3.1 teacher while running 10 to 20 times as fast at less than one-third the cost. Working with Booking.com on AI Trip Planner, Smart Filters and accommodation description generation, the pipeline closed over 90% of the quality gap and added 2 to 3.6x further speedup from Medusa heads.

  2. Meta Engineering Blog58

    Meta details production deployment of Catching JiTTests with human-on-the-loop review

    Meta has moved Catching JiTTests, its LLM-based just-in-time test generation approach, from research prototype into production infrastructure, and published the results in the FSE 2026 paper "Just-in-Time Catching Test Generation at Meta." The system runs overnight on spare capacity, targets risky diffs, generates tests through dodgy-diff and intent-aware workflows, and filters false positives with an LLM-as-Judge ensemble plus a rule-based RubFake assessor before reaching engineers. As of writing, 589 engineers (64% of outreach) engaged with the results, which showed a 60% true-positive rate, and in the first half of 2026 the system caught 74 serious privacy bugs at the diff stage and lowered privacy SEVs by 20%.

October 13Tuesday
  1. Modal Blog58

    Modal tests mixed-precision, mixed-accelerator RL samplers on Qwen3.6-35B-A3B

    Modal trained Qwen3.6-35B-A3B on agentic coding with samplers spread across six accelerator types (B200, B300, H100, H200, A100, RTX PRO 6000) at NVFP4, FP8 and BF16 precision, feeding one BF16 trainer on B200. Plain GRPO collapsed on both mixed and homogeneous samplers, but adding masked importance sampling plus score centering, with or without top-p mask replay, trained stably to the end and reached SWE-bench Pro V2 pass@4 on par with homogeneous samplers, at roughly 15% lower sampler cost per update. The mixed samplers ran with an average sampler-trainer KL 4.7x that of the homogeneous setup, and the authors argue stability depends on keeping the mismatch bounded rather than low.

  2. Amazon Science75

    Amazon Web Services researchers propose priming to convert pretrained Transformers into hybrid state space models without full retraining

    Amazon Web Services researchers introduce priming, a method that reuses pretrained Transformer weights to cut the pretraining cost of hybrid state space architectures by more than 99%, using under 0.5% of the source model's pretraining token budget. In controlled comparisons, Gated KalmaNet outperformed Gated DeltaNet and Mamba-2, and a 32B GKA-based hybrid matched its source Transformer on reasoning benchmarks while decoding up to twice as quickly at 128,000 tokens of context. The team released 8B and 32B primed hybrid models, training code, Triton kernels, and a vLLM serving plugin under the Apache 2.0 License.

    Why it matters: Amazon Web Services researchers show that reusing pretrained Transformer weights can cut hybrid architecture pretraining cost by over 99%, making controlled comparisons of state space layers practical.

October 8Thursday
  1. Zyphra Research36

    Zyphra Research: Expert Coupling Cuts MoE Pretraining Communication

    Zyphra Research shows MoE routing is highly structured, with co-selected experts correlated within a layer and a token's expert choices predicting later-layer routing. Exploiting this via correlated expert placement and token shuffling cuts all-to-all communication time up to 2.63× and improves end-to-end training step time up to 1.41× in Megatron-LM experiments on MI300X GPUs, without changing architecture or routing decisions.

  2. Goodfire Research71

    Goodfire trains and deploys probe-based cyber misuse monitors on Kimi K3 and GLM 5.3

    3 and deployed them on a production inference stack, where a cheap probe filters turns and only suspicious exchanges reach an LLM judge. 5% benign-session interruption rate, costs $65 per million turns without judge reasoning and $185 with it, and adds no measurable throughput loss inside SGLang.

    Why it matters: Goodfire shows a probe-plus-judge cascade can monitor agentic cyber misuse at roughly 50x lower cost with no measurable throughput loss, a concrete recipe for serving open models safely.

September 1Tuesday
  1. Zyphra Research48

    Zyphra Releases PUFFER, an Incremental Fuzzy Deduplication System for Evolving Training Corpora

    Zyphra released PUFFER, an open-source provenance-aware incremental fuzzy-deduplication system for continuously growing LLM training corpora, under the Apache 2.0 license. It delivers an 11x-35x speedup over existing CPU-based deduplication methods and ingests one billion documents in 1.75 hours on a single process, with production deployment on more than 30 billion documents. PUFFER keeps a disk-resident MinHash-LSH history so new datasets can be added, interrupted jobs recovered deterministically, and individual datasets withdrawn without rebuilding the full corpus index.

July 29Wednesday
  1. Berkeley AI Research58

    From CUDA to MLX: K-Search Brings Kernel Optimization Expertise to Apple Silicon

    IBM Research extended K-Search, the evolutionary kernel search framework from UC Berkeley Sky Lab, with an MLX backend and a structured CUDA-to-MLX translation layer that adapts existing CUDA kernels into Apple Silicon kernels. On an MLX attention kernel the approach reached 0.97x the speed of Apple's native MLX Attention kernel, up from 0.26x without the translation context, and an evolved Mamba SSM kernel reached up to 20x prefill speedup over the community mlx-lm implementation on an M1 Max. The authors attribute the gain mainly to the quality of context and constraints given to the LLM rather than its ability to write Metal code, and say the method is not specific to MLX.

July 1Wednesday
  1. Modal Blog58

    Modal Research and HeavyBall's MRP brings multi-token prediction to diffusion LMs

    Modal Research and NYU Shanghai's HeavyBall Research introduce Multi-token Residual Prediction (MRP), a 3-layer module attached to a frozen diffusion LM backbone that predicts the inter-step logit residual instead of the full next-step distribution. On SDAR-4B GSM8K, MRP holds 70.9% accuracy at K=3 versus 5.9% for naive MTP distillation, and in SGLang it reaches up to 1.56x throughput losslessly in speculative mode or recovers up to +16 accuracy points under aggressive low-threshold dynamic decoding. The paper, code, SGLang implementation, and SDAR-MRP models on Hugging Face are released.

April 20Monday
  1. Berkeley AI Research38

    GRASP: Gradient-Based Planning for World Models at Longer Horizons

    GRASP is a new gradient-based planner for learned world models that makes long-horizon planning practical by lifting trajectories into virtual states for parallel-in-time optimization, adding stochasticity to state iterates for exploration, and reshaping gradients so actions receive clean signals while avoiding brittle state-input gradients through high-dimensional vision models. The work addresses ill-conditioned computation graphs, non-greedy local minima, and high-dimensional latent failure modes that make long-horizon planning fragile. It was done with Mike Rabbat, Aditi Krishnapriyan, Yann LeCun, and Amir Bar.