Skip to content
#DeepSeek
  1. Hacker News · AI85

    Forensic analysis links six Chinese frontier models to export-controlled NVIDIA Blackwell GPUs

    Unemployment Labs' forensic analysis of published model weights finds that six models from DeepSeek, Moonshot AI, MiniMax and Ant Group were initialized on NVIDIA Blackwell hardware, while earlier models from the same labs match Hopper. The method recovers each model's random seed and thread layout from preserved weights, and the author says the matches were reproduced on physical H100, B300 and GB200 chips. The report estimates each training run needed roughly 500 to 3,000 Blackwell GPUs over two to three months, and notes the evidence does not establish where the chips were located or whether export controls were violated.

    Why it matters: The report derives hardware evidence solely from published model weights, offering a reproducible method for tracing which GPUs initialized a model without relying on leaks.

  1. vLLM Blog72

    vLLM serves DeepSeek-V4.1-Flash on Vera Rubin NVL72 at 58x GB300 NVL72 throughput

    vLLM reports serving DeepSeek-V4.1-Flash on a single NVIDIA Vera Rubin NVL72 rack at 1.7M tokens/s per GPU with 387 tokens/s per user, 58x the GB300 NVL72, peaking at 2.52M tokens/s and 1,810 tokens/s for a single user. The gains come from kernels rebuilt for Rubin's split memory domains and FP4 tensor cores, a specialized TP8 decode path, and rack-wide KV and Engram pools shared over NVLink. With prefixes pooled across the rack and Dynamo workload-aware routing, the prefix hit rate holds at 96.5-97% even at high concurrency.

    Why it matters: vLLM's third DeepSeek-V4.1-Flash post details how Rubin-specific kernels and rack-wide memory pooling lift throughput 58x over GB300 NVL72, offering a concrete reference for large-scale serving optimization.

  1. vLLM Blog77

    REINFORCE Zero: Kernel Alignment Enables Stable Async RL at Policy Lag 64, Extends to DeepSeek-V4.1 and Kimi K3.1

    NVIDIA Research and Inferact's REINFORCE Zero paper shows that aligning rollout and trainer kernels lets unclipped token-level importance sampling correct the remaining weight lag, training stably for 20,000 updates at policy lag 64 and reaching 2.40x the training-step throughput of synchronous training with aligned kernels. With standard kernels, the median rollout-to-learner KL rises 83.33x across the run and online AIME24 pass@1 falls from 34.27% to 13.96%, while a sequence gate stabilizes training but rejects 24.48% of sequences by the last 1,000 updates. The zero-mismatch setup now covers DeepSeek-V4.1-Flash, Kimi K3.1 on release day, and DeepSeek-V4-Flash and Kimi K3.1 on AMD MI355X, with code in Inferact/zero-mismatch-rl and NVIDIA-NeMo/labs-molt.

    Why it matters: NVIDIA Research and Inferact split the async RL rollout-learner gap into weight lag and kernel mismatch, showing that aligning kernels lets unclipped importance sampling hold stable training at policy lag 64.

You are all caught up