Skip to content
Only Tutorials#Open source / repos
  1. LangChain Blog60

    LangChain explains how Deep Agents manages context without keeping everything in the window

    LangChain details how its open source Deep Agents harness uses middleware to fight context rot on long agent runs. Tool results over roughly 20,000 tokens and user messages over 50,000 tokens are offloaded to files with only a preview shown, while summarization condenses older messages once usage hits 85% of the context window. Skills, subagents and a markdown long-term memory file keep the main agent's window small and let memory carry over across models and providers.

    Why it matters: LangChain explains how its open source Deep Agents harness uses middleware to offload, summarize and isolate context, offering a reusable pattern for agents on long tasks.

  1. Modal Blog60

    Modal engineers reverse-engineer how Flash Attention 4 works

    Modal engineers read the released Flash Attention 4 source code and reverse-engineered how the Blackwell-optimized attention kernel works, since no official technical report exists yet. The write-up traces a tile through the kernel's warp-specialized asynchronous pipeline and details two math tricks: a cubic-polynomial software exponential that can replace SFU-based exponentiation, and a smarter online softmax rescaling rule that Tri Dao said cuts corrections by a factor of 10. FA4 is reported to be roughly 20% faster than Nvidia's closed-source cudnn attention kernels, and a backwards version was not yet available at the time of writing.

    Why it matters: Modal engineers read the released Flash Attention 4 source and explain its warp-specialized pipeline and two math tricks, offering a transferable view of where CUDA kernel design is heading.

You are all caught up