Skip to content
Hot eventDeveloping

Together AI unveils agent-driven TKCC compiler for inference

1 reports1 reporting sourcesUpdated 19 h ago

Start here

AI digest

Together AI published a blog post describing TKCC, an agent-driven compiler that generates inference optimizations directly from forward-pass source code. The company reports TKCC reaching up to 1.7x higher TPS than its hand-tuned Llama 1B megakernel, and 1,111 TPS on MiniMax M3.1-Flash and 1,205 TPS on DeepSeek v4.1-Flash. Together AI says it deleted its megakernels in the process. In its ablations, Together AI found that default Torch Inductor kernels plus CUDA Graphs and fine-grained PDL reached 975 TPS, 98% of the megakernel's 990 TPS, without writing a single kernel. The team also reports that an expert-curated knowledge hub made agents 25-31% slower, and that a naive prompt outperformed six expert-written optimization strategies. Together AI says organizations can request early access to the Together Compiler.

Generated from reports · updated 19 h ago

Report timeline

Follow the reports to see the event from different sides.

November 17
  1. Hacker News · AI
    Together AI's road to TKCC: why it deleted its megakernels and let agents optimize inference

    Together AI describes TKCC, an agent-driven compiler that generates inference optimizations directly from forward-pass source code, reporting up to 1.7x higher TPS than its hand-tuned Llama 1B megakernel and 1,111 TPS on MiniMax M3.1-Flash and 1,205 TPS on DeepSeek v4.1-Flash. The team found that default Torch Inductor kernels plus CUDA Graphs and fine-grained PDL reached 975 TPS, 98% of the megakernel's 990 TPS, without writing a single kernel. Ablations showed that an expert-curated knowledge hub made agents 25-31% slower and that a naive prompt outperformed six expert-written optimization strategies.

Heat for this event

Current, comparable range
6
Peak, comparable range
10November 17 13:00
Change in 24 hours
–

The trend compares the same participants over hours observed continuously, so its range can be narrower than the current heat count. Hover or tap the chart for hourly heat; the arrow keys move through it.