Meta explains TLX, a hardware-native GPU compiler extension to Triton for production ML

Meta detailed TLX (Triton Low-Level Extensions), an extension to Triton that adds explicit warp-group and cluster-level orchestration while keeping Triton's tensor programming model. TLX is already running in production across Meta, with 20-25% end-to-end MFU on thousands of NVIDIA Blackwell GPUs for GEM training, up to two-thirds lower compute-intensive net latency for RecSys inference, and a distributed grouped GEMM kernel deployed in large-scale LLM pretraining. Meta says TLX targets NVIDIA Hopper and Blackwell plus AMD Mi300 and Mi350x, and is working on more architectures, automatic warp-group inference and a torch.compile backend.