Modal Product Updates: Multi-node Training Clusters, B200 and H200 GPUs, and Client 1.0

Modal has launched multi-node training clusters in beta, letting users tap dozens of GPUs across multiple hosts by adding the @clustered decorator, with 3.2 Tbps Infiniband RDMA interconnect for near-linear scaling. The platform now offers NVIDIA B200 and H200 GPUs serverlessly at $6.25/hr and $4.54/hr respectively, claiming up to 2-4× faster LLM inference than H100s. Modal also released Client 1.0, emphasizing API stability, alongside updates including a read-only Volume method and timezone support for Cron schedules.