Modal makes NVIDIA H100 GPUs available to all users

Modal has made NVIDIA H100 GPUs available to all users, priced at $7.65 per hour per GPU. NVIDIA benchmarks show the H100 delivers up to 4x training speedups and up to 30x inference speedups versus the A100, with 80 GB of on-chip DRAM and up to 8 GPUs linked via NVLink at 3.6 TB/s. Users enable it by setting "H100" as the GPU type in the Modal decorator.