Modal launches Batch, processing 1 million jobs with one line of code

Modal launched Modal Batch, a batch-processing interface backed by a rebuilt durable queue that can queue 1 million inputs at once, up from 2,000, and guarantees execution up to 7 days after a job is launched, up from 1 day. A new native handler, .spawn_map, spawns thousands of containers over a set of inputs without users managing async logic, and Harvey reports a 10x speed-up in its document-processing pipeline after fanning inputs across 1,000 containers. Suno uses it to run GPU-accelerated preprocessing on thousands of GPUs, and Achira relies on its retry mechanism for quantum mechanical datasets.