How Snorkel runs realistic agent simulations with Modal

Snorkel uses Modal's GPU and CPU sandboxes to run millions of agent simulations per month, peaking at tens of thousands of sandboxes an hour, and relies on Modal for inference on the open-weight models it evaluates. Adopting Modal's memory bursting cut Snorkel's total sandbox bill by around 20%, with roughly 10-15% of its sandboxes using bursting today. Modal was the only sandbox provider able to meet Snorkel's GPU sandbox needs at scale.