Modal Blog· Charles Frye·· 2026-07-06AI score38
How to price serverless GPUs: Modal's interactive cost model
How to price serverless GPUs
AI summary
Modal published an interactive tool for estimating serverless versus reserved GPU costs, defaulting to current rates for a B200 GPU serverlessly on Modal and via three-year hyperscaler reservation. The model shows that when an application's peak-to-average ratio exceeds the reservation discount rate, serverless GPUs cost less overall, and Modal cites observed discounts of 2-5x against peak-to-average ratios of 5-10x.
Source:Modal Blog · modal.com