Modal's linear programming resource solver for GPU capacity and cloud arbitrage

Modal built a "resource solver" that uses linear programming and the simplex algorithm to decide which cloud instances to spin up or down, meeting demand for GPUs at predictable prices. The system also captures temporary arbitrage, such as hundreds of H200 GPUs at 20% below the going rate for H100s, saving millions of dollars a year.