Tới nội dung
Modal Blog·· 2025-04-17Điểm AI25

Modal product updates: 1M-input batch jobs, ephemeral apps, and a TensorRT-LLM example

Product updates: Running batch jobs with 1M inputs, ephemeral apps, and a new TensorRT-LLM example

Nội dung này chưa có bằng ngôn ngữ của bạn; đang hiển thị bằng English.

Tóm tắt bằng AI

Modal now lets each Function queue up to 1 million inputs, up from 2k, with higher .spawn() rate limits and FunctionCall results retained for 7 days. The update also adds ephemeral apps via app.run() inside containers, Git commit info for apps in the CLI and dashboard, and a new TensorRT-LLM example serving LLMs at under 400 ms latency.

Nguồn:Modal Blog · modal.com