Modal Blog·· 2025-04-17Điểm AI25
Modal product updates: 1M-input batch jobs, ephemeral apps, and a TensorRT-LLM example
Product updates: Running batch jobs with 1M inputs, ephemeral apps, and a new TensorRT-LLM example
Nội dung này chưa có bằng ngôn ngữ của bạn; đang hiển thị bằng English.
Tóm tắt bằng AI
Modal now lets each Function queue up to 1 million inputs, up from 2k, with higher .spawn() rate limits and FunctionCall results retained for 7 days. The update also adds ephemeral apps via app.run() inside containers, Git commit info for apps in the CLI and dashboard, and a new TensorRT-LLM example serving LLMs at under 400 ms latency.
Nguồn:Modal Blog · modal.com