Skip to content
vLLM Blog· vLLM-Omni team·· 1 d agoPicksAI score64

vLLM-Omni benchmarks MiniMax H3-Image on Vera Rubin: 0.87s 4K generation and 6,115 images/hour

H3-Image Day-0 Support: 4K in 0.87s with Vera Rubin

AI summary

vLLM-Omni brought MiniMax H3-Image to NVIDIA Vera Rubin and measured 0.87-second median latency for native 4096×4096 text-to-image on four GPUs, plus 6,115 images/hour in a separate throughput configuration. H3-Image is an open-weight text-to-image and editing model that pairs a Qwen3-VL encoder with a 33.1B dense DiT and an image VAE, handling both tasks in six sampling steps with up to 16 reference images. The team reports MXFP8 DiT GEMMs, Ulysses SP4, AdaLN caching and a VAE decoding change that cut decode time from 2.635s to 0.213s, and lists recipes for AMD, Intel, Huawei Ascend and Moore Threads hardware.

Why it matters

vLLM-Omni's benchmark shows MiniMax H3-Image running on Vera Rubin at subsecond 4K latency, with per-hardware configurations and a cost model for serving economics.

Source:vLLM Blog · vllm.ai