H3-Image Day-0 Support: 4K in 0.87s with Vera Rubin
H3-Image Day-0 Support: 4K in 0.87s with Vera Rubin
vLLM-Omni brought MiniMax H3-Image, an open-weight text-to-image and editing model, to NVIDIA Vera Rubin, reaching 0.87 seconds median for native 4096×4096 generation on four GPUs with SP4 and MXFP8 in a short-prompt serving benchmark. A separate SP1×DP4 throughput configuration delivers 6,115 images/hour, which the authors project to 146,755 images/day and, at an assumed USD 0.06879 per image, USD 105.16/GPU/hour gross revenue at full billable utilization before operating costs. The post also documents VAE decoding gains from CUDA Graph replay plus multiple streams (2.635 s to 0.213 s on four GB300 GPUs) and community validations on AMD, Intel, Huawei Ascend and Moore Threads hardware.
Useful for readers weighing open-weight 4K image serving, since it separates latency and throughput operating points and labels its revenue projections as extrapolations before operating costs.
Source: vLLM Blog · vllm.ai