NVIDIA Vera Rubin NVL72 leads in MLPerf Endpoints v1.0 agentic inference benchmark
Understand this story
NVIDIA announced that Vera Rubin NVL72 leads in the agentic inference performance evaluation of MLPerf Endpoints v1.0. The benchmark evaluates inference systems via API on coding and enterprise workflows, measuring the balance between serving capacity and response speed, and targets AI agent workloads that must carry multi-turn conversation history, mixed generative inference, and tool calls and responses.
AI overview based on source reports · Updated 1 days ago
Coverage timeline
Follow the coverage to explore different perspectives.
- NVIDIA Technical BlogNVIDIA Vera Rubin NVL72 Leads Agentic Inference Performance on MLPerf Endpoints v1.0
NVIDIA says agentic workloads are placing growing demands on inference systems, as AI agents carry expanding conversation histories across turns and generate a mix of reasoning, tool calls and responses. MLPerf Endpoints v1.0 evaluates the balance between serving capacity and responsiveness using coding and enterprise workflows through an API. NVIDIA states that its Vera Rubin NVL72 leads agentic inference performance on this benchmark.
Activity for this story
- Current comparable activity
- 4
- Peak comparable activity
- 10Nov 17 01:00
- Change in the past 24 hours
- -49%
Trends compare the same fully observed participants, which may cover fewer participants than current activity. Move the pointer or tap the chart to inspect hourly activity; use the left and right arrow keys with a keyboard.