>"On a single GPU, this model delivers up to 5x higher throughput for agentic tasks compared to other open models in its size category.
[Scatter plot comparing Artificial Analysis Intelligence Index scores and output speed for open-weight models with 100K input tokens. Nemotron 3.5 Super VL exceeds 600 output tokens per second; the chart marks a 5x speed comparison with Inkling Small.]
Figure 1. Nemotron 3.5 Super VL delivers over 600 TPS on Artificial Analysis Intelligence Index agentic tasks on the Baseten endpoint"
This ~5x improvement is definitely a step forward!
>"On a single GPU, this model delivers up to 5x higher throughput for agentic tasks compared to other open models in its size category.
[Scatter plot comparing Artificial Analysis Intelligence Index scores and output speed for open-weight models with 100K input tokens. Nemotron 3.5 Super VL exceeds 600 output tokens per second; the chart marks a 5x speed comparison with Inkling Small.]
Figure 1. Nemotron 3.5 Super VL delivers over 600 TPS on Artificial Analysis Intelligence Index agentic tasks on the Baseten endpoint"
This ~5x improvement is definitely a step forward!