vLLM Serving Experiments on H100s – config beats the baseline on p95 TTFT,ITL

(efficientagent.substack.com)

1 points | by bnayak25 12 hours ago

1 comments