>1B tokens/minute/GPU by combining query planner and inference engine

(modal.com)

1 points | by birdculture 7 hours ago

No comments yet.