Serving a 1T open model at 511 tok.s single-stream, lossless, on four B200s

(brainsless.com)

7 points | by alsufiman a day ago

1 comments