A new Speculative decoding drafter for vLLM and SGLang called EAGLE-4

(github.com)

2 points | by sgiannopoulos 6 hours ago

No comments yet.