Lost in Backpropagation: The LM Head Is a Gradient Bottleneck

(arxiv.org)

4 points | by famouswaffles a day ago

No comments yet.