A Self-Pruning Transformer: Extreme KV-Cache Compression w/Universal Attention

(arxiv.org)

6 points | by matt_d 12 hours ago

No comments yet.