Fathom: Per-query read depth for sparse decoding over offloaded KV caches

(arxiv.org)

1 points | by vivekkalyanaran 4 hours ago

1 comments