When Fancy Eviction Fails: Rethinking Cache Replacement for LLM Prefix Reuse

(arxiv.org)

1 points | by matt_d 10 hours ago

No comments yet.