Zirui Liu

rayliuray's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted an article 5 months ago

view article

Article

Unlocking Longer Generation with Key-Value Cache Quantization

May 16, 2024

• 40

upvoted a paper 8 months ago

KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache

Paper • 2402.02750 • Published Feb 5, 2024 • 3