Get More with LESS: Synthesizing Recurrence with KV Cache Compression for Efficient LLM Inference
Paper
•
2402.09398
•
Published
Xinyu Yang
Hanyuezhuohua
AI & ML interests
None yet
Recent Activity
authored
a paper
about 1 month ago
Get More with LESS: Synthesizing Recurrence with KV Cache Compression
for Efficient LLM Inference
authored
a paper
about 1 month ago
BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View
Representation
authored
a paper
about 1 month ago
Zeroth-Order Fine-Tuning of LLMs with Extreme Sparsity
Organizations
None yet
Hanyuezhuohua's activity
authored
8
papers
about 1 month ago
BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representation
Paper
•
2205.13542
•
Published
Zeroth-Order Fine-Tuning of LLMs with Extreme Sparsity
Paper
•
2406.02913
•
Published
FlatFormer: Flattened Window Attention for Efficient Point Cloud Transformer
Paper
•
2301.08739
•
Published
Improving Domain Generalization with Domain Relations
Paper
•
2302.02609
•
Published
VcLLM: Video Codecs are Secretly Tensor Codecs
Paper
•
2407.00467
•
Published
•
1
It Takes Two: On the Seamlessness between Reward and Policy Model in RLHF
Paper
•
2406.07971
•
Published
S$^{2}$FT: Efficient, Scalable and Generalizable LLM Fine-tuning by Structured Sparsity
Paper
•
2412.06289
•
Published