"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization
Paper
•
2411.02355
•
Published
•
46
Jenny Y
jennyyyi
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
about 2 months ago
"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM
Quantization
Organizations
