Qwen2.5 Technical Report
Paper
•
2412.15115
•
Published
•
323
Yongchang Hao
yongchanghao
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
3 days ago
Qwen2.5 Technical Report
reacted
to
their
post
with 🔥
about 2 months ago
We just released a paper (NeuZip) that compresses VRAM in a lossless manner to run larger models. This should be particularly useful when VRAM is insufficient during training/inference. Specifically, we look inside each floating number and find that the exponents are highly compressible (as shown in the figure below).
Read more about the work at https://huggingface.co/papers/2410.20650
authored
a paper
about 2 months ago
Teacher Forcing Recovers Reward Functions for Text Generation
Organizations
