QwQ 1.5B version too?
#1
by
qingy2024
- opened
First of all, very useful model! I'm getting around 0.4-0.5 draft acceptance rates, so I think a higher-parameter version would give better performance.
Any plans to release a QwQ-1.5B distilled draft model too?
TIA
I just released the new models, including 1.5B and 7B AWQ.
These models are still in testing stage and thanks for your interest!