Can Math score be regained?
#18
by
SandInTheDunes
- opened
It is interesting that almost 20 point were lost from the original model. Is it possible to regain the Math capabilities?
Thank you for your work!
this model is based on a self-merge model I made calme-3-selfmerge-qwen2-78. I haven't evaluated that one, these are just too large to evaluate if not needed. But it is a good point to consider that there are models with this size with better math.
I have good math datasets, I'll see if I can heal the metrics for the math as well.
Great, thank you! Then your model will be even harder to beat :)