Dynamic quants
#13
by
XelotX
- opened
Hey guys, first of all thank you and great job all around!
Could you also create dynamic quants for V3 as well (as you did for R1)? Or do you have a colab that does it?
Thank you.
Hey guys, first of all thank you and great job all around!
Could you also create dynamic quants for V3 as well (as you did for R1)? Or do you have a colab that does it?
Thank you.
Hi if it's a higher request we will do it. Unfortunately it will take a lot of time from our side and money but we'll see what we can do. Thank you for the request!
Thank you for responding.
I'm guessing is mostly a manual optimization step. I don't have the most powerful machine (2x3090, 9950x with 192 ddr5, pop os) but if I can help in any way do let me know.
Cheers and all the best.