Dynamic Quant?

by wyes1 - opened Jan 29

wyes1

Jan 29

Just came here from the full size R1 quant announcement, I was wondering if this model could get a dynamic quant?

Unsloth AI org Jan 29

Just came here from the full size R1 quant announcement, I was wondering if this model could get a dynamic quant?

Good idea we'll see what we can do. However it might not be as good as R1's efficiency

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment