Quantization into 8bit/4bit?

by Yhyu13 - opened Sep 23, 2023

Sep 23, 2023

Would you release quantized versions of MathGLM like ChatGLM for the community?

Yhyu13 changed discussion title from Auto Quantization into 8bit/4bit? to Quantization into 8bit/4bit? Sep 23, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment