Can you quantify this model in exl2?
#7
by
xldistance
- opened
Someone commented under https://www.reddit.com/r/LocalLLaMA/comments/1d8m7tw/glm4_9b_base_chat_1m_variant_vision_language_model/ that it is not supported by the tool yet.