Hugging Face's logo

Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
Back to feed
wenhuach 
posted an update 19 days ago
Post
329
This week, OPEA Space released several new INT4 models, including:
nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
allenai/OLMo-2-1124-13B-Instruct
THUDM/glm-4v-9b
AIDC-AI/Marco-o1
and several others.
Let us know which models you'd like prioritized for quantization, and we'll do our best to make it happen!

https://huggingface.co/OPEA
John6666

It might be difficult because it's a individual model, but I'd be happy if it was quantized.
https://huggingface.co/fancyfeast/llama-joycaption-alpha-two-hf-llava

·
wenhuach

Sure, we will have a try

In this post