Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints

Quantized model

#6
by MaziyarPanahi - opened

Thanks for sharing this model with the community, I have quantized it in GGUF if anyone needs it:
https://huggingface.co/MaziyarPanahi/Yi-9B-GGUF

thanks!

Sign up or log in to comment