Hugging Face's logo

latimar
/
Synthia-13B-exl2

Text Generation
Transformers
llama
Inference Endpoints
Model card Files Community
1

Can you quantize MythoMax

#1
by TheYuriLover - opened
Discussion
TheYuriLover

This one deserves a 4.625 and 5.0 bpw quant :D

latimar
 Owner

There are already EXL2 quants of MythoMax: https://huggingface.co/QMB15/mythomax-13B-8.13bit-MAX-exl2 , https://huggingface.co/QMB15/mythomax-L2-13B-4.625bit-exl2

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment