Requesting a Quant

#1
by bigfish3 - opened

Can you make some imat quants for Umbra-v2.1-MoE-4x10.7? Even better if it were Q4 or Q5 with iMat.

https://huggingface.co/Steelskull/Umbra-v2.1-MoE-4x10.7

Sure, I'll put it in the queue.

mradermacher changed discussion status to closed

Sign up or log in to comment