Thanks!
#2
by
naser2
- opened
Have not tested it yet but will give it a try later today. The GGUF version will be very much appreciated though!
I just came here to thank you for your effort!
Keep up the good work
I'm uploading GGUF quantized models (all normal and k-quants) here:
https://huggingface.co/asedmammad/Maral-7B-alpha-1-GGUF