gguf model?

by clarity99 - opened 11 days ago

Discussion

clarity99

11 days ago

Hi,

any chance of providing a .gguf model, so it can be easier to use?

Thank you for your work!

dvres

Center za jezikovne vire in tehnologije Univerze v Ljubljani org about 4 hours ago

Hi, so far there is no plan for conversion to GGUF format - we are currently focusing on larger version of the model. However, GaMS is supported in vLLM library that enables easy and efficient usage and parallelisations on GPU.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment