Are you planning to publics GGUF versions?

#10

by a-ghorbani - opened 2 days ago

Discussion

a-ghorbani

2 days ago

Are you planning to publics GGUF versions? It would be good to see how it performs on phones.

jaeb

OpenGPT-X org 2 days ago

Hey, llama.cpp can be used to create GGUFs yourself. I think there are also online converters on HuggingFace which you can use if you don't want to set up llama.cpp. Please note that the models have not been tested for compatibility with llama.cpp.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment