Gguf?

#1
by edwardDali - opened

Any gguf version?
Thank you!

attempting now. there's no included tokenizer.model, is that on purpose @chrlu ? Attempting to parse the json but unsure if the results will be proper yet

Sakana AI org

Thanks! I think the current setup should be identical to this one:

https://huggingface.co/HuggingFaceH4/zephyr-7b-gemma-v0.1

Okay I had to pull in the tokenizer.model from google's gemma models and then fix a llama.cpp bug but i think I should be able to make them now 🀞

Sign up or log in to comment