GGUF Format

#1
by kalle07 - opened

at the moment not possible , you have any idea ?

Anvilogic org

Hmm this is a tricky one ,this model was made with CANINE model as the problem we solve is sensitive to slight letter change. I dont know how well GGUF support CANINE architectures. Mybe an onnx optimized custom model would be a better solution

Sign up or log in to comment