Model Type in ctransformers to use gguf gemma

by aryachakraborty - opened Mar 10

Mar 10

I want to use a GGUF version of a fine tuned Gemma model using CTransformers. There is a parameter called 'model_type'. can you tell me what will be the model type for the gemma model.

aryachakraborty changed discussion title from Model Type in ctransformers to Model Type in ctransformers to use gguf gemma Mar 10

mlabonne

Owner Mar 11

I don't think this is currently supported but you can directly ask it on GitHub: https://github.com/marella/ctransformers

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment