YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

This repo contains GGUF .mmproj files intended for use in KoboldCpp alongside other GGUF models.

Please pick the correct projector model to load for your architecture (e.g. all Mistral 7B based models should use the Mistral 7B projector.)

Load them in KoboldCpp with --mmproj or from the "Model Files" tab

image/png

When enabled, make sure you refresh KoboldAI Lite, then click Add Img and upload your image. Clicking that image should show Vision is enabled.

Downloads last month
9,864
GGUF
Model size
421M params
Architecture
clip

4-bit

5-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support