|
This repo contains GGUF .mmproj files intended for use in KoboldCpp alongside other GGUF models. |
|
|
|
Please pick the correct projector model to load for your architecture (e.g. all Mistral 7B based models should use the Mistral 7B projector.) |
|
|
|
Load them in KoboldCpp with `--mmproj` or from the "Model Files" tab |
|
|
|
 |
|
|
|
When enabled, make sure you refresh KoboldAI Lite, then click Add Img and upload your image. Clicking that image should show Vision is enabled. |