metadata
base_model:
- mistralai/Pixtral-12B-2409
- TheDrummer/Rocinante-12B-v1.1
- TheDrummer/UnslopNemo-12B-v3
base_model_relation: merge
library_name: transformers
tags:
- mergekit
- merge
- multimodal
- mistral
- pixtral
language:
- en
- fr
- de
- es
- it
- pt
- ru
- zh
- ja
license: other
pipeline_tag: image-text-to-text
Razorback 12B v0.1
Update: Use v0.2 nintwentydo/Razorback-12B-v0.2
This is a first pass attempt to merge Mistral Nemo finetunes with Pixtral 12B. Has not been fully tested yet other than confirming it can understand vision input and output coherent text. May be unstable for all we know lol.
Pixtral 12B as base with TheDrummer's Rocinante and UnslopNemo finetunes merged in.
In The Expanse the Razorback is a ship fitted with engines way bigger than a ship of its size would normally have. Thought it was a fitting way to celebrate TheDrummer's models supercharging Pixtral. 😉
Credits
- Mistral for mistralai/Pixtral-12B-2409
- Unsloth for unsloth/Pixtral-12B-2409 transformers conversion
- TheDrummer for TheDrummer/Rocinante-12B-v1.1
- TheDrummer for TheDrummer/UnslopNemo-12B-v3