File size: 1,531 Bytes
28ade5b
7d61a63
 
 
 
 
28ade5b
 
 
 
7d61a63
 
 
 
 
 
 
 
 
 
 
 
 
 
 
28ade5b
10e6bdb
7d61a63
28ade5b
9f78a84
 
10e6bdb
 
7d61a63
28ade5b
7d61a63
28ade5b
10e6bdb
 
7d61a63
2900e17
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
---
base_model:
- mistralai/Pixtral-12B-2409
- TheDrummer/Rocinante-12B-v1.1
- TheDrummer/UnslopNemo-12B-v3
base_model_relation: merge
library_name: transformers
tags:
- mergekit
- merge
- multimodal
- mistral
- pixtral
language:
- en
- fr
- de
- es
- it
- pt
- ru
- zh
- ja
license: other
pipeline_tag: image-text-to-text
---

# Razorback 12B v0.1

## Update: Use v0.2 [nintwentydo/Razorback-12B-v0.2](https://huggingface.co/nintwentydo/Razorback-12B-v0.2)

<img src="https://huggingface.co/nintwentydo/Razorback-12B-v0.1/resolve/main/razorback.jpg" style="max-width:700px"></img>

This is a first pass attempt to merge Mistral Nemo finetunes with Pixtral 12B. Has not been fully tested yet other than confirming it can understand vision input and output coherent text. May be unstable for all we know lol. 

Pixtral 12B as base with TheDrummer's Rocinante and UnslopNemo finetunes merged in. 

In *The Expanse* the Razorback is a ship fitted with engines way bigger than a ship of its size would normally have. Thought it was a fitting way to celebrate TheDrummer's models supercharging Pixtral. 😉 

## Credits
- Mistral for [mistralai/Pixtral-12B-2409](https://huggingface.co/mistralai/Pixtral-12B-2409) 
- Unsloth for [unsloth/Pixtral-12B-2409](https://huggingface.co/unsloth/Pixtral-12B-2409) transformers conversion 
- TheDrummer for [TheDrummer/Rocinante-12B-v1.1](https://huggingface.co/TheDrummer/Rocinante-12B-v1.1) 
- TheDrummer for [TheDrummer/UnslopNemo-12B-v3](https://huggingface.co/TheDrummer/UnslopNemo-12B-v3)