nintwentydo
/

Pixtral-Large-Instruct-2411

Image-Text-to-Text

Model card Files Files and versions Community

nintwentydo commited on Dec 18, 2024

Commit

f0c5ac2

·

verified ·

1 Parent(s): aca8d98

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -39,4 +39,6 @@ Chat template in chat_template.json uses the v7 instruct template:
 *- If you have a better implementation of the tokenizer let me know and I'm happy to swap it out.*
 *- As always pls respect the model license.*
-Currently doing a fresh measurement run ahead of re-doing my exl2 quants which I'll upload. Apologies in advance if anything is wonky, tbh this is just a personal learning exercise for me and I decided to make this model my fixation to freshen up on my knowledge lol.

 *- If you have a better implementation of the tokenizer let me know and I'm happy to swap it out.*
 *- As always pls respect the model license.*
+## Quantizations
+EXL2 quants are available in different sizes [here](https://huggingface.co/models?other=exl2&author=nintwentydo&search=pixtral-large). You'll need to use dev branch of [ExLlamaV2](https://github.com/turboderp/exllamav2/tree/dev) for vision input.