2024-03-14
This is a 3-bit exl2 (Exllamav2) conversion of MistralAI's Mistral-7B-Instruct-v0.2
This takes about 2.8G on disk, so it should load on consumer cards.
- More on ExLlamav2 -> https://github.com/turboderp/exllamav2 ( works with Oobabooga's textgen web ui )
- Original Model -> https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2 ( Original files are ~17GB on disk )
- Downloads last month
- 4
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.