altomek
/

dolphin-2.9.3-mistral-nemo-12b-8bpw-EXL2

Text Generation

Generated from Trainer

text-generation-inference

8-bit precision

Model card Files Files and versions Community

Dolphin 2.9.3 Mistral Nemo 12b

ExLlamav2 8 bpw quants of https://huggingface.co/cognitivecomputations/dolphin-2.9.3-mistral-nemo-12b

Downloads last month: 9

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for altomek/dolphin-2.9.3-mistral-nemo-12b-8bpw-EXL2

Base model

mistralai/Mistral-Nemo-Base-2407

Finetuned

cognitivecomputations/dolphin-2.9.3-mistral-nemo-12b

Quantized

(4)

this model

Datasets used to train altomek/dolphin-2.9.3-mistral-nemo-12b-8bpw-EXL2