iproskurina
/

Mistral-7B-v0.3-gptq-3bit

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Mistral-7B-v0.3-gptq-3bit / special_tokens_map.json

Commit History

AutoGPTQ model for mistralai/Mistral-7B-v0.3: 3bits, gr128, desc_act=False

95a098c
verified

iproskurina commited on Sep 25, 2024