Hugging Face's logo

lavawolfiee
/
Mixtral-8x7B-Instruct-v0.1-offloading-hqq-4bit-3bit

Text Generation
Transformers
Safetensors
mixtral
text-generation-inference
conversational
Inference Endpoints
Model card Files Community
1
Mixtral-8x7B-Instruct-v0.1-offloading-hqq-4bit-3bit
  • 1 contributor
 History: 4 commits
lavawolfiee's picture
lavawolfiee
Added quantization_config.json
ee0081f