Hugging Face's logo

stan-hua
/
Mistral-7B-Instruct-v0.3-AWQ-W4A16

Safetensors
mistral
4-bit precision
awq
Model card Files Community
Mistral-7B-Instruct-v0.3-AWQ-W4A16

Commit History

AWQ model for mistralai/Mistral-7B-Instruct-v0.3: {'w_bit': 4, 'zero_point': True, 'q_group_size': 128, 'version': 'GEMM'}
52598c3
verified

stan-hua commited on

AWQ model for mistralai/Mistral-7B-Instruct-v0.3: {'w_bit': 4, 'zero_point': True, 'q_group_size': 128, 'version': 'GEMM'}
82b4498
verified

stan-hua commited on

initial commit
003884f
verified

stan-hua commited on