Hugging Face's logo

stan-hua
/
Ministral-8B-Instruct-2410-AWQ-W4A16

Safetensors
mistral
4-bit precision
awq
Model card Files Community
Ministral-8B-Instruct-2410-AWQ-W4A16

Commit History

AWQ model for mistralai/Ministral-8B-Instruct-2410: {'w_bit': 4, 'zero_point': True, 'q_group_size': 128, 'version': 'GEMM'}
5be646b
verified

stan-hua commited on

AWQ model for mistralai/Ministral-8B-Instruct-2410: {'w_bit': 4, 'zero_point': True, 'q_group_size': 128, 'version': 'GEMM'}
23fb908
verified

stan-hua commited on

initial commit
4dffb00
verified

stan-hua commited on