stan-hua
/

Mistral-7B-Instruct-v0.3-AWQ-W4A16

4-bit precision

Model card Files Files and versions Community

Mistral-7B-Instruct-v0.3-AWQ-W4A16

1 contributor

History: 3 commits

stan-hua's picture

AWQ model for mistralai/Mistral-7B-Instruct-v0.3: {'w_bit': 4, 'zero_point': True, 'q_group_size': 128, 'version': 'GEMM'}

52598c3 verified 4 days ago

.gitattributes

1.52 kB

initial commit 5 days ago
config.json

965 Bytes

AWQ model for mistralai/Mistral-7B-Instruct-v0.3: {'w_bit': 4, 'zero_point': True, 'q_group_size': 128, 'version': 'GEMM'} 4 days ago
generation_config.json

132 Bytes

AWQ model for mistralai/Mistral-7B-Instruct-v0.3: {'w_bit': 4, 'zero_point': True, 'q_group_size': 128, 'version': 'GEMM'} 5 days ago
model.safetensors

4.16 GB
LFS

AWQ model for mistralai/Mistral-7B-Instruct-v0.3: {'w_bit': 4, 'zero_point': True, 'q_group_size': 128, 'version': 'GEMM'} 4 days ago
quant_config.json

90 Bytes

AWQ model for mistralai/Mistral-7B-Instruct-v0.3: {'w_bit': 4, 'zero_point': True, 'q_group_size': 128, 'version': 'GEMM'} 5 days ago
special_tokens_map.json

414 Bytes

AWQ model for mistralai/Mistral-7B-Instruct-v0.3: {'w_bit': 4, 'zero_point': True, 'q_group_size': 128, 'version': 'GEMM'} 5 days ago
tokenizer.json

3.67 MB

AWQ model for mistralai/Mistral-7B-Instruct-v0.3: {'w_bit': 4, 'zero_point': True, 'q_group_size': 128, 'version': 'GEMM'} 5 days ago
tokenizer.model

587 kB
LFS

AWQ model for mistralai/Mistral-7B-Instruct-v0.3: {'w_bit': 4, 'zero_point': True, 'q_group_size': 128, 'version': 'GEMM'} 5 days ago
tokenizer_config.json

141 kB

AWQ model for mistralai/Mistral-7B-Instruct-v0.3: {'w_bit': 4, 'zero_point': True, 'q_group_size': 128, 'version': 'GEMM'} 5 days ago