File size: 185 Bytes
3bdd8d6 |
1 2 3 4 5 6 7 8 9 10 11 12 13 |
---
license: mit
---
awq version of agentica-org/DeepCoder-14B-Preview
```
quant_config = {
"zero_point": True,
"q_group_size": 128,
"w_bit": 4,
"version": "GEMM"
}
``` |