Update README.md
Browse files
README.md
CHANGED
@@ -3,7 +3,7 @@ license: llama2
|
|
3 |
---
|
4 |
EXL2 quants of alpindale/goliath-120b (https://huggingface.co/alpindale/goliath-120b), to be used on exllamav2.
|
5 |
|
6 |
-
Calibration dataset is wikitext. I've added a measurement.json file if you want to do your own quants.
|
7 |
|
8 |
[4.85bpw](https://huggingface.co/Panchovix/goliath-120b-exl2/tree/4.85bpw)
|
9 |
|
|
|
3 |
---
|
4 |
EXL2 quants of alpindale/goliath-120b (https://huggingface.co/alpindale/goliath-120b), to be used on exllamav2.
|
5 |
|
6 |
+
Calibration dataset is wikitext. I've added a measurement.json file on the main branch if you want to do your own quants.
|
7 |
|
8 |
[4.85bpw](https://huggingface.co/Panchovix/goliath-120b-exl2/tree/4.85bpw)
|
9 |
|