OpenSourceRonin commited on
Commit
8174f9b
·
verified ·
1 Parent(s): 3206034

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -3
README.md CHANGED
@@ -1,3 +1,31 @@
1
- ---
2
- license: llama3.1
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ ---
3
+ license: llama3.1
4
+ ---
5
+ **Disclaimer**:
6
+
7
+ The model is reproduced based on the paper *VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models* [github](https://github.com/microsoft/vptq) and [arXiv](https://arxiv.org/abs/2409.17066)
8
+
9
+ The model itself is sourced from a community release.
10
+
11
+ It is intended only for experimental purposes.
12
+
13
+ Users are responsible for any consequences arising from the use of this model.
14
+
15
+ **Note**:
16
+
17
+ The PPL test results are for reference only and were collected using GPTQ testing script.
18
+
19
+ ```json
20
+ {
21
+ "ctx_2048": {
22
+ "wikitext2": 6.929847717285156
23
+ },
24
+ "ctx_4096": {
25
+ "wikitext2": 6.54049825668335
26
+ },
27
+ "ctx_8192": {
28
+ "wikitext2": 6.35698127746582
29
+ }
30
+ }
31
+ ```