OpenSourceRonin commited on
Commit
892f3a0
1 Parent(s): 806f9bf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +30 -3
README.md CHANGED
@@ -1,3 +1,30 @@
1
- ---
2
- license: llama3.1
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: llama3.1
3
+ ---
4
+ **Disclaimer**:
5
+
6
+ The model is reproduced based on the paper *VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models* [github](https://github.com/microsoft/vptq)
7
+
8
+ The model itself is sourced from a community release.
9
+
10
+ It is intended only for experimental purposes.
11
+
12
+ Users are responsible for any consequences arising from the use of this model.
13
+
14
+ **Note**:
15
+
16
+ The PPL test results are for reference only and were collected using GPTQ testing script.
17
+
18
+ ```json
19
+ {
20
+ "ctx_2048": {
21
+ "wikitext2": 7.63037109375
22
+ },
23
+ "ctx_4096": {
24
+ "wikitext2": 7.144953727722168
25
+ },
26
+ "ctx_8192": {
27
+ "wikitext2": 6.862803936004639
28
+ }
29
+ }
30
+ ```