spisupat commited on
Commit
517459d
·
verified ·
1 Parent(s): 44c13c3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -73,7 +73,7 @@ Refer to the [original model card](https://huggingface.co/AtlaAI/Selene-1-Mini-L
73
  This quantisation was calibrated using a sample of 512 datapoints from the data used to train Selene-1-Mini.
74
  As a result, our quantised models show minimal performance degradation, losing <0.5% overall across benchmarks!
75
 
76
- For reference, an 8-bit [Llama-3.1-8B](neuralmagic/Meta-Llama-3.1-8B-quantized.w8a8) shows ~1.5% degradation across benchmarks.
77
 
78
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/633c4fb100732349209f2aad/K-455q4bMkd11-0P4XSdc.png)
79
 
 
73
  This quantisation was calibrated using a sample of 512 datapoints from the data used to train Selene-1-Mini.
74
  As a result, our quantised models show minimal performance degradation, losing <0.5% overall across benchmarks!
75
 
76
+ For reference, a GPTQ quantized 8-bit [Llama-3.1-8B](neuralmagic/Meta-Llama-3.1-8B-quantized.w8a8) shows ~1.5% degradation across benchmarks.
77
 
78
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/633c4fb100732349209f2aad/K-455q4bMkd11-0P4XSdc.png)
79