LoneStriker commited on
Commit
0393205
1 Parent(s): 5d02e72

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ # ExLlamaV2 Measurements
2
+
3
+ Measurement files used to quantize models uploaded here. Depending on the model type one of the following datasets is used for calibration:
4
+ * General chat or instruct model: ThePile [0007.parquet](https://huggingface.co/datasets/EleutherAI/the_pile_deduplicated/resolve/refs%2Fconvert%2Fparquet/default/train/0007.parquet)
5
+ * Coding model: [WizardLM_evol_instruct_V2_196k](https://huggingface.co/datasets/WizardLM/WizardLM_evol_instruct_V2_196k)
6
+ * RP model: pippa.parquet (from users of TheBloke Discord)
7
+ * Japanese model: filtered text from file [Japanese Wiki file jawikibooks-20231023-cirrussearch](https://dumps.wikimedia.org/other/cirrussearch/20231023/jawikibooks-20231023-cirrussearch-content.json.gz)