TehVenom commited on
Commit
11a73e1
1 Parent(s): aeccaa5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -24,7 +24,7 @@ It was trained by doing supervised fine-tuning over a mixture of regular instruc
24
 
25
  The current Metharme-13b has been trained as a LoRA, then merged down to the base model for distribuition.
26
 
27
- It has also been quantized down to 4Bit using the GPTQ library available here: https://github.com/0cc4m/GPTQ-for-LLaMa
28
  ```
29
  python llama.py .\TehVenom_Metharme-13b-Merged c4 --wbits 8 --act-order --save_safetensors Metharme-13b-GPTQ-8bit.act-order.safetensors
30
  ```
 
24
 
25
  The current Metharme-13b has been trained as a LoRA, then merged down to the base model for distribuition.
26
 
27
+ It has also been quantized down to 8Bit using the GPTQ library available here: https://github.com/0cc4m/GPTQ-for-LLaMa
28
  ```
29
  python llama.py .\TehVenom_Metharme-13b-Merged c4 --wbits 8 --act-order --save_safetensors Metharme-13b-GPTQ-8bit.act-order.safetensors
30
  ```