iqbalamo93 commited on
Commit
8c714ed
1 Parent(s): cb2237b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -27,13 +27,13 @@ widget:
27
  ---
28
 
29
  This is 8-bit GPTQ version of [Meta-Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct).
30
- Quantization has been done using auto-gptq library.
31
 
32
  ### Use with transformers
33
 
34
  Starting with `transformers >= 4.43.0` onward, you can run conversational inference using the Transformers `pipeline` abstraction or by leveraging the Auto classes with the `generate()` function.
35
 
36
- Make sure to update your transformers installation via `pip install --upgrade transformers` and you have auto-gptq, optimum installed.
37
 
38
  ```bash
39
  !pip install auto-gptq optimum --quiet
 
27
  ---
28
 
29
  This is 8-bit GPTQ version of [Meta-Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct).
30
+ Quantization has been done using [AutoGPTQ](https://github.com/AutoGPTQ/AutoGPTQ) library.
31
 
32
  ### Use with transformers
33
 
34
  Starting with `transformers >= 4.43.0` onward, you can run conversational inference using the Transformers `pipeline` abstraction or by leveraging the Auto classes with the `generate()` function.
35
 
36
+ Make sure to update your transformers installation via `pip install --upgrade transformers` and you have Autogptq, optimum installed.
37
 
38
  ```bash
39
  !pip install auto-gptq optimum --quiet