jerryzh168 commited on
Commit
aa8ef96
·
verified ·
1 Parent(s): ab71d7e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -26,7 +26,7 @@ pip install --pre torchao --index-url https://download.pytorch.org/whl/nightly/c
26
  ```
27
 
28
  ## Untie Embedding Weights
29
- Before quantization, since we need quantize input embedding and unembedding (lm_head) layer which are tied, we first need to untie the model:
30
 
31
  ```
32
  from transformers import (
 
26
  ```
27
 
28
  ## Untie Embedding Weights
29
+ Before quantization, since we need quantize input embedding and unembedding (lm_head) layer which are tied, but we want to quantize them separately, we first need to untie the model:
30
 
31
  ```
32
  from transformers import (