Update README.md
Browse files
README.md
CHANGED
@@ -26,7 +26,7 @@ pip install --pre torchao --index-url https://download.pytorch.org/whl/nightly/c
|
|
26 |
```
|
27 |
|
28 |
## Untie Embedding Weights
|
29 |
-
Before quantization, since we need quantize input embedding and unembedding (lm_head) layer which are tied, we first need to untie the model:
|
30 |
|
31 |
```
|
32 |
from transformers import (
|
|
|
26 |
```
|
27 |
|
28 |
## Untie Embedding Weights
|
29 |
+
Before quantization, since we need quantize input embedding and unembedding (lm_head) layer which are tied, but we want to quantize them separately, we first need to untie the model:
|
30 |
|
31 |
```
|
32 |
from transformers import (
|