Update README.md
Browse files
README.md
CHANGED
@@ -13,8 +13,12 @@ tags:
|
|
13 |
license: llama3.3
|
14 |
---
|
15 |
|
16 |
-
The [original model](https://huggingface.co/Tarek07/Progenitor-V5-Final-LLaMa-70B) had invalid `tensor.Shape` for weights (`[1, 8192]`)
|
17 |
-
|
|
|
|
|
|
|
|
|
18 |
```python
|
19 |
import os
|
20 |
from safetensors.torch import load_file, save_file
|
|
|
13 |
license: llama3.3
|
14 |
---
|
15 |
|
16 |
+
The [original model](https://huggingface.co/Tarek07/Progenitor-V5-Final-LLaMa-70B) had invalid `tensor.Shape` for weights (`[1, 8192]`), raising following errors when loading with `transformers`:
|
17 |
+
```
|
18 |
+
ValueError: Trying to set a tensor of shape torch.Size([1, 8192]) in "weight" (which has shape torch. Size ( [8192])), this looks incorrect.
|
19 |
+
```
|
20 |
+
|
21 |
+
So I resized them into `[8192]` with following script:
|
22 |
```python
|
23 |
import os
|
24 |
from safetensors.torch import load_file, save_file
|