y-ryan commited on
Commit
eaeae60
·
verified ·
1 Parent(s): 8dbb0f6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -2
README.md CHANGED
@@ -13,8 +13,12 @@ tags:
13
  license: llama3.3
14
  ---
15
 
16
- The [original model](https://huggingface.co/Tarek07/Progenitor-V5-Final-LLaMa-70B) had invalid `tensor.Shape` for weights (`[1, 8192]`). So I resized them into `[8192]`.
17
- The script I used is:
 
 
 
 
18
  ```python
19
  import os
20
  from safetensors.torch import load_file, save_file
 
13
  license: llama3.3
14
  ---
15
 
16
+ The [original model](https://huggingface.co/Tarek07/Progenitor-V5-Final-LLaMa-70B) had invalid `tensor.Shape` for weights (`[1, 8192]`), raising following errors when loading with `transformers`:
17
+ ```
18
+ ValueError: Trying to set a tensor of shape torch.Size([1, 8192]) in "weight" (which has shape torch. Size ( [8192])), this looks incorrect.
19
+ ```
20
+
21
+ So I resized them into `[8192]` with following script:
22
  ```python
23
  import os
24
  from safetensors.torch import load_file, save_file