TeeZee commited on
Commit
4aac96a
1 Parent(s): 391ecee

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md CHANGED
@@ -1,3 +1,15 @@
1
  ---
2
  license: apache-2.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
  ---
4
+ FP32 version of original BF16 mistral safetensors.
5
+
6
+ ```python
7
+ from transformers import AutoTokenizer, AutoModelForCausalLM
8
+ import torch
9
+
10
+ tokenizer = AutoTokenizer.from_pretrained("mistralai/Mistral-7B-v0.1")
11
+ model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-v0.1", torch_dtype=torch.float)
12
+
13
+ model.save_pretrained("./Mistral-7B-v0.1-fp32")
14
+ tokenizer.save_pretrained("./Mistral-7B-v0.1-fp32")
15
+ ```