MediaTek-Research
/

Breeze-7B-Base-v0_1

Text Generation

text-generation-inference

Model card Files Files and versions Community

YC-Chen commited on Jan 19, 2024

Commit

8fea15c

·

verified ·

1 Parent(s): 13f4441

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -176,7 +176,7 @@ from transformers import AutoModelForCausalLM, AutoTokenizer
 import torch
 model = AutoModelForCausalLM.from_pretrained(
-    model="MediaTek-Research/Breeze-7B-Base-v0_1",
     device_map="auto",
     torch_dtype=torch.bfloat16,
     attn_implementation="flash_attention_2" # optional

 import torch
 model = AutoModelForCausalLM.from_pretrained(
+    "MediaTek-Research/Breeze-7B-Base-v0_1",
     device_map="auto",
     torch_dtype=torch.bfloat16,
     attn_implementation="flash_attention_2" # optional