MediaTek-Research
/

Breeze-7B-Instruct-v0_1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Splend1dchan commited on Jan 17, 2024

Commit

b14be99

·

verified ·

1 Parent(s): f422e8e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -180,7 +180,7 @@ from transformers import AutoModelForCausalLM, AutoTokenizer
 import torch
 model = AutoModelForCausalLM.from_pretrained(
-    model="MediaTek-Research/Breeze-7B-Instruct-v0.1",
     device_map="auto",
     torch_dtype=torch.bfloat16,
     use_flash_attn_2=True # optional

 import torch
 model = AutoModelForCausalLM.from_pretrained(
+    "MediaTek-Research/Breeze-7B-Instruct-v0.1",
     device_map="auto",
     torch_dtype=torch.bfloat16,
     use_flash_attn_2=True # optional