None1145
/

Llama-3-8B-Theresa

Text Generation

Inference Endpoints

Model card Files Files and versions Community

None1145 commited on Nov 9, 2024

Commit

4125dea

·

verified ·

1 Parent(s): edc5e74

README

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -25,5 +25,7 @@ ver = "ver0.2"
 model_id = "None1145/Llama-3-8B-Theresa/{ver}"
 pipeline = transformers.pipeline(
 pipeline("你好")
 ```

 model_id = "None1145/Llama-3-8B-Theresa/{ver}"
 pipeline = transformers.pipeline(
+    "text-generation", model=model_id, model_kwargs={"torch_dtype": torch.bfloat16}, device_map="auto"
+)
 pipeline("你好")
 ```