pankajmathur
/

orca_mini_v8_1_70b

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

pankajmathur commited on 5 days ago

Commit

8fbc0b2

•

1 Parent(s): 341340a

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -39,7 +39,7 @@ Hello Orca Mini, what can you do for me?<|eot_id|>
 <|start_header_id|>assistant<|end_header_id|>
 ```
-Below shows a code example on how to use this model in default full precision (bf16) format, it requires around ~133GB VRAM
 ```python
 import torch

 <|start_header_id|>assistant<|end_header_id|>
 ```
+Below shows a code example on how to use this model in default half precision (bfloat16) format, it requires around ~133GB VRAM
 ```python
 import torch