Commit
·
7e10fb8
1
Parent(s):
4cde805
update ReadME.md
Browse files
README.md
CHANGED
@@ -57,7 +57,7 @@ To ensure the consistency of model evaluation, we use [OpenCompass](https://open
|
|
57 |
```python
|
58 |
>>> from transformers import AutoModelForCausalLM, AutoTokenizer
|
59 |
>>> tokenizer = AutoTokenizer.from_pretrained("vivo-ai/BlueLM-7B-Base", trust_remote_code=True, use_fast=False)
|
60 |
-
>>> model = AutoModelForCausalLM.from_pretrained("vivo-ai/BlueLM-7B-Base", device_map="cuda:0", trust_remote_code=True)
|
61 |
>>> model = model.eval()
|
62 |
>>> inputs = tokenizer("儒林外史->吴敬梓\n隋唐演义->褚人获\n红楼梦->", return_tensors="pt")
|
63 |
>>> inputs = inputs.to("cuda:0")
|
@@ -72,8 +72,8 @@ To ensure the consistency of model evaluation, we use [OpenCompass](https://open
|
|
72 |
聊斋志异->蒲松龄
|
73 |
封神演义->许仲琳
|
74 |
东周列国志->冯梦龙
|
75 |
-
|
76 |
-
|
77 |
```
|
78 |
|
79 |
更多使用说明,请参考我们的 [Github 仓库](https://github.com/vivo-ai-lab/BlueLM)。
|
|
|
57 |
```python
|
58 |
>>> from transformers import AutoModelForCausalLM, AutoTokenizer
|
59 |
>>> tokenizer = AutoTokenizer.from_pretrained("vivo-ai/BlueLM-7B-Base", trust_remote_code=True, use_fast=False)
|
60 |
+
>>> model = AutoModelForCausalLM.from_pretrained("vivo-ai/BlueLM-7B-Base", device_map="cuda:0", torch_dtype=torch.bfloat16, trust_remote_code=True)
|
61 |
>>> model = model.eval()
|
62 |
>>> inputs = tokenizer("儒林外史->吴敬梓\n隋唐演义->褚人获\n红楼梦->", return_tensors="pt")
|
63 |
>>> inputs = inputs.to("cuda:0")
|
|
|
72 |
聊斋志异->蒲松龄
|
73 |
封神演义->许仲琳
|
74 |
东周列国志->冯梦龙
|
75 |
+
三言二拍->冯梦龙
|
76 |
+
官场现形记->李宝嘉
|
77 |
```
|
78 |
|
79 |
更多使用说明,请参考我们的 [Github 仓库](https://github.com/vivo-ai-lab/BlueLM)。
|