Koki Itai commited on
Commit
d9e7b8b
1 Parent(s): 0dc36b0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +76 -3
README.md CHANGED
@@ -1,5 +1,78 @@
1
- 元モデル:neoAI-pj-absol/llmjpv2.0-full-checkpoint2000
2
 
3
- data:hh-rlhf(kunishou)
4
 
5
- parameter:lr5e-7,beta0.1,epoch20
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # **Model Description**
2
 
3
+ **Llama 3 neoAI 8B Chat v0.1**は,[Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct)をベースとして日本語能力を強化するために事後学習を行なったモデルです.
4
 
5
+ 詳細はブログ記事を参照してください.
6
+
7
+ # Usage
8
+
9
+ ## Huggingface
10
+
11
+ ```python
12
+ import transformers
13
+ import torch
14
+
15
+ model_id = "neoai-inc/Llama-3-neoAI-8B-Chat-v0.1"
16
+
17
+ pipeline = transformers.pipeline(
18
+ "text-generation",
19
+ model=model_id,
20
+ model_kwargs={"torch_dtype": torch.bfloat16},
21
+ device_map="auto",
22
+ )
23
+
24
+ messages = [
25
+ {"role": "system", "content": "あなたは誠実で優秀な日本人のアシスタントです。"},
26
+ {"role": "user", "content": "日本で一番高い山は?"},
27
+ ]
28
+
29
+ terminators = [
30
+ pipeline.tokenizer.eos_token_id,
31
+ pipeline.tokenizer.convert_tokens_to_ids("<|eot_id|>")
32
+ ]
33
+
34
+ outputs = pipeline(
35
+ messages,
36
+ max_new_tokens=256,
37
+ eos_token_id=terminators,
38
+ do_sample=True,
39
+ temperature=0.6,
40
+ top_p=0.9,
41
+ )
42
+ print(outputs[0]["generated_text"][-1])
43
+
44
+ ```
45
+
46
+ # Evaluation
47
+
48
+ - [suzume](https://huggingface.co/Rakuten/RakutenAI-7B-instruct): Mt-bechのスコア図とか載せてる
49
+ - [rakuten](https://huggingface.co/Rakuten/RakutenAI-7B-instruct): スコアの表を載せている
50
+
51
+ # License
52
+
53
+ Llama 3 is licensed under the Meta LLAMA 3 Community License, Copyright (c) Meta Platforms, Inc. All Rights Reserved.
54
+
55
+ # Developed by
56
+
57
+ neoAIロゴ
58
+
59
+ # Developers
60
+
61
+ 以下アルファベット順
62
+
63
+ - Gouki Minegishi
64
+ - Koki Itai
65
+ - Koshiro Terasawa
66
+ - Masaki Otsuki
67
+ - Ryo Yagi
68
+
69
+ # How to Cite
70
+
71
+ ```python
72
+ @misc{neoAI-Llama3-8B-Chat-v0.1,
73
+ title={Llama-3-neoAI-8B-Chat-v0.1},
74
+ url={https://huggingface.co/neoai-inc/Llama-3-neoAI-8B-Chat-v0.1},
75
+ author={Gouki Minegishi and Koki Itai and Koshiro Terasawa and Masaki Otsuki and Ryo Yagi},
76
+ year={2024},
77
+ }
78
+ ```