yniu commited on
Commit
228c3bf
·
verified ·
1 Parent(s): f12d3d5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -37
README.md CHANGED
@@ -1,37 +1,7 @@
1
- ---
2
- license: mit
3
- ---
4
-
5
- # Evaluator
6
-
7
- This model is a fine-tuned version of Meta-Llama-3.1-8B-Instruct
8
-
9
- ## Training and evaluation data
10
-
11
- More information needed
12
-
13
- ## Training procedure
14
-
15
- ### Training hyperparameters
16
-
17
- The following hyperparameters were used during training:
18
- - learning_rate: 5e-06
19
- - train_batch_size: 2
20
- - eval_batch_size: 8
21
- - seed: 42
22
- - distributed_type: multi-GPU
23
- - num_devices: 8
24
- - gradient_accumulation_steps: 4
25
- - total_train_batch_size: 64
26
- - total_eval_batch_size: 64
27
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
28
- - lr_scheduler_type: cosine
29
- - lr_scheduler_warmup_steps: 100
30
- - num_epochs: 6.0
31
-
32
- ### Framework versions
33
-
34
- - Transformers 4.44.2
35
- - Pytorch 2.4.1+cu118
36
- - Datasets 2.21.0
37
- - Tokenizers 0.19.1
 
1
+ ---
2
+ license: mit
3
+ ---
4
+
5
+ # Evaluator
6
+
7
+ This model is a fine-tuned version of Meta-Llama-3.1-8B-Instruct