olinguyen commited on
Commit
65d202a
·
verified ·
1 Parent(s): 13a07b6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -8
README.md CHANGED
@@ -11,9 +11,9 @@ tags: []
11
 
12
  ## Model Details
13
 
14
- Base model results:
 
15
 
16
- model=meta-llama/Llama-3.2-1B-Instruct
17
  |Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
18
  |------|------:|------|-----:|-----------------------|---|-----:|---|------|
19
  |ifeval| 4|none | 0|inst_level_loose_acc |↑ |0.6475|± | N/A|
@@ -23,15 +23,14 @@ model=meta-llama/Llama-3.2-1B-Instruct
23
 
24
 
25
 
26
- Fine-tuned model results:
27
 
28
- model=meta-llama/Llama-3.2-1B-Instruct
29
  |Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
30
  |------|------:|------|-----:|-----------------------|---|-----:|---|------|
31
- |ifeval| 4|none | 0|inst_level_loose_acc |↑ |0.6475|± | N/A|
32
- | | |none | 0|inst_level_strict_acc |↑ |0.4856|± | N/A|
33
- | | |none | 0|prompt_level_loose_acc |↑ |0.5342|± |0.0215|
34
- | | |none | 0|prompt_level_strict_acc|↑ |0.3549|± |0.0206|
35
 
36
  ### Model Description
37
 
 
11
 
12
  ## Model Details
13
 
14
+ Base model (meta-llama/Llama-3.2-1B-Instruct) results:
15
+
16
 
 
17
  |Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
18
  |------|------:|------|-----:|-----------------------|---|-----:|---|------|
19
  |ifeval| 4|none | 0|inst_level_loose_acc |↑ |0.6475|± | N/A|
 
23
 
24
 
25
 
26
+ Fine-tuned model (meta-llama/Llama-3.2-1B-Instruct using [mlabonne/orpo-dpo-mix-40k](https://huggingface.co/datasets/mlabonne/orpo-dpo-mix-40k)) results:
27
 
 
28
  |Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
29
  |------|------:|------|-----:|-----------------------|---|-----:|---|------|
30
+ |ifeval| 4|none | 0|inst_level_loose_acc |↑ |0.5132|± | N/A|
31
+ | | |none | 0|inst_level_strict_acc |↑ |0.4748|± | N/A|
32
+ | | |none | 0|prompt_level_loose_acc |↑ |0.3752|± |0.0208|
33
+ | | |none | 0|prompt_level_strict_acc|↑ |0.3327|± |0.0203|
34
 
35
  ### Model Description
36