Update README.md
Browse files
README.md
CHANGED
@@ -11,9 +11,9 @@ tags: []
|
|
11 |
|
12 |
## Model Details
|
13 |
|
14 |
-
Base model results:
|
|
|
15 |
|
16 |
-
model=meta-llama/Llama-3.2-1B-Instruct
|
17 |
|Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
18 |
|------|------:|------|-----:|-----------------------|---|-----:|---|------|
|
19 |
|ifeval| 4|none | 0|inst_level_loose_acc |↑ |0.6475|± | N/A|
|
@@ -23,15 +23,14 @@ model=meta-llama/Llama-3.2-1B-Instruct
|
|
23 |
|
24 |
|
25 |
|
26 |
-
Fine-tuned model results:
|
27 |
|
28 |
-
model=meta-llama/Llama-3.2-1B-Instruct
|
29 |
|Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
30 |
|------|------:|------|-----:|-----------------------|---|-----:|---|------|
|
31 |
-
|ifeval| 4|none | 0|inst_level_loose_acc |↑ |0.
|
32 |
-
| | |none | 0|inst_level_strict_acc |↑ |0.
|
33 |
-
| | |none | 0|prompt_level_loose_acc |↑ |0.
|
34 |
-
| | |none | 0|prompt_level_strict_acc|↑ |0.
|
35 |
|
36 |
### Model Description
|
37 |
|
|
|
11 |
|
12 |
## Model Details
|
13 |
|
14 |
+
Base model (meta-llama/Llama-3.2-1B-Instruct) results:
|
15 |
+
|
16 |
|
|
|
17 |
|Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
18 |
|------|------:|------|-----:|-----------------------|---|-----:|---|------|
|
19 |
|ifeval| 4|none | 0|inst_level_loose_acc |↑ |0.6475|± | N/A|
|
|
|
23 |
|
24 |
|
25 |
|
26 |
+
Fine-tuned model (meta-llama/Llama-3.2-1B-Instruct using [mlabonne/orpo-dpo-mix-40k](https://huggingface.co/datasets/mlabonne/orpo-dpo-mix-40k)) results:
|
27 |
|
|
|
28 |
|Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
29 |
|------|------:|------|-----:|-----------------------|---|-----:|---|------|
|
30 |
+
|ifeval| 4|none | 0|inst_level_loose_acc |↑ |0.5132|± | N/A|
|
31 |
+
| | |none | 0|inst_level_strict_acc |↑ |0.4748|± | N/A|
|
32 |
+
| | |none | 0|prompt_level_loose_acc |↑ |0.3752|± |0.0208|
|
33 |
+
| | |none | 0|prompt_level_strict_acc|↑ |0.3327|± |0.0203|
|
34 |
|
35 |
### Model Description
|
36 |
|