Hugging Face's logo

olinguyen
/
Llama-3.2-1B-Instruct-orpo

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community
olinguyen commited on
Commit
13a07b6
·
verified ·
1 Parent(s): 0ba3525

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -0
README.md CHANGED
@@ -11,6 +11,28 @@ tags: []
11
 
12
  ## Model Details
13
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
  ### Model Description
15
 
16
  <!-- Provide a longer summary of what this model is. -->
 
11
 
12
  ## Model Details
13
 
14
+ Base model results:
15
+
16
+ model=meta-llama/Llama-3.2-1B-Instruct
17
+ |Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
18
+ |------|------:|------|-----:|-----------------------|---|-----:|---|------|
19
+ |ifeval| 4|none | 0|inst_level_loose_acc |↑ |0.6475|± | N/A|
20
+ | | |none | 0|inst_level_strict_acc |↑ |0.4856|± | N/A|
21
+ | | |none | 0|prompt_level_loose_acc |↑ |0.5342|± |0.0215|
22
+ | | |none | 0|prompt_level_strict_acc|↑ |0.3549|± |0.0206|
23
+
24
+
25
+
26
+ Fine-tuned model results:
27
+
28
+ model=meta-llama/Llama-3.2-1B-Instruct
29
+ |Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
30
+ |------|------:|------|-----:|-----------------------|---|-----:|---|------|
31
+ |ifeval| 4|none | 0|inst_level_loose_acc |↑ |0.6475|± | N/A|
32
+ | | |none | 0|inst_level_strict_acc |↑ |0.4856|± | N/A|
33
+ | | |none | 0|prompt_level_loose_acc |↑ |0.5342|± |0.0215|
34
+ | | |none | 0|prompt_level_strict_acc|↑ |0.3549|± |0.0206|
35
+
36
  ### Model Description
37
 
38
  <!-- Provide a longer summary of what this model is. -->