model card
Browse files
README.md
CHANGED
@@ -160,6 +160,19 @@ Fireplace is built on top of Llama 3 70b Instruct, the highest performance open-
|
|
160 |
|
161 |
This version of Fireplace uses the [glaiveai/glaive-function-calling-v2](https://huggingface.co/datasets/glaiveai/glaive-function-calling-v2) dataset converted to Llama 3 Instruct format.
|
162 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
163 |
|
164 |
|
165 |
![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/63444f2687964b331809eb55/VCJ8Fmefd8cdVhXSSxJiD.jpeg)
|
@@ -175,16 +188,3 @@ We care about open source.
|
|
175 |
For everyone to use.
|
176 |
|
177 |
We encourage others to finetune further from our models.
|
178 |
-
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
|
179 |
-
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_ValiantLabs__Llama3-70B-Fireplace)
|
180 |
-
|
181 |
-
| Metric |Value|
|
182 |
-
|-------------------|----:|
|
183 |
-
|Avg. |36.82|
|
184 |
-
|IFEval (0-Shot) |77.74|
|
185 |
-
|BBH (3-Shot) |49.56|
|
186 |
-
|MATH Lvl 5 (4-Shot)|19.64|
|
187 |
-
|GPQA (0-shot) |13.98|
|
188 |
-
|MuSR (0-shot) |16.77|
|
189 |
-
|MMLU-PRO (5-shot) |43.25|
|
190 |
-
|
|
|
160 |
|
161 |
This version of Fireplace uses the [glaiveai/glaive-function-calling-v2](https://huggingface.co/datasets/glaiveai/glaive-function-calling-v2) dataset converted to Llama 3 Instruct format.
|
162 |
|
163 |
+
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
|
164 |
+
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_ValiantLabs__Llama3-70B-Fireplace)
|
165 |
+
|
166 |
+
| Metric |Value|
|
167 |
+
|-------------------|----:|
|
168 |
+
|Avg. |36.82|
|
169 |
+
|IFEval (0-Shot) |77.74|
|
170 |
+
|BBH (3-Shot) |49.56|
|
171 |
+
|MATH Lvl 5 (4-Shot)|19.64|
|
172 |
+
|GPQA (0-shot) |13.98|
|
173 |
+
|MuSR (0-shot) |16.77|
|
174 |
+
|MMLU-PRO (5-shot) |43.25|
|
175 |
+
|
176 |
|
177 |
|
178 |
![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/63444f2687964b331809eb55/VCJ8Fmefd8cdVhXSSxJiD.jpeg)
|
|
|
188 |
For everyone to use.
|
189 |
|
190 |
We encourage others to finetune further from our models.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|