Limerobot commited on
Commit
345cbf8
1 Parent(s): 6e27838

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -14,6 +14,23 @@ We developed the Depth Up-Scaling technique. Built on the Llama2 architecture, S
14
  Depth-Upscaled SOLAR-10.7B has remarkable performance. It outperforms models with up to 30B parameters, even surpassing the recent Mixtral 8X7B model. For detailed information, please refer to the experimental table ([link to be updated soon]).
15
  Solar 10.7B is an ideal choice for fine-tuning. SOLAR-10.7B offers robustness and adaptability for your fine-tuning needs. Our simple instruction fine-tuning using the SOLAR-10.7B pre-trained model yields significant performance improvements. [[link to be updated soon]]
16
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
17
 
18
  # **Usage Instructions**
19
 
 
14
  Depth-Upscaled SOLAR-10.7B has remarkable performance. It outperforms models with up to 30B parameters, even surpassing the recent Mixtral 8X7B model. For detailed information, please refer to the experimental table ([link to be updated soon]).
15
  Solar 10.7B is an ideal choice for fine-tuning. SOLAR-10.7B offers robustness and adaptability for your fine-tuning needs. Our simple instruction fine-tuning using the SOLAR-10.7B pre-trained model yields significant performance improvements. [[link to be updated soon]]
16
 
17
+ # **Evaluation Results**
18
+ | Model | H6 | Model Size |
19
+ |----------------------------------------|-------|------------|
20
+ | **SOLAR-10.7B-Instruct-v1.0** | **74.20** | **~ 11B** |
21
+ | mistralai/Mixtral-8x7B-Instruct-v0.1 | 72.62 | ~ 46.7B |
22
+ | 01-ai/Yi-34B-200K | 70.81 | ~ 34B |
23
+ | 01-ai/Yi-34B | 69.42 | ~ 34B |
24
+ | mistralai/Mixtral-8x7B-v0.1 | 68.42 | ~ 46.7B |
25
+ | meta-llama/Llama-2-70b-hf | 67.87 | ~ 70B |
26
+ | tiiuae/falcon-180B | 67.85 | ~ 180B |
27
+ | **SOLAR-10.7B-v1.0** | **66.04** | **~11B** |
28
+ | mistralai/Mistral-7B-Instruct-v0.2 | 65.71 | ~ 7B |
29
+ | Qwen/Qwen-14B | 65.86 | ~ 14B |
30
+ | 01-ai/Yi-34B-Chat | 65.32 | ~34B |
31
+ | meta-llama/Llama-2-70b-chat-hf | 62.4 | ~ 70B |
32
+ | mistralai/Mistral-7B-v0.1 | 60.97 | ~ 7B |
33
+ | mistralai/Mistral-7B-Instruct-v0.1 | 54.96 | ~ 7B |
34
 
35
  # **Usage Instructions**
36