Update README.md
Browse files
README.md
CHANGED
|
@@ -132,6 +132,19 @@ Use the code below to get started with the model.
|
|
| 132 |
|
| 133 |
### Results
|
| 134 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 135 |
| | EN | | | | |
|
| 136 |
|--------------------------|-----------|-------|-------|---------|----------|
|
| 137 |
| Model | MedQA-4op | MedQA | MMLU | MedMCQA | PubMedQA |
|
|
|
|
| 132 |
|
| 133 |
### Results
|
| 134 |
|
| 135 |
+
|
| 136 |
+
| dataset | EN MMLU | EN MedMCQA | EN MedQA | EN MedQA-4op | EN PubMedQA | EN Avg | JA DenQA | JA IgakuQA | JA JJSIMQA | JA Avg | ZH CMExam | ZH MedQA | ZH MedQA-4op | ZH Avg |
|
| 137 |
+
|---------------------------------------|---------|------------|----------|--------------|-------------|--------|----------|------------|------------|--------|-----------|----------|--------------|--------|
|
| 138 |
+
| google_gemma-7b | 63.65 | 49.81 | 43.38 | 48.82 | 71.52 | 55.44 | 18.60 | 29.02 | 18.90 | 22.17 | 36.34 | 40.54 | 43.03 | 39.97 |
|
| 139 |
+
| meta-llama_Llama-2-7b-hf | 45.02 | 36.84 | 30.13 | 36.59 | 49.90 | 39.70 | 10.63 | 17.64 | 8.13 | 12.13 | 24.33 | 25.02 | 29.61 | 26.32 |
|
| 140 |
+
| meta-llama_Meta-Llama-3-8B | 71.22 | 56.97 | 52.60 | 57.89 | 69.70 | 61.68 | 18.88 | 35.09 | 23.52 | 25.83 | 40.30 | 44.96 | 51.15 | 45.47 |
|
| 141 |
+
| tokyotech-llm_Llama-3-Swallow-8B-v0.1 | 65.96 | 51.27 | 45.90 | 52.92 | 61.01 | 55.41 | 22.24 | 42.21 | 27.25 | 30.57 | 36.19 | 40.89 | 48.00 | 41.69 |
|
| 142 |
+
| kenyano_ELAINE-medLLM | 67.80 | 54.55 | 50.47 | 57.73 | 67.27 | 59.56 | 22.38 | 44.06 | 29.45 | 31.96 | 46.03 | 52.50 | 58.23 | 52.25 |
|
| 143 |
+
|
| 144 |
+
|
| 145 |
+
|
| 146 |
+
|
| 147 |
+
|
| 148 |
| | EN | | | | |
|
| 149 |
|--------------------------|-----------|-------|-------|---------|----------|
|
| 150 |
| Model | MedQA-4op | MedQA | MMLU | MedMCQA | PubMedQA |
|