Update README.md
Browse files
README.md
CHANGED
|
@@ -3,4 +3,13 @@ license: mit
|
|
| 3 |
language:
|
| 4 |
- zh
|
| 5 |
- en
|
| 6 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
language:
|
| 4 |
- zh
|
| 5 |
- en
|
| 6 |
+
---
|
| 7 |
+
|
| 8 |
+
We fine-tuned our ChemGPT2-QA-72B based on the Qwen2-72B-Instruct model. Our training data, ChemGPT-2.0-Data, has been open-sourced and is available at https://huggingface.co/datasets/ALmonster/ChemGPT-2.0-Data.
|
| 9 |
+
We evaluated our model on the three chemistry tasks of C-Eval and compared it with GPT-3.5 and GPT-4. The results are as follows:
|
| 10 |
+
|
| 11 |
+
| C-Eval | college_chemistry | high_school_chemistry | middle_school_chemistry | AVG |
|
| 12 |
+
|--------|-------------------|-----------------------|-------------------------|-----|
|
| 13 |
+
| GPT-3.5 | 0.397 | 0.529 | 0.714 | 0.54666667 |
|
| 14 |
+
| GPT4 | 0.594 | 0.558 | 0.811 | 0.65433333 |
|
| 15 |
+
| chemgpt| 0.71 | 0.936 | 0.995 | 0.88033333 |
|