Update README.md
Browse files
README.md
CHANGED
@@ -126,6 +126,13 @@ predict_score = extract_score(output_text)
|
|
126 |
print(predict_score) # 1
|
127 |
```
|
128 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
129 |
### **Citation**
|
130 |
```bibtex
|
131 |
@misc{kim2023prometheus,
|
@@ -137,4 +144,4 @@ print(predict_score) # 1
|
|
137 |
primaryClass={cs.CL}
|
138 |
}
|
139 |
```
|
140 |
-
Our trainig code can be found here: [TBD]
|
|
|
126 |
print(predict_score) # 1
|
127 |
```
|
128 |
|
129 |
+
### **Heatmap Visualize**
|
130 |
+
We randomly sampled 200 sentences from the training data, extracted scores from the model-generated sentences, and compared them to the correct answers.
|
131 |
+
The training and test datasets are not separated, so we can only see how well the model learned.
|
132 |
+
- prometheus-7b-v1.0 (english train-> english inference) # 3 failed to output a score, total 197
|
133 |
+
- llama3-8b-it-prometheus-ko (korean train-> korean inference) # total 200
|
134 |
+

|
135 |
+
|
136 |
### **Citation**
|
137 |
```bibtex
|
138 |
@misc{kim2023prometheus,
|
|
|
144 |
primaryClass={cs.CL}
|
145 |
}
|
146 |
```
|
147 |
+
Our trainig code can be found here: [TBD]
|