nayohan commited on
Commit
a11436d
·
verified ·
1 Parent(s): dd2c0e6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -1
README.md CHANGED
@@ -126,6 +126,13 @@ predict_score = extract_score(output_text)
126
  print(predict_score) # 1
127
  ```
128
 
 
 
 
 
 
 
 
129
  ### **Citation**
130
  ```bibtex
131
  @misc{kim2023prometheus,
@@ -137,4 +144,4 @@ print(predict_score) # 1
137
  primaryClass={cs.CL}
138
  }
139
  ```
140
- Our trainig code can be found here: [TBD]
 
126
  print(predict_score) # 1
127
  ```
128
 
129
+ ### **Heatmap Visualize**
130
+ We randomly sampled 200 sentences from the training data, extracted scores from the model-generated sentences, and compared them to the correct answers.
131
+ The training and test datasets are not separated, so we can only see how well the model learned.
132
+ - prometheus-7b-v1.0 (english train-> english inference) # 3 failed to output a score, total 197
133
+ - llama3-8b-it-prometheus-ko (korean train-> korean inference) # total 200
134
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6152b4b9ecf3ca6ab820e325/ssZRGTysyiOZD4ttNOD4s.png)
135
+
136
  ### **Citation**
137
  ```bibtex
138
  @misc{kim2023prometheus,
 
144
  primaryClass={cs.CL}
145
  }
146
  ```
147
+ Our trainig code can be found here: [TBD]