Update README.md
Browse files
README.md
CHANGED
@@ -213,16 +213,17 @@ def moderate(instruction, response):
|
|
213 |
- [heegyu/PKU-SafeRLHF-ko](https://huggingface.co/datasets/heegyu/PKU-SafeRLHF-ko)
|
214 |
- [MrBananaHuman/kor_ethical_question_answer](https://huggingface.co/datasets/MrBananaHuman/kor_ethical_question_answer)
|
215 |
|
216 |
-
| **Dataset**
|
217 |
-
|
218 |
-
|
|
219 |
-
| kor-ethical-qa
|
220 |
-
| kor-ethical-qa
|
221 |
-
| kor-ethical-qa
|
222 |
-
|
|
223 |
-
|
|
224 |
-
| pku-safe-rlhf
|
225 |
-
| pku-safe-rlhf
|
226 |
-
|
227 |
-
|
228 |
-
|
|
|
|
213 |
- [heegyu/PKU-SafeRLHF-ko](https://huggingface.co/datasets/heegyu/PKU-SafeRLHF-ko)
|
214 |
- [MrBananaHuman/kor_ethical_question_answer](https://huggingface.co/datasets/MrBananaHuman/kor_ethical_question_answer)
|
215 |
|
216 |
+
| **Dataset** | **Training Steps** | **Accuracy** | **F1 Score** | **Precision** | **Recall** |
|
217 |
+
|-------------------|--------------------|--------------|--------------|---------------|--------------|
|
218 |
+
| OpenAI Moderation | - | 0.5 | 0.07 | 0.76 | 0.04 |
|
219 |
+
| kor-ethical-qa | **142947 (main)** | **0.944** | **0.942029** | 0.976395 | **0.91** |
|
220 |
+
| kor-ethical-qa | 285894 | 0.888 | 0.874157 | 0.997436 | 0.778 |
|
221 |
+
| kor-ethical-qa | 428841 | 0.907 | 0.898361 | 0.990361 | 0.822 |
|
222 |
+
| kor-ethical-qa | 571788 | 0.751 | 0.668442 | **1** | 0.502 |
|
223 |
+
| OpenAI Moderation | - | 0.5 | 0.07 | 0.76 | 0.04 |
|
224 |
+
| pku-safe-rlhf | **142947 (main)** | 0.833 | 0.841706 | 0.825279 | **0.858801** |
|
225 |
+
| pku-safe-rlhf | 285894 | 0.845 | 0.837356 | **0.915138** | 0.77176 |
|
226 |
+
| pku-safe-rlhf | 428841 | **0.848** | **0.849206** | 0.87169 | 0.827853 |
|
227 |
+
| pku-safe-rlhf | 571788 | 0.798 | 0.773543 | 0.92 | 0.667311 |
|
228 |
+
|
229 |
+
OpenAI Moderation API๋ ํ๊ธ์ ๋ฏธ์ง์ํ๋์ง ๋๋ถ๋ถ safeํ๋ค๊ณ ํ๋ณ์ ํฉ๋๋ค. 0.25์ํญ ๋จ์๋ก ํ๊ฐ ๋ฐ ์ ์ฅํ์ผ๋ฉฐ, ๊ฐ ํ์ต ์คํ
๋ณ๋ก revision์ ๋ชจ๋ธ์ด ์ ์ฅ๋์ด ์์ต๋๋ค. ์ฌ๋ฌ ์งํ๋ฅผ ๊ณ ๋ คํด์, 142947 steps๋ฅผ main์ผ๋ก ์ ์ ํ์ต๋๋ค.
|