Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
@@ -1,10 +1,27 @@
|
|
1 |
---
|
2 |
title: README
|
3 |
-
emoji:
|
4 |
colorFrom: indigo
|
5 |
-
colorTo:
|
6 |
sdk: static
|
7 |
pinned: false
|
8 |
---
|
9 |
|
10 |
-
# HAERAE
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
title: README
|
3 |
+
emoji: 🔥
|
4 |
colorFrom: indigo
|
5 |
+
colorTo: blue
|
6 |
sdk: static
|
7 |
pinned: false
|
8 |
---
|
9 |
|
10 |
+
# Welcome to HAERAE
|
11 |
+
|
12 |
+
|
13 |
+
We are a non-profit research lab focused on the interpretability and evaluation of Korean language models. Our mission is to advance the field with insightful benchmarks and tools. Below is an overview of our grouped projects and resources.
|
14 |
+
|
15 |
+
## Evaluation Benchmarks
|
16 |
+
- **HAE_RAE_BENCH Series**:
|
17 |
+
- [HAE_RAE_BENCH_1.0](https://huggingface.co/datasets/HAERAE-HUB/HAE_RAE_BENCH_1.0): An evaluation suite for Korean knowledge. See [paper](https://arxiv.org/abs/2309.02706) for further information.
|
18 |
+
- [HAE_RAE_BENCH_1.1](https://huggingface.co/datasets/HAERAE-HUB/HAE_RAE_BENCH_1.1): An ongoing project to refine the HAE_RAE_BENCH 1.0, enhancing its depth and coverage.
|
19 |
+
|
20 |
+
- **KMMLU**:
|
21 |
+
- [KMMLU](https://huggingface.co/datasets/HAERAE-HUB/KMMLU): A Korean reimplementation of MMLU, focusing on comprehensive language understanding across a wide range of subjects. See [paper](https://arxiv.org/abs/2402.11548) for further information.
|
22 |
+
- [KMMLU-HARD](https://huggingface.co/datasets/HAERAE-HUB/KMMLU-HARD): A subset of KMMLU, with CoT samples.
|
23 |
+
|
24 |
+
## Bias and Fairness
|
25 |
+
- [QARV](https://huggingface.co/datasets/HAERAE-HUB/QARV-preview) : An ongoing project aiming to benchmark and mitigate regional bias in Large Language Models (LLMs), enhancing fairness in language understanding. (More information to be added)
|
26 |
+
|
27 |
+
If you have any inquiries or are interested in joining our team, please contact me at `[email protected]`.
|