amphora commited on
Commit
2691a4a
·
verified ·
1 Parent(s): a762b98

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -3
README.md CHANGED
@@ -1,10 +1,27 @@
1
  ---
2
  title: README
3
- emoji: 🐠
4
  colorFrom: indigo
5
- colorTo: indigo
6
  sdk: static
7
  pinned: false
8
  ---
9
 
10
- # HAERAE (해례)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  title: README
3
+ emoji: 🔥
4
  colorFrom: indigo
5
+ colorTo: blue
6
  sdk: static
7
  pinned: false
8
  ---
9
 
10
+ # Welcome to HAERAE
11
+
12
+
13
+ We are a non-profit research lab focused on the interpretability and evaluation of Korean language models. Our mission is to advance the field with insightful benchmarks and tools. Below is an overview of our grouped projects and resources.
14
+
15
+ ## Evaluation Benchmarks
16
+ - **HAE_RAE_BENCH Series**:
17
+ - [HAE_RAE_BENCH_1.0](https://huggingface.co/datasets/HAERAE-HUB/HAE_RAE_BENCH_1.0): An evaluation suite for Korean knowledge. See [paper](https://arxiv.org/abs/2309.02706) for further information.
18
+ - [HAE_RAE_BENCH_1.1](https://huggingface.co/datasets/HAERAE-HUB/HAE_RAE_BENCH_1.1): An ongoing project to refine the HAE_RAE_BENCH 1.0, enhancing its depth and coverage.
19
+
20
+ - **KMMLU**:
21
+ - [KMMLU](https://huggingface.co/datasets/HAERAE-HUB/KMMLU): A Korean reimplementation of MMLU, focusing on comprehensive language understanding across a wide range of subjects. See [paper](https://arxiv.org/abs/2402.11548) for further information.
22
+ - [KMMLU-HARD](https://huggingface.co/datasets/HAERAE-HUB/KMMLU-HARD): A subset of KMMLU, with CoT samples.
23
+
24
+ ## Bias and Fairness
25
+ - [QARV](https://huggingface.co/datasets/HAERAE-HUB/QARV-preview) : An ongoing project aiming to benchmark and mitigate regional bias in Large Language Models (LLMs), enhancing fairness in language understanding. (More information to be added)
26
+
27
+ If you have any inquiries or are interested in joining our team, please contact me at `[email protected]`.