Spaces:
Sleeping
Sleeping
Oskar van der Wal
commited on
Commit
•
e03dc2a
1
Parent(s):
b2e49d6
Update notice.md
Browse files
notice.md
CHANGED
@@ -1,3 +1,6 @@
|
|
1 |
-
#
|
2 |
-
|
3 |
-
|
|
|
|
|
|
|
|
1 |
+
# Measuring bias in language models is hard!
|
2 |
+
How to measure bias in language models is not trivial and still an active area of research.
|
3 |
+
First of all, what is bias? As you may have noticed, stereotypes may change across languages and cultures.
|
4 |
+
What is problematic in the USA, may not be relevant in the Netherlands---each cultural context requires its own careful evaluation.
|
5 |
+
Furthermore, defining good ways to measure it is also difficult.
|
6 |
+
For example, [Blodgett et al. (2021)](https://aclanthology.org/2021.acl-long.81/) find that typos, nonsensical examples, and other mistakes threatens the validity of CrowS-Pairs.
|