update README
Browse files
README.md
CHANGED
@@ -17,7 +17,7 @@ pinned: false
|
|
17 |
***Module Card Instructions:***
|
18 |
|
19 |
## Measurement Description
|
20 |
-
This metric is used to calculate the diversity of a group of sentences. It can be used to evaluate the diversity of generated responses
|
21 |
|
22 |
## How to Use
|
23 |
|
|
|
17 |
***Module Card Instructions:***
|
18 |
|
19 |
## Measurement Description
|
20 |
+
This metric is used to calculate the diversity of a group of sentences. It can be used to either evaluate the diversity of generated responses of the testset (i.e., corpus level diversity), or calculate diversity of a group of sampled responses given one context (i.e., utterence level diversity). The [original paper](https://aclanthology.org/N16-1014) (Li et al. 2022) used it as corpus-level while some may use it as utterance-level. However, we don't recommend to calculate Distinct on a small group as it is sensitive to the sentence length and number.
|
21 |
|
22 |
## How to Use
|
23 |
|