update README
Browse files- distinct.py +3 -1
distinct.py
CHANGED
@@ -51,9 +51,11 @@ _CITATION = """\
|
|
51 |
|
52 |
|
53 |
_DESCRIPTION = """\
|
54 |
-
Distinct metric is to calculate corpus-level diversity of language. We provide two versions of distinct score. Expectation-Adjusted-Distinct is the default one, which removes
|
55 |
the biases of the original distinct score on lengthier sentences. Distinct is the original version.
|
56 |
|
|
|
|
|
57 |
For the use of Expectation-Adjusted-Distinct, vocab_size is required.
|
58 |
|
59 |
Please follow ACL paper https://aclanthology.org/2022.acl-short.86 for motivation and follow the rules of thumb provided by https://github.com/lsy641/Expectation-Adjusted-Distinct/blob/main/EAD.ipynb to determine the vocab_size
|
|
|
51 |
|
52 |
|
53 |
_DESCRIPTION = """\
|
54 |
+
Distinct metric is to calculate corpus-level diversity of language. We provide two versions of distinct score. Expectation-Adjusted-Distinct (EAD) is the default one, which removes
|
55 |
the biases of the original distinct score on lengthier sentences. Distinct is the original version.
|
56 |
|
57 |
+

|
58 |
+
|
59 |
For the use of Expectation-Adjusted-Distinct, vocab_size is required.
|
60 |
|
61 |
Please follow ACL paper https://aclanthology.org/2022.acl-short.86 for motivation and follow the rules of thumb provided by https://github.com/lsy641/Expectation-Adjusted-Distinct/blob/main/EAD.ipynb to determine the vocab_size
|