distinct
Browse files- distinct.py +3 -1
distinct.py
CHANGED
@@ -54,7 +54,9 @@ _DESCRIPTION = """\
|
|
54 |
Distinct metric is to calculate corpus-level diversity of language. We provide two versions of distinct score. Expectation-Adjusted-Distinct (EAD) is the default one, which removes
|
55 |
the biases of the original distinct score on lengthier sentences. Distinct is the original version.
|
56 |
|
57 |
-

|
|
|
|
|
58 |
|
59 |
For the use of Expectation-Adjusted-Distinct, vocab_size is required.
|
60 |
|
|
|
54 |
Distinct metric is to calculate corpus-level diversity of language. We provide two versions of distinct score. Expectation-Adjusted-Distinct (EAD) is the default one, which removes
|
55 |
the biases of the original distinct score on lengthier sentences. Distinct is the original version.
|
56 |
|
57 |
+
# 
|
58 |
+
<img src="https://huggingface.co/spaces/lsy641/distinct/resolve/main/distinct_compare_pic.jpg" alt="drawing" width="200"/>
|
59 |
+
img[alt=drawing]{width: 200px;}
|
60 |
|
61 |
For the use of Expectation-Adjusted-Distinct, vocab_size is required.
|
62 |
|