readme
Browse files
README.md
CHANGED
@@ -45,54 +45,8 @@ description: >-
|
|
45 |
duplicated_from: evaluate-metric/wer
|
46 |
---
|
47 |
|
48 |
-
#
|
49 |
|
50 |
## Metric description
|
51 |
-
Word error rate (WER) is a common metric of the performance of an automatic speech recognition (ASR) system.
|
52 |
|
53 |
-
|
54 |
-
|
55 |
-
This problem is solved by first aligning the recognized word sequence with the reference (spoken) word sequence using dynamic string alignment. Examination of this issue is seen through a theory called the power law that states the correlation between [perplexity](https://huggingface.co/metrics/perplexity) and word error rate (see [this article](https://www.cs.cmu.edu/~roni/papers/eval-metrics-bntuw-9802.pdf) for further information).
|
56 |
-
|
57 |
-
Word error rate can then be computed as:
|
58 |
-
|
59 |
-
`WER = (S + D + I) / N = (S + D + I) / (S + D + C)`
|
60 |
-
|
61 |
-
where
|
62 |
-
|
63 |
-
`S` is the number of substitutions,
|
64 |
-
|
65 |
-
`D` is the number of deletions,
|
66 |
-
|
67 |
-
`I` is the number of insertions,
|
68 |
-
|
69 |
-
`C` is the number of correct words,
|
70 |
-
|
71 |
-
`N` is the number of words in the reference (`N=S+D+C`).
|
72 |
-
|
73 |
-
|
74 |
-
## Citation
|
75 |
-
|
76 |
-
```bibtex
|
77 |
-
@inproceedings{woodard1982,
|
78 |
-
author = {Woodard, J.P. and Nelson, J.T.,
|
79 |
-
year = {1982},
|
80 |
-
journal = {Workshop on standardisation for speech I/O technology, Naval Air Development Center, Warminster, PA},
|
81 |
-
title = {An information theoretic measure of speech recognition performance}
|
82 |
-
}
|
83 |
-
```
|
84 |
-
|
85 |
-
```bibtex
|
86 |
-
@inproceedings{morris2004,
|
87 |
-
author = {Morris, Andrew and Maier, Viktoria and Green, Phil},
|
88 |
-
year = {2004},
|
89 |
-
month = {01},
|
90 |
-
pages = {},
|
91 |
-
title = {From WER and RIL to MER and WIL: improved evaluation measures for connected speech recognition.}
|
92 |
-
}
|
93 |
-
```
|
94 |
-
|
95 |
-
## Further References
|
96 |
-
|
97 |
-
- [Word Error Rate -- Wikipedia](https://en.wikipedia.org/wiki/Word_error_rate)
|
98 |
-
- [Hugging Face Tasks -- Automatic Speech Recognition](https://huggingface.co/tasks/automatic-speech-recognition)
|
|
|
45 |
duplicated_from: evaluate-metric/wer
|
46 |
---
|
47 |
|
48 |
+
# WER hmm
|
49 |
|
50 |
## Metric description
|
|
|
51 |
|
52 |
+
lorem ipsum
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|