dalmeow commited on
Commit
abbe4df
·
1 Parent(s): 3c52f26
Files changed (1) hide show
  1. README.md +2 -48
README.md CHANGED
@@ -45,54 +45,8 @@ description: >-
45
  duplicated_from: evaluate-metric/wer
46
  ---
47
 
48
- # Metric Card for WER
49
 
50
  ## Metric description
51
- Word error rate (WER) is a common metric of the performance of an automatic speech recognition (ASR) system.
52
 
53
- The general difficulty of measuring the performance of ASR systems lies in the fact that the recognized word sequence can have a different length from the reference word sequence (supposedly the correct one). The WER is derived from the [Levenshtein distance](https://en.wikipedia.org/wiki/Levenshtein_distance), working at the word level.
54
-
55
- This problem is solved by first aligning the recognized word sequence with the reference (spoken) word sequence using dynamic string alignment. Examination of this issue is seen through a theory called the power law that states the correlation between [perplexity](https://huggingface.co/metrics/perplexity) and word error rate (see [this article](https://www.cs.cmu.edu/~roni/papers/eval-metrics-bntuw-9802.pdf) for further information).
56
-
57
- Word error rate can then be computed as:
58
-
59
- `WER = (S + D + I) / N = (S + D + I) / (S + D + C)`
60
-
61
- where
62
-
63
- `S` is the number of substitutions,
64
-
65
- `D` is the number of deletions,
66
-
67
- `I` is the number of insertions,
68
-
69
- `C` is the number of correct words,
70
-
71
- `N` is the number of words in the reference (`N=S+D+C`).
72
-
73
-
74
- ## Citation
75
-
76
- ```bibtex
77
- @inproceedings{woodard1982,
78
- author = {Woodard, J.P. and Nelson, J.T.,
79
- year = {1982},
80
- journal = {Workshop on standardisation for speech I/O technology, Naval Air Development Center, Warminster, PA},
81
- title = {An information theoretic measure of speech recognition performance}
82
- }
83
- ```
84
-
85
- ```bibtex
86
- @inproceedings{morris2004,
87
- author = {Morris, Andrew and Maier, Viktoria and Green, Phil},
88
- year = {2004},
89
- month = {01},
90
- pages = {},
91
- title = {From WER and RIL to MER and WIL: improved evaluation measures for connected speech recognition.}
92
- }
93
- ```
94
-
95
- ## Further References
96
-
97
- - [Word Error Rate -- Wikipedia](https://en.wikipedia.org/wiki/Word_error_rate)
98
- - [Hugging Face Tasks -- Automatic Speech Recognition](https://huggingface.co/tasks/automatic-speech-recognition)
 
45
  duplicated_from: evaluate-metric/wer
46
  ---
47
 
48
+ # WER hmm
49
 
50
  ## Metric description
 
51
 
52
+ lorem ipsum