1-800-BAD-CODE
commited on
Commit
·
26abccc
1
Parent(s):
33d9157
Update README.md
Browse files
README.md
CHANGED
@@ -63,7 +63,7 @@ and detects sentence boundaries (full stops) in 47 languages.
|
|
63 |
|
64 |
|
65 |
## Post-Punctuation Tokens
|
66 |
-
This model predicts the following set of
|
67 |
|
68 |
| Token | Description | Relevant Languages |
|
69 |
| ---: | :---------- | :----------- |
|
@@ -86,7 +86,7 @@ This model predicts the following set of "post" punctuation tokens:
|
|
86 |
|
87 |
|
88 |
## Pre-Punctuation Tokens
|
89 |
-
This model predicts the following set of
|
90 |
|
91 |
| Token | Description | Relevant Languages |
|
92 |
| ---: | :---------- | :----------- |
|
|
|
63 |
|
64 |
|
65 |
## Post-Punctuation Tokens
|
66 |
+
This model predicts the following set of punctuation tokens after each subtoken:
|
67 |
|
68 |
| Token | Description | Relevant Languages |
|
69 |
| ---: | :---------- | :----------- |
|
|
|
86 |
|
87 |
|
88 |
## Pre-Punctuation Tokens
|
89 |
+
This model predicts the following set of punctuation tokens before each subword:
|
90 |
|
91 |
| Token | Description | Relevant Languages |
|
92 |
| ---: | :---------- | :----------- |
|