1-800-BAD-CODE
commited on
Commit
·
33d9157
1
Parent(s):
2d25caf
Update README.md
Browse files
README.md
CHANGED
@@ -65,7 +65,7 @@ and detects sentence boundaries (full stops) in 47 languages.
|
|
65 |
## Post-Punctuation Tokens
|
66 |
This model predicts the following set of "post" punctuation tokens:
|
67 |
|
68 |
-
| Token | Description |
|
69 |
| ---: | :---------- | :----------- |
|
70 |
| \<NULL\> | No punctuation | All |
|
71 |
| \<ACRONYM\> | Every character in this subword is followed by a period | Primarily English, some European |
|
@@ -88,8 +88,9 @@ This model predicts the following set of "post" punctuation tokens:
|
|
88 |
## Pre-Punctuation Tokens
|
89 |
This model predicts the following set of "post" punctuation tokens:
|
90 |
|
91 |
-
| Token | Description |
|
92 |
| ---: | :---------- | :----------- |
|
|
|
93 |
| ¿ | Inverted question mark | Spanish |
|
94 |
|
95 |
|
|
|
65 |
## Post-Punctuation Tokens
|
66 |
This model predicts the following set of "post" punctuation tokens:
|
67 |
|
68 |
+
| Token | Description | Relevant Languages |
|
69 |
| ---: | :---------- | :----------- |
|
70 |
| \<NULL\> | No punctuation | All |
|
71 |
| \<ACRONYM\> | Every character in this subword is followed by a period | Primarily English, some European |
|
|
|
88 |
## Pre-Punctuation Tokens
|
89 |
This model predicts the following set of "post" punctuation tokens:
|
90 |
|
91 |
+
| Token | Description | Relevant Languages |
|
92 |
| ---: | :---------- | :----------- |
|
93 |
+
| \<NULL\> | No punctuation | All |
|
94 |
| ¿ | Inverted question mark | Spanish |
|
95 |
|
96 |
|