balochiml
/

balochi-tokenizer

Model card Files Files and versions Community

strickvl commited on Jun 3, 2023

Commit

27e62e8

·

1 Parent(s): e938b17

update README

Files changed (1) hide show

README.md +6 -2

README.md CHANGED Viewed

@@ -1,2 +1,6 @@
-# balochi-tokenizer
-A custom tokenizer for the Balochi language.

+# Balochi Tokenizers
+Custom tokenizers for the Balochi language.
+- 🤗 Tokenizer
+- Spacy Tokenizer (WIP)