balochiml
/

balochi-tokenizer

Model card Files Files and versions Community

balochi-tokenizer / README.md

strickvl's picture

update README

b0493e1 over 1 year ago

|

history blame contribute delete

186 Bytes

	---
	language:
	- bal
	tags:
	- balochi
	- tokenizer
	license: "apache-2.0"
	---

	# Balochi Tokenizers

	Custom tokenizers for the Balochi language.

	- 🤗 Tokenizer
	- Spacy Tokenizer (WIP)