clearloop
/

tokenizer

Model card Files Files and versions Community

tokenizer / gemma2 /README.md

clearloop's picture

feat(gemma2): add gemma2 tokenizer

04dabc7 3 months ago

|

history blame contribute delete

143 Bytes

	The `tokenizer.json` here is extracted from [google/gemma-2-2b-it](https://huggingface.co/google/gemma-2-2b-it/tree/main).

	## LICENSE

	gemma2