clearloop
/

tokenizer

Model card Files Files and versions Community

tokenizer / gemma2 /README.md

clearloop's picture

feat(gemma2): add gemma2 tokenizer

04dabc7 3 months ago

|

history blame contribute delete

143 Bytes

The tokenizer.json here is extracted from google/gemma-2-2b-it.

LICENSE

gemma2