File size: 284 Bytes
037d15b
 
4e12080
037d15b
 
 
 
618db5f
037d15b
 
618db5f
1
2
3
4
5
6
7
8
9
10
11
---
title: The Tokenizer Playground
emoji: 📝
colorFrom: indigo
colorTo: purple
sdk: static
pinned: false
short_description: Experiment with and compare different tokenizers
---

Link to source code: https://github.com/xenova/transformers.js/tree/main/examples/tokenizer-playground.