silait's picture
Upload 34 files
c0cb02e verified

tokenizers-wasm

Bindings of huggingface tokenizers for web assembly.

  • in development
  • unstable
  • potentially non-compliant with huggingface/tokenizers

try the example out !