This is a tokenizer only, with the following modification:

  • Replaced [unused0], [unused1], [unused2] with [ES], [DE], [FR] respectively in the vocabulary
  • Added [ES], [DE], [FR] as special tokens and therefore they won't lowercased or splitted
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support