Fast tokenizer, general VLLM support
#5
by
getfit
- opened
Is this being working on ? I did not see any PRs for transformers
yes, transformers support is in progress, hope we can submit the the PR within next week
vLLM support is in this PR:https://github.com/vllm-project/vllm/pull/20114/files
about the faster tokenizer, could give some example on this items (some link inside of transformers lib ?)