No support on vllm/lmdeploy
#1
by
solankibhargav
- opened
I wanted to try this model on vllm and/or lmdeploy and seems like its not supported currently. I also upgraded transformers to the latest version.Are there any plans to support this model for any faster inference engine except transformers?