Can I not use vllm but transformers to load the model?
Hi @zhilinw6 , yes you can use it via transformers as well
· Sign up or log in to comment
