Added vllm run commands
#8
by
dsarfati
- opened
Added an example of using vllm in a basic configuration as well as the advanced configuration with ngram spec dec.
as-cii
changed pull request status to
merged