Update README.md
Browse files
README.md
CHANGED
@@ -80,7 +80,8 @@ print("Response:", output_text[0][len(prompt):])
|
|
80 |
```
|
81 |
|
82 |
# Serving with vllm
|
83 |
-
|
|
|
84 |
```
|
85 |
pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
|
86 |
```
|
|
|
80 |
```
|
81 |
|
82 |
# Serving with vllm
|
83 |
+
|
84 |
+
Need to install vllm nightly to get some recent changes:
|
85 |
```
|
86 |
pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
|
87 |
```
|