Update README.md
Browse files
README.md
CHANGED
@@ -318,6 +318,8 @@ Download sharegpt dataset: `wget https://huggingface.co/datasets/anon8231489123/
|
|
318 |
|
319 |
Other datasets can be found in: https://github.com/vllm-project/vllm/tree/main/benchmarks
|
320 |
|
|
|
|
|
321 |
### baseline
|
322 |
Server:
|
323 |
```Shell
|
|
|
318 |
|
319 |
Other datasets can be found in: https://github.com/vllm-project/vllm/tree/main/benchmarks
|
320 |
|
321 |
+
Note: you can change the number of prompts to be benchmarked with `--num-prompts` argument for `benchmark_serving` script.
|
322 |
+
|
323 |
### baseline
|
324 |
Server:
|
325 |
```Shell
|