jerryzh168 commited on
Commit
d0f0e1e
·
verified ·
1 Parent(s): 4ba6889

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -318,6 +318,8 @@ Download sharegpt dataset: `wget https://huggingface.co/datasets/anon8231489123/
318
 
319
  Other datasets can be found in: https://github.com/vllm-project/vllm/tree/main/benchmarks
320
 
 
 
321
  ### baseline
322
  Server:
323
  ```Shell
 
318
 
319
  Other datasets can be found in: https://github.com/vllm-project/vllm/tree/main/benchmarks
320
 
321
+ Note: you can change the number of prompts to be benchmarked with `--num-prompts` argument for `benchmark_serving` script.
322
+
323
  ### baseline
324
  Server:
325
  ```Shell