catid commited on
Commit
183796f
·
verified ·
1 Parent(s): d474064

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -12,5 +12,5 @@ conda create -n vllm70 python=3.10 -y && conda activate vllm70
12
 
13
  pip install -U git+https://github.com/vllm-project/vllm.git
14
 
15
- python -m vllm.entrypoints.openai.api_server --model cat-llama-3-70b-awq-q128-w4-gemm --tensor-parallel-size 2 --gpu-memory-utilization 0.95 --space-space 1
16
  ```
 
12
 
13
  pip install -U git+https://github.com/vllm-project/vllm.git
14
 
15
+ python -m vllm.entrypoints.openai.api_server --model cat-llama-3-70b-awq-q128-w4-gemm --tensor-parallel-size 2 --gpu-memory-utilization 0.935
16
  ```