QscQ commited on
Commit
49bc30d
·
verified ·
1 Parent(s): f8a8008

Update vllm_deployment_guide.md

Browse files
Files changed (1) hide show
  1. vllm_deployment_guide.md +3 -0
vllm_deployment_guide.md CHANGED
@@ -48,6 +48,9 @@ To ensure consistency and stability of the deployment environment, we recommend
48
  - If you are using a Docker image with vLLM version lower than the required version, you will need to:
49
  1. Update to the latest vLLM code
50
  2. Recompile vLLM from source. Follow the compilation instructions in Solution 2 of the Common Issues section
 
 
 
51
 
52
  1. Get the container image:
53
  ```bash
 
48
  - If you are using a Docker image with vLLM version lower than the required version, you will need to:
49
  1. Update to the latest vLLM code
50
  2. Recompile vLLM from source. Follow the compilation instructions in Solution 2 of the Common Issues section
51
+ - Special Note: For vLLM versions between 0.8.3 and 0.9.2, you need to modify the model configuration:
52
+ 1. Open `config.json`
53
+ 2. Change `config['architectures'] = ["MiniMaxM1ForCausalLM"]` to `config['architectures'] = ["MiniMaxText01ForCausalLM"]`
54
 
55
  1. Get the container image:
56
  ```bash