Update vllm_deployment_guide.md
Browse files- vllm_deployment_guide.md +3 -0
vllm_deployment_guide.md
CHANGED
@@ -48,6 +48,9 @@ To ensure consistency and stability of the deployment environment, we recommend
|
|
48 |
- If you are using a Docker image with vLLM version lower than the required version, you will need to:
|
49 |
1. Update to the latest vLLM code
|
50 |
2. Recompile vLLM from source. Follow the compilation instructions in Solution 2 of the Common Issues section
|
|
|
|
|
|
|
51 |
|
52 |
1. Get the container image:
|
53 |
```bash
|
|
|
48 |
- If you are using a Docker image with vLLM version lower than the required version, you will need to:
|
49 |
1. Update to the latest vLLM code
|
50 |
2. Recompile vLLM from source. Follow the compilation instructions in Solution 2 of the Common Issues section
|
51 |
+
- Special Note: For vLLM versions between 0.8.3 and 0.9.2, you need to modify the model configuration:
|
52 |
+
1. Open `config.json`
|
53 |
+
2. Change `config['architectures'] = ["MiniMaxM1ForCausalLM"]` to `config['architectures'] = ["MiniMaxText01ForCausalLM"]`
|
54 |
|
55 |
1. Get the container image:
|
56 |
```bash
|