Save VLLM model to local disk?
#29
by
narai
- opened
How do I save the model?
Save the model files to local and use vLLM to load your local path.
How do I save the model?
Save the model files to local and use vLLM to load your local path.