rednote-hilab
/

dots.llm1.inst-FP8-dynamic

Text Generation

compressed-tensors

Model card Files Files and versions Community

redmoe-ai-v1 commited on Jun 24

Commit

7b07257

·

verified ·

1 Parent(s): 00a40af

Upload folder using huggingface_hub

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -70,7 +70,7 @@ We release the quantized `dots.llm1.inst.FP8-dynamic` model, which retains appro
 ### Docker (vllm)
-For convenience, we recommend running vLLM inference using our Docker image `rednote-hilab/vllm-openai-v0.9.1`, , which is available on [Docker Hub](https://hub.docker.com/repository/docker/rednotehilab/dots1/tags).
 ```bash
 python3 -m vllm.entrypoints.openai.api_server \

 ### Docker (vllm)
+For convenience, we recommend running vLLM inference using our Docker image `rednotehilab/dots1:vllm-openai-v0.9.1`, , which is available on [Docker Hub](https://hub.docker.com/repository/docker/rednotehilab/dots1/tags).
 ```bash
 python3 -m vllm.entrypoints.openai.api_server \