Hugging Face's logo

second-state
/
Qwen1.5-7B-Chat-GGUF

Text Generation
Transformers
GGUF
English
qwen2
chat
Inference Endpoints
conversational
Model card Files Community
Xin Liu commited on
Commit
7791765
·
1 Parent(s): d777502

Update

Browse files

Signed-off-by: Xin Liu <[email protected]>

Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -49,13 +49,13 @@ tags:
49
  - Run as LlamaEdge service
50
 
51
  ```bash
52
- wasmedge --dir .:. --nn-preload default:GGML:AUTO:Qwen1.5-7B-Chat-Q5_K_M.gguf.gguf llama-api-server.wasm -p chatml
53
  ```
54
 
55
  - Run as LlamaEdge command app
56
 
57
  ```bash
58
- wasmedge --dir .:. --nn-preload default:GGML:AUTO:Qwen1.5-7B-Chat-Q5_K_M.gguf.gguf llama-chat.wasm -p chatml
59
  ```
60
 
61
  ## Quantized GGUF Models
 
49
  - Run as LlamaEdge service
50
 
51
  ```bash
52
+ wasmedge --dir .:. --nn-preload default:GGML:AUTO:Qwen1.5-7B-Chat-Q5_K_M.gguf llama-api-server.wasm -p chatml
53
  ```
54
 
55
  - Run as LlamaEdge command app
56
 
57
  ```bash
58
+ wasmedge --dir .:. --nn-preload default:GGML:AUTO:Qwen1.5-7B-Chat-Q5_K_M.gguf llama-chat.wasm -p chatml
59
  ```
60
 
61
  ## Quantized GGUF Models