Hugging Face's logo

dranger003
/
c4ai-command-r7b-12-2024-GGUF

Text Generation
GGUF
Inference Endpoints
conversational
Model card Files Community
dranger003 commited on
Commit
1aeb55a
·
verified ·
1 Parent(s): f086e3f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -9,4 +9,6 @@ GGUF version of [c4ai-command-r7b-12-2024](https://huggingface.co/CohereForAI/c4
9
 
10
  ```sh
11
  ./build/bin/llama-cli -fa --no-display-prompt -c 0 -m ggml-c4ai-command-r-7b-12-2024-q4_k.gguf -p "<|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|>You are a helpful assistant.<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|USER_TOKEN|>Tell me all about yourself.<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|><|START_RESPONSE|>"
12
- ```
 
 
 
9
 
10
  ```sh
11
  ./build/bin/llama-cli -fa --no-display-prompt -c 0 -m ggml-c4ai-command-r-7b-12-2024-q4_k.gguf -p "<|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|>You are a helpful assistant.<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|USER_TOKEN|>Tell me all about yourself.<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|><|START_RESPONSE|>"
12
+ ```
13
+
14
+ https://github.com/ggerganov/llama.cpp/issues/10816#issuecomment-2548574766