Update README.md
Browse files
README.md
CHANGED
|
@@ -5,4 +5,8 @@ base_model:
|
|
| 5 |
library: gguf
|
| 6 |
pipeline_tag: text-generation
|
| 7 |
---
|
| 8 |
-
GGUF version of [c4ai-command-r7b-12-2024](https://huggingface.co/CohereForAI/c4ai-command-r7b-12-2024) from CohereForAI.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 5 |
library: gguf
|
| 6 |
pipeline_tag: text-generation
|
| 7 |
---
|
| 8 |
+
GGUF version of [c4ai-command-r7b-12-2024](https://huggingface.co/CohereForAI/c4ai-command-r7b-12-2024) from CohereForAI.
|
| 9 |
+
|
| 10 |
+
```sh
|
| 11 |
+
./build/bin/llama-cli -fa --no-display-prompt -c 0 -m ggml-c4ai-command-r-7b-12-2024-q4_k.gguf -p "<|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|>You are a helpful assistant.<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|USER_TOKEN|>Tell me all about yourself.<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|><|START_RESPONSE|>"
|
| 12 |
+
```
|