Update README.md
Browse files
README.md
CHANGED
@@ -19,7 +19,7 @@ tags:
|
|
19 |
- code
|
20 |
- granite
|
21 |
model-index:
|
22 |
-
- name: granite-34b-code-base
|
23 |
results:
|
24 |
- task:
|
25 |
type: text-generation
|
@@ -225,9 +225,9 @@ model-index:
|
|
225 |
|
226 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/62cd5057674cdb524450093d/1hzxoPwqkBJXshKVVe6_9.png)
|
227 |
|
228 |
-
# ibm-granite/granite-34b-code-base-GGUF
|
229 |
-
This is the Q4_K_M converted version of the original [`ibm-granite/granite-34b-code-base`](https://huggingface.co/ibm-granite/granite-34b-code-base).
|
230 |
-
Refer to the [original model card](https://huggingface.co/ibm-granite/granite-34b-code-base) for more details.
|
231 |
|
232 |
## Use with llama.cpp
|
233 |
```shell
|
@@ -238,5 +238,5 @@ cd llama.cpp
|
|
238 |
make
|
239 |
|
240 |
# run generation
|
241 |
-
./main -m granite-34b-code-base-GGUF/granite-34b-code-base.Q4_K_M.gguf -n 128 -p "def generate_random(x: int):" --color
|
242 |
```
|
|
|
19 |
- code
|
20 |
- granite
|
21 |
model-index:
|
22 |
+
- name: granite-34b-code-base-8k
|
23 |
results:
|
24 |
- task:
|
25 |
type: text-generation
|
|
|
225 |
|
226 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/62cd5057674cdb524450093d/1hzxoPwqkBJXshKVVe6_9.png)
|
227 |
|
228 |
+
# ibm-granite/granite-34b-code-base-8k-GGUF
|
229 |
+
This is the Q4_K_M converted version of the original [`ibm-granite/granite-34b-code-base-8k`](https://huggingface.co/ibm-granite/granite-34b-code-base-8k).
|
230 |
+
Refer to the [original model card](https://huggingface.co/ibm-granite/granite-34b-code-base-8k) for more details.
|
231 |
|
232 |
## Use with llama.cpp
|
233 |
```shell
|
|
|
238 |
make
|
239 |
|
240 |
# run generation
|
241 |
+
./main -m granite-34b-code-base-8k-GGUF/granite-34b-code-base.Q4_K_M.gguf -n 128 -p "def generate_random(x: int):" --color
|
242 |
```
|