Update README.md
Browse files
README.md
CHANGED
@@ -4,7 +4,7 @@ license: apache-2.0
|
|
4 |
|
5 |
# DeciLM-7B-instruct GGUF checkpoints
|
6 |
This repository includes DeciLM-7B-instruct checkpoints in the GGUF format.<br>
|
7 |
-
DeciLM
|
8 |
|
9 |
## 1. Clone and build llama.cpp (1 minute)
|
10 |
```
|
@@ -12,16 +12,16 @@ git clone https://github.com/ggerganov/llama.cpp && cd llama.cpp && make -j
|
|
12 |
```
|
13 |
|
14 |
## 2. Download the GGUF checkpoint
|
15 |
-
-
|
16 |
-
- Click on
|
17 |
-
- Click on the
|
18 |
|
19 |
## 3. Generate outputs
|
20 |
-
- Use the chat template and feed a prompt to DeciLM-
|
21 |
```text
|
22 |
./main -m ~/Downloads/decilm-7b-uniform-gqa-q8_0.gguf -p """
|
23 |
### System:
|
24 |
-
You are an AI assistant that follows
|
25 |
### User:
|
26 |
How do I make the most delicious pancakes the world has ever tasted?
|
27 |
### Assistant:
|
@@ -31,15 +31,15 @@ git clone https://github.com/ggerganov/llama.cpp && cd llama.cpp && make -j
|
|
31 |
- Output:
|
32 |
```
|
33 |
### System:
|
34 |
-
You are an AI assistant that follows
|
35 |
### User:
|
36 |
How do I make the most delicious pancakes the world has ever tasted?
|
37 |
### Assistant:
|
38 |
-
To make the most delicious pancakes the world ever tasted, follow these steps:
|
39 |
|
40 |
-
1. In a mixing bowl, combine 2 cups of all-purpose flour, 4 tablespoons of sugar, and 3
|
41 |
-
2. Make a
|
42 |
-
3. Heat your frying pan with
|
43 |
4. Enjoy your delicious pancakes [end of text]
|
44 |
|
45 |
llama_print_timings: load time = 343.16 ms
|
|
|
4 |
|
5 |
# DeciLM-7B-instruct GGUF checkpoints
|
6 |
This repository includes DeciLM-7B-instruct checkpoints in the GGUF format.<br>
|
7 |
+
DeciLM demonstrates strong performance on commodity CPUs when utilizing the llama.cpp codebase.
|
8 |
|
9 |
## 1. Clone and build llama.cpp (1 minute)
|
10 |
```
|
|
|
12 |
```
|
13 |
|
14 |
## 2. Download the GGUF checkpoint
|
15 |
+
- Navigate to the 'Files' section
|
16 |
+
- Click on 'decilm-7b-uniform-gqa-q8_0.gguf'
|
17 |
+
- Click on the 'Download' button
|
18 |
|
19 |
## 3. Generate outputs
|
20 |
+
- Use the chat template and feed a prompt to DeciLM-7B-instruct. We are using the INT8 quantized GGUF checkpoint.
|
21 |
```text
|
22 |
./main -m ~/Downloads/decilm-7b-uniform-gqa-q8_0.gguf -p """
|
23 |
### System:
|
24 |
+
You are an AI assistant that follows instructions exceptionally well. Be as helpful as possible.
|
25 |
### User:
|
26 |
How do I make the most delicious pancakes the world has ever tasted?
|
27 |
### Assistant:
|
|
|
31 |
- Output:
|
32 |
```
|
33 |
### System:
|
34 |
+
You are an AI assistant that follows instructions exceptionally well. Be as helpful as possible.
|
35 |
### User:
|
36 |
How do I make the most delicious pancakes the world has ever tasted?
|
37 |
### Assistant:
|
38 |
+
To make the most delicious pancakes the world has ever tasted, follow these steps:
|
39 |
|
40 |
+
1. In a mixing bowl, combine 2 cups of all-purpose flour, 4 tablespoons of sugar, and 3 teaspoons of baking powder with 1/2 teaspoon salt; mix well.
|
41 |
+
2. Make a well in the center and pour in 4 eggs and 1 cup of milk. Whisk well until smooth. Add 3 tablespoons of oil and 1 tablespoon of melted butter.
|
42 |
+
3. Heat your frying pan with some butter or oil. Ladle the batter onto the pan, and spread it to a 1/2-inch thickness. Wait for tiny bubbles to form on the surface, then flip it over to brown the other side until golden.
|
43 |
4. Enjoy your delicious pancakes [end of text]
|
44 |
|
45 |
llama_print_timings: load time = 343.16 ms
|