danaevan commited on
Commit
393c4bb
1 Parent(s): c59849a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -11
README.md CHANGED
@@ -4,7 +4,7 @@ license: apache-2.0
4
 
5
  # DeciLM-7B-instruct GGUF checkpoints
6
  This repository includes DeciLM-7B-instruct checkpoints in the GGUF format.<br>
7
- DeciLM performs well on commodity CPUs using the llama.cpp codebase.
8
 
9
  ## 1. Clone and build llama.cpp (1 minute)
10
  ```
@@ -12,16 +12,16 @@ git clone https://github.com/ggerganov/llama.cpp && cd llama.cpp && make -j
12
  ```
13
 
14
  ## 2. Download the GGUF checkpoint
15
- - Go to "Files"
16
- - Click on "decilm-7b-uniform-gqa-q8_0.gguf"
17
- - Click on the "Download" button
18
 
19
  ## 3. Generate outputs
20
- - Use the chat template and feed a prompt to DeciLM-7b-instruct. We are using the INT8 quantized GGUF checkpoint.
21
  ```text
22
  ./main -m ~/Downloads/decilm-7b-uniform-gqa-q8_0.gguf -p """
23
  ### System:
24
- You are an AI assistant that follows instruction extremely well. Help as much as you can.
25
  ### User:
26
  How do I make the most delicious pancakes the world has ever tasted?
27
  ### Assistant:
@@ -31,15 +31,15 @@ git clone https://github.com/ggerganov/llama.cpp && cd llama.cpp && make -j
31
  - Output:
32
  ```
33
  ### System:
34
- You are an AI assistant that follows instruction extremely well. Help as much as you can.
35
  ### User:
36
  How do I make the most delicious pancakes the world has ever tasted?
37
  ### Assistant:
38
- To make the most delicious pancakes the world ever tasted, follow these steps:
39
 
40
- 1. In a mixing bowl, combine 2 cups of all-purpose flour, 4 tablespoons of sugar, and 3 teaspoon of baking powder with 1/2 teaspoon salt, mix well.
41
- 2. Make a hole in the center and pour in 4 eggs and 1 cup of milk, whisk well mix it until smooth. Add 3 table spoon of oil and a tables of melted butter.
42
- 3. Heat your frying pan with little bit butter or oil and ladle batter onto the pan, spread it with 1/2 inch width. Wait for small bubbles to form in the surface and flip over to brown other side until golden.
43
  4. Enjoy your delicious pancakes [end of text]
44
 
45
  llama_print_timings: load time = 343.16 ms
 
4
 
5
  # DeciLM-7B-instruct GGUF checkpoints
6
  This repository includes DeciLM-7B-instruct checkpoints in the GGUF format.<br>
7
+ DeciLM demonstrates strong performance on commodity CPUs when utilizing the llama.cpp codebase.
8
 
9
  ## 1. Clone and build llama.cpp (1 minute)
10
  ```
 
12
  ```
13
 
14
  ## 2. Download the GGUF checkpoint
15
+ - Navigate to the 'Files' section
16
+ - Click on 'decilm-7b-uniform-gqa-q8_0.gguf'
17
+ - Click on the 'Download' button
18
 
19
  ## 3. Generate outputs
20
+ - Use the chat template and feed a prompt to DeciLM-7B-instruct. We are using the INT8 quantized GGUF checkpoint.
21
  ```text
22
  ./main -m ~/Downloads/decilm-7b-uniform-gqa-q8_0.gguf -p """
23
  ### System:
24
+ You are an AI assistant that follows instructions exceptionally well. Be as helpful as possible.
25
  ### User:
26
  How do I make the most delicious pancakes the world has ever tasted?
27
  ### Assistant:
 
31
  - Output:
32
  ```
33
  ### System:
34
+ You are an AI assistant that follows instructions exceptionally well. Be as helpful as possible.
35
  ### User:
36
  How do I make the most delicious pancakes the world has ever tasted?
37
  ### Assistant:
38
+ To make the most delicious pancakes the world has ever tasted, follow these steps:
39
 
40
+ 1. In a mixing bowl, combine 2 cups of all-purpose flour, 4 tablespoons of sugar, and 3 teaspoons of baking powder with 1/2 teaspoon salt; mix well.
41
+ 2. Make a well in the center and pour in 4 eggs and 1 cup of milk. Whisk well until smooth. Add 3 tablespoons of oil and 1 tablespoon of melted butter.
42
+ 3. Heat your frying pan with some butter or oil. Ladle the batter onto the pan, and spread it to a 1/2-inch thickness. Wait for tiny bubbles to form on the surface, then flip it over to brown the other side until golden.
43
  4. Enjoy your delicious pancakes [end of text]
44
 
45
  llama_print_timings: load time = 343.16 ms