apepkuss79 commited on
Commit
cc6d1c8
1 Parent(s): f410809

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +84 -1
README.md CHANGED
@@ -1,3 +1,86 @@
1
  ---
2
- license: apache-2.0
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ base_model: runwayml/stable-diffusion-v1-5
3
+ license: creativeml-openrail-m
4
+ inference: true
5
+ model_creator: runwayml
6
+ model_name: stable-diffusion-v1-5
7
+ quantized_by: Second State Inc.
8
+ tags:
9
+ - stable-diffusion
10
+ - stable-diffusion-diffusers
11
+ - text-to-image
12
  ---
13
+
14
+ <!-- header start -->
15
+ <!-- 200823 -->
16
+ <div style="width: auto; margin-left: auto; margin-right: auto">
17
+ <img src="https://github.com/LlamaEdge/LlamaEdge/raw/dev/assets/logo.svg" style="width: 100%; min-width: 400px; display: block; margin: auto;">
18
+ </div>
19
+ <hr style="margin-top: 1.0em; margin-bottom: 1.0em;">
20
+ <!-- header end -->
21
+
22
+ # stable-diffusion-v1-5-GGUF
23
+
24
+ ## Original Model
25
+
26
+ [runwayml/stable-diffusion-v1-5](https://huggingface.co/runwayml/stable-diffusion-v1-5)
27
+
28
+ ## Run with LlamaEdge
29
+
30
+ - LlamaEdge version: coming soon
31
+
32
+ <!-- - LlamaEdge version: [v0.12.2](https://github.com/LlamaEdge/LlamaEdge/releases/tag/0.12.2) and above
33
+
34
+ - Prompt template
35
+
36
+ - Prompt type: `chatml`
37
+
38
+ - Prompt string
39
+
40
+ ```text
41
+ <|im_start|>system
42
+ {system_message}<|im_end|>
43
+ <|im_start|>user
44
+ {prompt}<|im_end|>
45
+ <|im_start|>assistant
46
+ ```
47
+
48
+ - Context size: `4096`
49
+
50
+ - Run as LlamaEdge service
51
+
52
+ ```bash
53
+ wasmedge --dir .:. --nn-preload default:GGML:AUTO:stablelm-2-12b-chat-Q5_K_M.gguf \
54
+ llama-api-server.wasm \
55
+ --prompt-template chatml \
56
+ --ctx-size 4096 \
57
+ --model-name stablelm-2-12b-chat
58
+ ```
59
+
60
+ - Run as LlamaEdge command app
61
+
62
+ ```bash
63
+ wasmedge --dir .:. \
64
+ --nn-preload default:GGML:AUTO:stablelm-2-12b-chat-Q5_K_M.gguf \
65
+ llama-chat.wasm \
66
+ --prompt-template chatml \
67
+ --ctx-size 4096
68
+ ``` -->
69
+
70
+ ## Quantized GGUF Models
71
+
72
+ Using formats of different precisions will yield results of varying quality.
73
+
74
+ | f32 | f16 |q8_0 |q5_0 |q5_1 |q4_0 |q4_1 |
75
+ | ---- |---- |---- |---- |---- |---- |---- |
76
+ | ![](https://github.com/leejet/stable-diffusion.cpp/blob/master/assets/f32.png?raw=true) |![](https://github.com/leejet/stable-diffusion.cpp/blob/master/assets/f16.png?raw=true) |![](https://github.com/leejet/stable-diffusion.cpp/blob/master/assets/q8_0.png?raw=true) |![](https://github.com/leejet/stable-diffusion.cpp/blob/master/assets/q5_0.png?raw=true) |![](https://github.com/leejet/stable-diffusion.cpp/blob/master/assets/q5_1.png?raw=true) |![](https://github.com/leejet/stable-diffusion.cpp/blob/master/assets/q4_0.png?raw=true) |![](https://github.com/leejet/stable-diffusion.cpp/blob/master/assets/q4_1.png?raw=true) |
77
+
78
+ | Name | Quant method | Bits | Size | Use case |
79
+ | ---- | ---- | ---- | ---- | ----- |
80
+ | [stable-diffusion-v1-5-pruned-emaonly-Q4_0.gguf](https://huggingface.co/second-state/stable-diffusion-v1-5-GGUF/blob/main/stable-diffusion-v1-5-pruned-emaonly-Q4_0.gguf) | Q4_0 | 2 | 1.57 GB | |
81
+ | [stable-diffusion-v1-5-pruned-emaonly-Q4_1.gguf](https://huggingface.co/second-state/stable-diffusion-v1-5-GGUF/blob/main/stable-diffusion-v1-5-pruned-emaonly-Q4_1.gguf) | Q4_1 | 3 | 1.59 GB | |
82
+ | [stable-diffusion-v1-5-pruned-emaonly-Q5_0.gguf](https://huggingface.co/second-state/stable-diffusion-v1-5-GGUF/blob/main/stable-diffusion-v1-5-pruned-emaonly-Q5_0.gguf) | Q5_0 | 3 | 1.62 GB | |
83
+ | [stable-diffusion-v1-5-pruned-emaonly-Q5_1.gguf](https://huggingface.co/second-state/stable-diffusion-v1-5-GGUF/blob/main/stable-diffusion-v1-5-pruned-emaonly-Q5_1.gguf) | Q5_1 | 3 | 1.64 GB | |
84
+ | [stable-diffusion-v1-5-pruned-emaonly-Q8_0.gguf](https://huggingface.co/second-state/stable-diffusion-v1-5-GGUF/blob/main/stable-diffusion-v1-5-pruned-emaonly-Q8_0.gguf) | Q8_0 | 4 | 1.76 GB | |
85
+ | [stable-diffusion-v1-5-pruned-emaonly-f16.gguf](https://huggingface.co/second-state/stable-diffusion-v1-5-GGUF/blob/main/stable-diffusion-v1-5-pruned-emaonly-f16.gguf) | f16 | 4 | 2.13 GB | |
86
+ | [stable-diffusion-v1-5-pruned-emaonly-f32.gguf](https://huggingface.co/second-state/stable-diffusion-v1-5-GGUF/blob/main/stable-diffusion-v1-5-pruned-emaonly-f32.gguf) | f32 | 4 | 4.27 GB | |