Hugging Face's logo

MaziyarPanahi
/
calme-3.3-baguette-3b-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Community
3

Upload folder using huggingface_hub

#2
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/2
Discussion Files changed
+14
-15
Files changed (5) hide show
  1. README.md +6 -7
  2. calme-3.3-baguette-3b.Q5_K_M.gguf +2 -2
  3. calme-3.3-baguette-3b.Q6_K.gguf +2 -2
  4. calme-3.3-baguette-3b.Q8_0.gguf +2 -2
  5. calme-3.3-baguette-3b.fp16.gguf +2 -2
README.md CHANGED
@@ -1,4 +1,10 @@
1
  ---
 
 
 
 
 
 
2
  tags:
3
  - quantized
4
  - 2-bit
@@ -9,13 +15,6 @@ tags:
9
  - 8-bit
10
  - GGUF
11
  - text-generation
12
- - text-generation
13
- model_name: calme-3.3-baguette-3b-GGUF
14
- base_model: MaziyarPanahi/calme-3.3-baguette-3b
15
- inference: false
16
- model_creator: MaziyarPanahi
17
- pipeline_tag: text-generation
18
- quantized_by: MaziyarPanahi
19
  ---
20
  # [MaziyarPanahi/calme-3.3-baguette-3b-GGUF](https://huggingface.co/MaziyarPanahi/calme-3.3-baguette-3b-GGUF)
21
  - Model creator: [MaziyarPanahi](https://huggingface.co/MaziyarPanahi)
 
1
  ---
2
+ base_model: MaziyarPanahi/calme-3.3-baguette-3b
3
+ inference: false
4
+ model_creator: MaziyarPanahi
5
+ model_name: calme-3.3-baguette-3b-GGUF
6
+ pipeline_tag: text-generation
7
+ quantized_by: MaziyarPanahi
8
  tags:
9
  - quantized
10
  - 2-bit
 
15
  - 8-bit
16
  - GGUF
17
  - text-generation
 
 
 
 
 
 
 
18
  ---
19
  # [MaziyarPanahi/calme-3.3-baguette-3b-GGUF](https://huggingface.co/MaziyarPanahi/calme-3.3-baguette-3b-GGUF)
20
  - Model creator: [MaziyarPanahi](https://huggingface.co/MaziyarPanahi)
calme-3.3-baguette-3b.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8bfae7fb82eb43023a852d03c8a895f9c90043a36a29749de8879265d0cd38fb
3
- size 2225423520
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e75b76e8cda215ef5c9ad79edfc6e5deee2f9e01ecf605ee6a557b1b5c9ef85
3
+ size 2224815264
calme-3.3-baguette-3b.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f33c82658a3a1c9520abdc804d2c8a88924f08b7b1980c7b9dc21cfb8bb794fd
3
- size 2538767520
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d9558b325206025cb335753147d63ad8d3b2e9b502d344cc9f999f5641b6e38e
3
+ size 2538159264
calme-3.3-baguette-3b.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2170b0db341370ee4be263cb851d1ef42f0eae1862bba6eea8b6ffd538468972
3
- size 3286084768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6303481021e2da645ced6b6d8a1443a4033312a5356c09d8b248fac5727d7c59
3
+ size 3285476512
calme-3.3-baguette-3b.fp16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b383e55eb4f11ce18616b624b62bb64280a949353d8007f28784aec569456ba9
3
- size 6178925472
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05f105f909180319114fb5d3ee20a7d42f82cde6305e4051239fd5b915c2c47b
3
+ size 6178317472