Hugging Face's logo

MaziyarPanahi
/
Codestral-22B-v0.1-GGUF

Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama-3
llama
imatrix
Model card Files Community
5

Upload folder using huggingface_hub

#5
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/5
Discussion Files changed
+37
-43
Files changed (17) hide show
  1. Codestral-22B-v0.1-hf.IQ1_M.gguf +2 -2
  2. Codestral-22B-v0.1-hf.IQ1_S.gguf +2 -2
  3. Codestral-22B-v0.1-hf.IQ2_XS.gguf +2 -2
  4. Codestral-22B-v0.1-hf.IQ3_XS.gguf +2 -2
  5. Codestral-22B-v0.1-hf.IQ4_XS.gguf +2 -2
  6. Codestral-22B-v0.1-hf.Q2_K.gguf +2 -2
  7. Codestral-22B-v0.1-hf.Q3_K_L.gguf +2 -2
  8. Codestral-22B-v0.1-hf.Q3_K_M.gguf +2 -2
  9. Codestral-22B-v0.1-hf.Q3_K_S.gguf +2 -2
  10. Codestral-22B-v0.1-hf.Q4_K_M.gguf +2 -2
  11. Codestral-22B-v0.1-hf.Q4_K_S.gguf +2 -2
  12. Codestral-22B-v0.1-hf.Q5_K_M.gguf +2 -2
  13. Codestral-22B-v0.1-hf.Q5_K_S.gguf +2 -2
  14. Codestral-22B-v0.1-hf.Q6_K.gguf +2 -2
  15. Codestral-22B-v0.1-hf.Q8_0.gguf +2 -2
  16. Codestral-22B-v0.1-hf.fp16.gguf +2 -2
  17. README.md +5 -11
Codestral-22B-v0.1-hf.IQ1_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6d8e68d6180567322f29858c43b34b70f79e85bb39198146ebbd0a33fd7a1561
3
- size 5267136832
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9fcd5f613dc65f762192c04c8e9207c9b6485b51dda699b39f2283e7671fc6df
3
+ size 5267136896
Codestral-22B-v0.1-hf.IQ1_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4459565ab12eee290d7062be8403b9a68656a774feb4939d190477c4d89af2ee
3
- size 4829487424
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad737370fc21c82d55f08f5ecf1ecdea1dbdf800ebe4b97d8afa82be902fec9d
3
+ size 4829487488
Codestral-22B-v0.1-hf.IQ2_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1e394326e73122ffbdc8bd985b618206f9b26a2035148819bf8bb54f11f40492
3
- size 6646145344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:337b5053a2fafae1e101920de44410ac20a33657b77734f4ec436e537e0ea39f
3
+ size 6646145408
Codestral-22B-v0.1-hf.IQ3_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b6f45bd0f757344240dbfcdaf854250367a6b889f2bee85537cfd356343281bf
3
- size 9176097088
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0913dc4f0704f5a6a8f06692bbe7ce9ddb8cb0cc0b2bca90cdac12847e482409
3
+ size 9176097152
Codestral-22B-v0.1-hf.IQ4_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d8928bf14217a484134e84ca64ea6287932dc8902885f3d0e42db65305d50860
3
- size 11935293760
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a801900712c3e6cc0e67cea1bc1a9b704b768669dabae4b0b76eb46fb31ab9e9
3
+ size 11935293824
Codestral-22B-v0.1-hf.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3c785af06144ef6864dbf9a601be4d37e3ea8726412b1516e3928d54d39c3440
3
- size 8272093504
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a8d7d167c4a4185068494a066cecf189444599104bc237d797e542418511123
3
+ size 8272093568
Codestral-22B-v0.1-hf.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:99a6f7216b52dd0802566a94430272480587370dab273df12351a774407fd6ce
3
- size 11730428224
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0dce5486221dd8072f1984b22fe34d3fdb6142caf03b674ae97e92460829e7c8
3
+ size 11730428288
Codestral-22B-v0.1-hf.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e392dc4637fb81d5860e74337a5b41aa9a0d124882d642e28c7c81250e810014
3
- size 10756825408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5745344684fd26de8c6681e0574a83113098e7c967aa83e8456e1059565714f0
3
+ size 10756825472
Codestral-22B-v0.1-hf.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:809f3e51d0fa2cc3c4da7283bfa097165baad9446a994ae842f21e64b23d071f
3
- size 9641271616
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b32324f7b5f3cde80e6a3d8d6bf2cc4af57061707f0977e10c9567be14db5ec9
3
+ size 9641271680
Codestral-22B-v0.1-hf.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:36a91a2b49334969c6c7077fee24ab16238a47f835a30fa918f12c9b5f11586f
3
- size 13341237568
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cdc9b7d0c755ffd8b3c9cf33024cac10a262dd79708067526643bdfe6f17e9a2
3
+ size 13341237632
Codestral-22B-v0.1-hf.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:938df66fe9083a816ea5b78898922f00da9a4c985e98cc6b5b711d24cc107d33
3
- size 12660384064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d45712e2b9736cc0bda216520b3163b5afa456a79cf39b0804a21f888cea85e
3
+ size 12660384128
Codestral-22B-v0.1-hf.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:37010993bf57f6eb81f35adac21439bf539e97a44684860550e14543881d8401
3
- size 15722553664
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76fcf29356fa15fb698692592ed4f8be23bf6d9b9acd8a2b85a4bb01b8df43a4
3
+ size 15722553728
Codestral-22B-v0.1-hf.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fca33c30993c13e1b81eb6c6b8c66d629d3abd9f0e2d50a3ad6df0920785bdd8
3
- size 15324815680
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ec82d74fb3ce1b8b2b0c30c1be6a6c867c9fd3e0e37db517e667f32a4120d3d
3
+ size 15324815744
Codestral-22B-v0.1-hf.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:050d2b5a30630293db6726eb46bf16fd0c2b5570ccf09e5bd93e139921d6a607
3
- size 18252702016
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06d97ad0738b6b85d457bc0ccede288220b459873663f90476e45c12f2974304
3
+ size 18252702080
Codestral-22B-v0.1-hf.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d799d30c9b7e531c8bc4f128b4123d986ab5946b4967d47b9e94c49b056bd7ae
3
- size 23640547648
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:649c88acac6b325abe8e8d4505a4cccd822d2d8c04118d86da526832b60389f0
3
+ size 23640547712
Codestral-22B-v0.1-hf.fp16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c7e52a42c97093b9717921d2e8bc385e21fee04cdf98c861f7ed6b6010112226
3
- size 44496724096
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b7ef0879600cf3f8773589573c82821c9e3e2c3f1b95bb88b303be86a3f0cd5b
3
+ size 44496724160
README.md CHANGED
@@ -8,29 +8,23 @@ tags:
8
  - 6-bit
9
  - 8-bit
10
  - GGUF
11
- - transformers
12
- - safetensors
13
- - mistral
14
  - text-generation
15
- - code
16
- - license:other
17
- - autotrain_compatible
18
- - text-generation-inference
19
- - region:us
20
  - text-generation
21
- model_name: Codestral-22B-v0.1-GGUF
22
  base_model: bullerwins/Codestral-22B-v0.1-hf
23
  inference: false
24
  model_creator: bullerwins
25
  pipeline_tag: text-generation
26
  quantized_by: MaziyarPanahi
27
  ---
28
- # [MaziyarPanahi/Codestral-22B-v0.1-GGUF](https://huggingface.co/MaziyarPanahi/Codestral-22B-v0.1-GGUF)
29
  - Model creator: [bullerwins](https://huggingface.co/bullerwins)
30
  - Original model: [bullerwins/Codestral-22B-v0.1-hf](https://huggingface.co/bullerwins/Codestral-22B-v0.1-hf)
31
 
32
  ## Description
33
- [MaziyarPanahi/Codestral-22B-v0.1-GGUF](https://huggingface.co/MaziyarPanahi/Codestral-22B-v0.1-GGUF) contains GGUF format model files for [bullerwins/Codestral-22B-v0.1-hf](https://huggingface.co/bullerwins/Codestral-22B-v0.1-hf).
34
 
35
  ### About GGUF
36
 
 
8
  - 6-bit
9
  - 8-bit
10
  - GGUF
 
 
 
11
  - text-generation
12
+ - llama-3
13
+ - llama
 
 
 
14
  - text-generation
15
+ model_name: Codestral-22B-v0.1-hf-GGUF
16
  base_model: bullerwins/Codestral-22B-v0.1-hf
17
  inference: false
18
  model_creator: bullerwins
19
  pipeline_tag: text-generation
20
  quantized_by: MaziyarPanahi
21
  ---
22
+ # [MaziyarPanahi/Codestral-22B-v0.1-hf-GGUF](https://huggingface.co/MaziyarPanahi/Codestral-22B-v0.1-hf-GGUF)
23
  - Model creator: [bullerwins](https://huggingface.co/bullerwins)
24
  - Original model: [bullerwins/Codestral-22B-v0.1-hf](https://huggingface.co/bullerwins/Codestral-22B-v0.1-hf)
25
 
26
  ## Description
27
+ [MaziyarPanahi/Codestral-22B-v0.1-hf-GGUF](https://huggingface.co/MaziyarPanahi/Codestral-22B-v0.1-hf-GGUF) contains GGUF format model files for [bullerwins/Codestral-22B-v0.1-hf](https://huggingface.co/bullerwins/Codestral-22B-v0.1-hf).
28
 
29
  ### About GGUF
30