Hugging Face's logo

mradermacher
/
Neural-Mistral-7B-GGUF

Transformers
GGUF
English
Inference Endpoints
conversational
Model card Files Community
mradermacher commited on
Commit
51cb522
•
1 Parent(s): 1fab724

uploaded from rich1

Browse files
Files changed (13) hide show
  1. .gitattributes +12 -0
  2. Neural-Mistral-7B.IQ4_XS.gguf +3 -0
  3. Neural-Mistral-7B.Q2_K.gguf +3 -0
  4. Neural-Mistral-7B.Q3_K_L.gguf +3 -0
  5. Neural-Mistral-7B.Q3_K_M.gguf +3 -0
  6. Neural-Mistral-7B.Q3_K_S.gguf +3 -0
  7. Neural-Mistral-7B.Q4_K_M.gguf +3 -0
  8. Neural-Mistral-7B.Q4_K_S.gguf +3 -0
  9. Neural-Mistral-7B.Q5_K_M.gguf +3 -0
  10. Neural-Mistral-7B.Q5_K_S.gguf +3 -0
  11. Neural-Mistral-7B.Q6_K.gguf +3 -0
  12. Neural-Mistral-7B.Q8_0.gguf +3 -0
  13. Neural-Mistral-7B.f16.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Neural-Mistral-7B.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Neural-Mistral-7B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Neural-Mistral-7B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Neural-Mistral-7B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Neural-Mistral-7B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Neural-Mistral-7B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Neural-Mistral-7B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Neural-Mistral-7B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Neural-Mistral-7B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Neural-Mistral-7B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Neural-Mistral-7B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Neural-Mistral-7B.f16.gguf filter=lfs diff=lfs merge=lfs -text
Neural-Mistral-7B.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f5592396a9aebd1b1f5eca858e300d98214651db438640f4006a1c8a3ca6947
3
+ size 3944389952
Neural-Mistral-7B.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:afd6c19b227937aec3d0ad2e852b27d16f7eaaf6130925d54b1ec6efa37035ac
3
+ size 2719243584
Neural-Mistral-7B.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c00e8d4151290f83a392a16b9d105e23d527c6aa30620e4ae673f08fb29b54e6
3
+ size 3822026048
Neural-Mistral-7B.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:016086b65fc41940b8dfd1f3ae93d69e084294759627cf5e9ae2193112f6a1d9
3
+ size 3518987584
Neural-Mistral-7B.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e926abeba76bb4751748305accbb3e3bc66cd1ab292329416fbb02b8345a6b4e
3
+ size 3164568896
Neural-Mistral-7B.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a0e0d2cfb989b7e16a80c027316a105ae4b821ff0cfd1a8e9d0078e417d530db
3
+ size 4368440640
Neural-Mistral-7B.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b953ae6170ade43e289f18c1cea95ad1dc2eaba57d5ee765e5e9658524efa62a
3
+ size 4140375360
Neural-Mistral-7B.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6540c1483a5ebe44e92a73c89ac62aae98094a4242483cff1fc2e07c1ed394ad
3
+ size 5131410752
Neural-Mistral-7B.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae3b4227e418614cccd8e34fc73b3d00b95008850746d29c7cb08e917e235df2
3
+ size 4997717312
Neural-Mistral-7B.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:33afc58bfd67a7bd631264abe62052f57b3dc4fb06cf54f00861e906566be72a
3
+ size 5942066496
Neural-Mistral-7B.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:635f960b52d2a0a25c9e610387557997a88a3eb60c4bbdd7b7372ed156a73319
3
+ size 7695859008
Neural-Mistral-7B.f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51fb588088e9db094009b2bca915113c69caf9bc63592be2d431afae192d44ce
3
+ size 14484733248