Hugging Face's logo

mudler
/
Mirai-Nova-Llama3-LocalAI-8B-v0.1-GGUF

Transformers
llama-factory
llama3
Inference Endpoints
Model card Files Community
mudler commited on
Commit
4c2a4fd
•
1 Parent(s): 131d646

Upload folder using huggingface_hub

Browse files
Files changed (12) hide show
  1. Mirai-Nova-Llama3-LocalAI-8B-v0.1-q2_k.bin +3 -0
  2. Mirai-Nova-Llama3-LocalAI-8B-v0.1-q3_k_l.bin +3 -0
  3. Mirai-Nova-Llama3-LocalAI-8B-v0.1-q3_k_m.bin +3 -0
  4. Mirai-Nova-Llama3-LocalAI-8B-v0.1-q3_k_s.bin +3 -0
  5. Mirai-Nova-Llama3-LocalAI-8B-v0.1-q4_0.bin +3 -0
  6. Mirai-Nova-Llama3-LocalAI-8B-v0.1-q4_k_m.bin +3 -0
  7. Mirai-Nova-Llama3-LocalAI-8B-v0.1-q4_k_s.bin +3 -0
  8. Mirai-Nova-Llama3-LocalAI-8B-v0.1-q5_0.bin +3 -0
  9. Mirai-Nova-Llama3-LocalAI-8B-v0.1-q5_k_m.bin +3 -0
  10. Mirai-Nova-Llama3-LocalAI-8B-v0.1-q5_k_s.bin +3 -0
  11. Mirai-Nova-Llama3-LocalAI-8B-v0.1-q6_k.bin +3 -0
  12. Mirai-Nova-Llama3-LocalAI-8B-v0.1-q8_0.bin +3 -0
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q2_k.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e9cfc6e0faa0bfd2d0885e64a858ca99b737fa0a7142cdbe46ef346ed3fe580
3
+ size 3179644448
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q3_k_l.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c05926267eec2b4761024ca811b5dbd5b25ac1a8f19a98b2a9a9d6256e19b66
3
+ size 4322469408
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q3_k_m.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:362e8c6395df8b0e59bee1d9b4c2b5976763a24e5cf7bac98d26f09719097a01
3
+ size 4019430944
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q3_k_s.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5bc12fadc7cf4683b3cf9d45d2f10077dafe76190bbaf81dc1898af40f1b8ffb
3
+ size 3665012256
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q4_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98708be6b73057d293f471db33d9520003b2e2b58b1926953f045035092d2dce
3
+ size 4661724704
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q4_k_m.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:579cbb229f9c11d0330759ff4733102d2491615a4c61289e26c09d1b3a583fec
3
+ size 4921247264
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q4_k_s.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b295fd25e76d9aa8f00fd9ac352da47744283a0dcd961424afef442af4959d6
3
+ size 4693181984
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q5_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:deccccea78a808c8ec0db260e0333e6f167182d107e69358bf876fa1766abccc
3
+ size 5599807008
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q5_k_m.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2a812c14aaa3a0a9c4723e9a38e510c9dadba77fe0577fa7f0cbb3fe295e11e4
3
+ size 5733500448
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q5_k_s.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2ae806ac305546ee7f89ebea91954b5aec7261c5645eee51c723abec1a31c77
3
+ size 5599807008
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q6_k.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:868b6595073d48b69d15ffd114a15fa2732afe737646fc14510122adb89f4386
3
+ size 6596519456
Mirai-Nova-Llama3-LocalAI-8B-v0.1-q8_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:36f51c66532b6c0c29a791708b7f04ab4eeef43f46c3bc5b759cc1dc2d3af01e
3
+ size 8541283872