Hugging Face's logo

Felladrin
/
gguf-Lite-Oute-1-300M-Instruct

GGUF
Inference Endpoints
conversational
Model card Files Community
Felladrin commited on
Commit
fe3537c
•
1 Parent(s): 0473fa5

Upload folder using huggingface_hub

Browse files
Files changed (11) hide show
  1. .gitattributes +8 -0
  2. Lite-Oute-1-300M-Instruct.IQ2_XXS.gguf +3 -0
  3. Lite-Oute-1-300M-Instruct.IQ3_XXS.gguf +3 -0
  4. Lite-Oute-1-300M-Instruct.IQ4_XS.gguf +3 -0
  5. Lite-Oute-1-300M-Instruct.Q4_K.gguf +3 -0
  6. Lite-Oute-1-300M-Instruct.Q5_K.gguf +3 -0
  7. Lite-Oute-1-300M-Instruct.Q6_K.gguf +3 -0
  8. Lite-Oute-1-300M-Instruct.Q8_0.gguf +3 -0
  9. Lite-Oute-1-300M-Instruct.gguf +3 -0
  10. README.md +5 -0
  11. imatrix.dat +0 -0
.gitattributes CHANGED
@@ -33,3 +33,11 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Lite-Oute-1-300M-Instruct.IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Lite-Oute-1-300M-Instruct.IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Lite-Oute-1-300M-Instruct.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Lite-Oute-1-300M-Instruct.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Lite-Oute-1-300M-Instruct.Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Lite-Oute-1-300M-Instruct.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Lite-Oute-1-300M-Instruct.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Lite-Oute-1-300M-Instruct.gguf filter=lfs diff=lfs merge=lfs -text
Lite-Oute-1-300M-Instruct.IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:999fd2615594c49aceb0df2f7ae25444e45ea98202a0a6c7d1d9c8df1947233f
3
+ size 234694752
Lite-Oute-1-300M-Instruct.IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f24baaf9bf992fca5fbde137726b94fb542ee849469a5dc63b2c143b5978bb17
3
+ size 242271328
Lite-Oute-1-300M-Instruct.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:247ed514b0412cbfd767950bed41b06cb51d472512fad341cb5e5c962ad20e34
3
+ size 251804768
Lite-Oute-1-300M-Instruct.Q4_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eefd498652686b61d8f16715aec6467d1a302f312233d833826df3bfdbb748d2
3
+ size 285673568
Lite-Oute-1-300M-Instruct.Q5_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b0ebe3baa89b20ad0f89cc93f23157f196d63369bd461a28616854b8f1bc248
3
+ size 300475488
Lite-Oute-1-300M-Instruct.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c6db369637b89719a8ba5d23690475438904eed34f701471c8353e915b552123
3
+ size 358679648
Lite-Oute-1-300M-Instruct.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:313574fb683b08cbaa87b8a88d900e84c4d74058a4340c52ee6a4f14f8d65862
3
+ size 374234208
Lite-Oute-1-300M-Instruct.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80ff59b2d7c775db4d351654bcc4f5c1f98edcaaa933232af81bf6fcadd047de
3
+ size 600026016
README.md ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ ---
2
+ base_model: OuteAI/Lite-Oute-1-300M-Instruct
3
+ ---
4
+
5
+ GGUF version of [OuteAI/Lite-Oute-1-300M-Instruct](https://huggingface.co/OuteAI/Lite-Oute-1-300M-Instruct).
imatrix.dat ADDED
Binary file (721 kB). View file