jartine
/

gemma-2-9b-it-llamafile

Inference Endpoints

Model card Files Files and versions Community

jartine commited on Jun 29

Commit

4eb3069

•

1 Parent(s): 8f86ec6

Quantize Q5_K_M with llamafile-0.8.8

Files changed (2) hide show

.gitattributes +1 -0
gemma-2-9b-it.Q5_K_M.llamafile +3 -0

.gitattributes CHANGED Viewed

@@ -36,3 +36,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 gemma-2-9b-it.Q6_K.llamafile filter=lfs diff=lfs merge=lfs -text
 gemma-2-9b-it.Q5_0.llamafile filter=lfs diff=lfs merge=lfs -text
 gemma-2-9b-it.Q8_0.llamafile filter=lfs diff=lfs merge=lfs -text

 gemma-2-9b-it.Q6_K.llamafile filter=lfs diff=lfs merge=lfs -text
 gemma-2-9b-it.Q5_0.llamafile filter=lfs diff=lfs merge=lfs -text
 gemma-2-9b-it.Q8_0.llamafile filter=lfs diff=lfs merge=lfs -text
+gemma-2-9b-it.Q5_K_M.llamafile filter=lfs diff=lfs merge=lfs -text

gemma-2-9b-it.Q5_K_M.llamafile ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6762221ef2bce05141f33185e0998e470bba3439e439b13af6e7f839ca9d80bd
+size 6677477612