Hugging Face's logo

bullerwins
/
Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation
GGUF
facebook
meta
llama
llama-3
Inference Endpoints
conversational
Model card Files Community
1
bullerwins commited on
Commit
9961037
•
1 Parent(s): 67f0cdd

Upload folder using huggingface_hub

Browse files
Files changed (13) hide show
  1. .gitattributes +12 -0
  2. Meta-Llama-3.1-70B-Instruct-Q2_K.gguf +3 -0
  3. Meta-Llama-3.1-70B-Instruct-Q3_K_L.gguf +3 -0
  4. Meta-Llama-3.1-70B-Instruct-Q3_K_M.gguf +3 -0
  5. Meta-Llama-3.1-70B-Instruct-Q3_K_S.gguf +3 -0
  6. Meta-Llama-3.1-70B-Instruct-Q4_K_M.gguf +3 -0
  7. Meta-Llama-3.1-70B-Instruct-Q4_K_S.gguf +3 -0
  8. Meta-Llama-3.1-70B-Instruct-Q5_K_M.gguf +3 -0
  9. Meta-Llama-3.1-70B-Instruct-Q5_K_S.gguf +3 -0
  10. Meta-Llama-3.1-70B-Instruct-Q6_K-00001-of-00002.gguf +3 -0
  11. Meta-Llama-3.1-70B-Instruct-Q6_K-00002-of-00002.gguf +3 -0
  12. Meta-Llama-3.1-70B-Instruct-Q8_0-00001-of-00002.gguf +3 -0
  13. Meta-Llama-3.1-70B-Instruct-Q8_0-00002-of-00002.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Meta-Llama-3.1-70B-Instruct-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Meta-Llama-3.1-70B-Instruct-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Meta-Llama-3.1-70B-Instruct-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Meta-Llama-3.1-70B-Instruct-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Meta-Llama-3.1-70B-Instruct-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Meta-Llama-3.1-70B-Instruct-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Meta-Llama-3.1-70B-Instruct-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Meta-Llama-3.1-70B-Instruct-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Meta-Llama-3.1-70B-Instruct-Q6_K-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Meta-Llama-3.1-70B-Instruct-Q6_K-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Meta-Llama-3.1-70B-Instruct-Q8_0-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Meta-Llama-3.1-70B-Instruct-Q8_0-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
Meta-Llama-3.1-70B-Instruct-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:025acb51326c0bf5a658bca1c05ab9517b4ea54f4341b8d7a0f814888120aad3
3
+ size 26375108480
Meta-Llama-3.1-70B-Instruct-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55b84b6dee18fa95aed703d4ae8a0d5523faf299aee2fee4f4e51cecd3282116
3
+ size 37140592512
Meta-Llama-3.1-70B-Instruct-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9a7d90d0dcaa7938075c313eb4f1642334b68cf0ea4dac5ed6cae128c0279c16
3
+ size 34267494272
Meta-Llama-3.1-70B-Instruct-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:977ed6d83fdb453fa771856b252ee0f686c754e98e8170841f643998c2182918
3
+ size 30912051072
Meta-Llama-3.1-70B-Instruct-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c13f113a54bc3818341bdee12ced4c1171e4da9a835fa694f2d9b115e400c265
3
+ size 42520393600
Meta-Llama-3.1-70B-Instruct-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c533d9f03c151280c23af321e6261832075a0bea1730439b3847117ea193f66
3
+ size 40347219840
Meta-Llama-3.1-70B-Instruct-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:87c38f1884bf39d5167c8fc89063e341b5505abca934b34e3924267dd6d7daa1
3
+ size 49949816704
Meta-Llama-3.1-70B-Instruct-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0d40874064751b89d7ac4541cc4bd6214495753c295df33f22dbeedae5f9a67
3
+ size 48657446784
Meta-Llama-3.1-70B-Instruct-Q6_K-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:052188a16d5ef0ac913e6b5ff1ee9cdff56100179cb023ba19f27d11af653e37
3
+ size 44975985408
Meta-Llama-3.1-70B-Instruct-Q6_K-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f517f73d7796a86b12e172ee2000fbda3d2103f822297307e08d44e195b2e58c
3
+ size 12912158048
Meta-Llama-3.1-70B-Instruct-Q8_0-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:94b0f43252d98255421cf6b9bd8402cb32ef77cea7224e21c6927b588678e079
3
+ size 44764902496
Meta-Llama-3.1-70B-Instruct-Q8_0-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c348c2b1aa8867231188fae7a8ffbe7aed9f18b865d002a63bfcb1cd16262750
3
+ size 30210147296