Hugging Face's logo

bullerwins
/
Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation
GGUF
facebook
meta
llama
llama-3
Inference Endpoints
conversational
Model card Files Community
1
bullerwins commited on
Commit
30b2b30
•
1 Parent(s): e57be7c

Upload folder using huggingface_hub

Browse files
Files changed (12) hide show
  1. Meta-Llama-3.1-70B-Instruct-Q2_K.gguf +2 -2
  2. Meta-Llama-3.1-70B-Instruct-Q3_K_L.gguf +2 -2
  3. Meta-Llama-3.1-70B-Instruct-Q3_K_M.gguf +2 -2
  4. Meta-Llama-3.1-70B-Instruct-Q3_K_S.gguf +2 -2
  5. Meta-Llama-3.1-70B-Instruct-Q4_K_M.gguf +2 -2
  6. Meta-Llama-3.1-70B-Instruct-Q4_K_S.gguf +2 -2
  7. Meta-Llama-3.1-70B-Instruct-Q5_K_M.gguf +2 -2
  8. Meta-Llama-3.1-70B-Instruct-Q5_K_S.gguf +2 -2
  9. Meta-Llama-3.1-70B-Instruct-Q6_K-00001-of-00002.gguf +2 -2
  10. Meta-Llama-3.1-70B-Instruct-Q6_K-00002-of-00002.gguf +1 -1
  11. Meta-Llama-3.1-70B-Instruct-Q8_0-00001-of-00002.gguf +2 -2
  12. Meta-Llama-3.1-70B-Instruct-Q8_0-00002-of-00002.gguf +1 -1
Meta-Llama-3.1-70B-Instruct-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2a1cd1227e7e5d68831cb919577520af7090f037d5029ce07c5701ab44c51983
3
- size 26375108480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f3bc56ecb814597ecaf3cdabecf9894c1bb6f00d20d09378ea342baa19e2e08a
3
+ size 26375108800
Meta-Llama-3.1-70B-Instruct-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:018fb82bbad553b6a0ad017bce5abb6e1f80e9cb46c68ad973ea2280613612aa
3
- size 37140592512
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f73131c77485cf40e8f486bb0e5d30b23260489480ee7f9d24ef22c0b5180f4
3
+ size 37140592832
Meta-Llama-3.1-70B-Instruct-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fd895524c520bc8fce9cc3b4eee7f42cfbb444abcb10be1a5b9e2e0cf9563eb1
3
- size 34267494272
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63d14fc8cc858eca699a5a01443e7bc9924c6c262bc92ea712412975d5c2dfb5
3
+ size 34267494592
Meta-Llama-3.1-70B-Instruct-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a65c7301176104a4f4093bbfeece3e65896fb33fd3d82cdf6d367125bdb9f0c9
3
- size 30912051072
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59a78bf90a8f853b318cfb9eae8a08601e061b696ca63068f85a2f6c73c7a96f
3
+ size 30912051392
Meta-Llama-3.1-70B-Instruct-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ddd65606001e81bbd7af61a440666b40eda1adf69a31d51375746a2cb9d656fd
3
- size 42520393600
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b7c1c02c87aa5c13c13ec8e987446ae077bf88cc013220427bdee780239849c
3
+ size 42520393920
Meta-Llama-3.1-70B-Instruct-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2a0c1a06bbf63c69f68fa1e82053e9970c291b63a2bf0af8fbe3aa28f0b7d4d2
3
- size 40347219840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca8c61211dc23e0cb2abc8e74004f225013c0b3ec80394e0d06d5fc21253ada4
3
+ size 40347220160
Meta-Llama-3.1-70B-Instruct-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4b218de677f1389b4b5cbc2533607e9773cd72c12e60ce321e6e9416aa67a8fd
3
- size 49949816704
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:306aa8c2813f10ed310c20f719de7f7172d1d145f2e12d94af13490ff43d475e
3
+ size 49949817024
Meta-Llama-3.1-70B-Instruct-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:99f36e763328769e47181f7114dbe7e69cb13434881d9f30371ce2047fbdbf7b
3
- size 48657446784
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e9109652ec3432223712b1b228327d88687106e039333d7fe19065b0ee15fcd
3
+ size 48657447104
Meta-Llama-3.1-70B-Instruct-Q6_K-00001-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:33eb9ffef31d6f17694ee446853d1dfb3551dd1dc242f089e0ec1a5047e8cec7
3
- size 44975985408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f961953a7f0e65a6de145a763083bc60be0f78d342dff8692f5efdf8e958664
3
+ size 44975985696
Meta-Llama-3.1-70B-Instruct-Q6_K-00002-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f517f73d7796a86b12e172ee2000fbda3d2103f822297307e08d44e195b2e58c
3
  size 12912158048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01ed4315bee9591a3423bc434c2018794bcb555e674ba2ece7e1e1c6e8de380f
3
  size 12912158048
Meta-Llama-3.1-70B-Instruct-Q8_0-00001-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:65ab3712c29ae973395c8e4a996957b44168645b956c9995a82f967b118a466e
3
- size 44764902496
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68a615544f9a49fb2e7430a8238f44a358406e7d1007260e2d8939cb11dfec31
3
+ size 44764902816
Meta-Llama-3.1-70B-Instruct-Q8_0-00002-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c348c2b1aa8867231188fae7a8ffbe7aed9f18b865d002a63bfcb1cd16262750
3
  size 30210147296
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2487be151b5932ca17eddd5c82a06e4d3cec9508221dfd5429dbedf0207ef1fb
3
  size 30210147296