Hugging Face's logo

ModelCloud
/
Meta-Llama-3.1-70B-Instruct-gptq-4bit

Text Generation
Transformers
Safetensors
llama
gptq
4bit
int4
gptqmodel
modelcloud
llama-3.1
70b
instruct
conversational
text-generation-inference
Inference Endpoints
4-bit precision
Model card Files Community
5

Upload folder using huggingface_hub

#3
by lrl-modelcloud - opened
base: refs/heads/main
←
from: refs/pr/3
Discussion Files changed
+6
-6
Files changed (6) hide show
  1. config.json +1 -1
  2. model-00001-of-00005.safetensors +1 -1
  3. model-00002-of-00005.safetensors +1 -1
  4. model-00003-of-00005.safetensors +1 -1
  5. model-00004-of-00005.safetensors +1 -1
  6. model-00005-of-00005.safetensors +1 -1
config.json CHANGED
@@ -53,4 +53,4 @@
53
  "transformers_version": "4.44.0.dev0",
54
  "use_cache": true,
55
  "vocab_size": 128256
56
- }
 
53
  "transformers_version": "4.44.0.dev0",
54
  "use_cache": true,
55
  "vocab_size": 128256
56
+ }
model-00001-of-00005.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:07ca4a8c4c8be908d5b9c05a0f4d0f64b9c66c5eb2969b4b48bdb3ccaa3944f0
3
  size 7963341608
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a7d5fd94998b50215392a4ffe20faf977524cc9e38775e016961b9cf1803d6c
3
  size 7963341608
model-00002-of-00005.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:859e4966fd249d0ab6302cf94011728a1bb7d9dd38a7197bdc369c6b260db83f
3
  size 7972908440
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e503008164d2b9ec4078a0ed9cfe7b72091fc623d25cabfa0262f395df159b6
3
  size 7972908440
model-00003-of-00005.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8e46ee3feddbdc7fbc81ef444b54a0db18d56d56ad2c830bdd4c292af911eded
3
  size 7999024080
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98e78c2bcb0f40c114fcaee50687160e394fefe08b3f3097184d3e789b7caa6a
3
  size 7999024080
model-00004-of-00005.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ee1d18c286774c698c87c515ac471bb091c63016179700ce7f9598a2a7724513
3
  size 7972908424
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05f2d33634ba440c4551528bcd1bf79103295038e686f07661ba5556fe90e232
3
  size 7972908424
model-00005-of-00005.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:730c1c7fea6fd160a7a65dd3968cd0cec60a7e9c9e94a93dbba245a4b02ade30
3
  size 7884778880
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc8ba4dc3adf401025754a6efb7fc47afb7bc920bee3162bbc5309858cc0bb38
3
  size 7884778880