PrunaAI
/

SweatyCrayfish-llama-3-8b-quantized-HQQ-2bit-smashed

Text Generation

Inference Endpoints

Model card Files Files and versions Community

SweatyCrayfish-llama-3-8b-quantized-HQQ-2bit-smashed

1 contributor

History: 3 commits

sharpenb's picture

b937bcfad403aa48bd1212156cf59ea12090f336267fcf2ed5d066dbf1a997b0

09179a1 verified 6 months ago

.gitattributes

1.52 kB

initial commit 6 months ago
README.md

5.56 kB

b937bcfad403aa48bd1212156cf59ea12090f336267fcf2ed5d066dbf1a997b0 6 months ago
config.json

708 Bytes

b937bcfad403aa48bd1212156cf59ea12090f336267fcf2ed5d066dbf1a997b0 6 months ago
qmodel.pt
Detected Pickle imports (8)
- "torch.float16",
- "torch.uint8",
- "torch.ByteStorage",
- "torch.HalfStorage",
- "torch._utils._rebuild_parameter",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.Size"
How to fix it?
4.01 GB
LFS

ea9fdbe5c96c86ad62ade63f755e5f6436a3ca877ad6a72947612093209199ec 6 months ago
smash_config.json

1.02 kB

b937bcfad403aa48bd1212156cf59ea12090f336267fcf2ed5d066dbf1a997b0 6 months ago
special_tokens_map.json

449 Bytes

b937bcfad403aa48bd1212156cf59ea12090f336267fcf2ed5d066dbf1a997b0 6 months ago
tokenizer.json

9.08 MB

b937bcfad403aa48bd1212156cf59ea12090f336267fcf2ed5d066dbf1a997b0 6 months ago
tokenizer_config.json

50.8 kB

b937bcfad403aa48bd1212156cf59ea12090f336267fcf2ed5d066dbf1a997b0 6 months ago