ISTA-DASLab
/

Llama-2-7b-AQLM-2Bit-2x8-hf

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Llama-2-7b-AQLM-2Bit-2x8-hf

3 contributors

History: 4 commits

Andrei Panferov

better checkpoint

f6db3f5 11 months ago

.gitattributes

1.52 kB

initial commit 12 months ago
config.json

2.5 kB

everythin 12 months ago
configuration_llama_aqlm.py

421 Bytes

everythin 12 months ago
modeling_llama_aqlm.py

65.6 kB

better checkpoint 11 months ago
pytorch_model.bin
Detected Pickle imports (5)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch._utils._rebuild_parameter",
- "torch.HalfStorage",
- "torch.CharStorage"
How to fix it?
2.15 GB
LFS

better checkpoint 11 months ago