ISTA-DASLab
/

Llama-2-7b-AQLM-2Bit-2x8-hf

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Llama-2-7b-AQLM-2Bit-2x8-hf

3 contributors

History: 3 commits

Andrei Panferov

try except import

400eeaa 11 months ago

.gitattributes

1.52 kB

initial commit 11 months ago
config.json

2.5 kB

everythin 11 months ago
configuration_llama_aqlm.py

421 Bytes

everythin 11 months ago
modeling_llama_aqlm.py

65.5 kB

try except import 11 months ago
pytorch_model.bin
Detected Pickle imports (5)
- "torch._utils._rebuild_parameter",
- "torch.CharStorage",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
How to fix it?
2.15 GB
LFS

everythin 11 months ago