PrunaAI
/

PowerInfer-SmallThinker-3B-Preview-HQQ-4bit-smashed

Model card Files Files and versions Community

PowerInfer-SmallThinker-3B-Preview-HQQ-4bit-smashed

1 contributor

History: 5 commits

sharpenb's picture

56481f3e547152ba981437f3678abbcf5b3247bc7f1abc231494559c4a5e3387

1304493 verified 5 days ago

.gitattributes

1.52 kB

initial commit 6 days ago
README.md

5.48 kB

Upload folder using huggingface_hub (#1) 6 days ago
config.json

1.23 kB

56481f3e547152ba981437f3678abbcf5b3247bc7f1abc231494559c4a5e3387 5 days ago
qmodel.pt
Detected Pickle imports (8)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "torch.uint8",
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "torch.Size",
- "torch._utils._rebuild_parameter"
How to fix it?
2.98 GB
LFS

Upload folder using huggingface_hub (#3) 6 days ago
smash_config.json

451 Bytes

56481f3e547152ba981437f3678abbcf5b3247bc7f1abc231494559c4a5e3387 5 days ago