PrunaAI
/

PowerInfer-SmallThinker-3B-Preview-HQQ-4bit-smashed

Model card Files Files and versions Community

PowerInfer-SmallThinker-3B-Preview-HQQ-4bit-smashed

1 contributor

History: 7 commits

sharpenb's picture

619c3bcf94c714309a23ae4ee3863767b7a1d07d3bcae08b18b85f94e739802e

0935d95 verified 3 days ago

.gitattributes

1.52 kB

initial commit 6 days ago
README.md

5.48 kB

Upload folder using huggingface_hub (#1) 6 days ago
config.json

1.23 kB

619c3bcf94c714309a23ae4ee3863767b7a1d07d3bcae08b18b85f94e739802e 3 days ago
qmodel.pt
Detected Pickle imports (8)
- "torch.ByteStorage",
- "torch._utils._rebuild_parameter",
- "torch._utils._rebuild_tensor_v2",
- "torch.Size",
- "torch.uint8",
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch.FloatStorage"
How to fix it?
2.98 GB
LFS

f303211493eb8a3c481f774de1c6a6c00a3ec6baea4ffdc9950bb9e7f0e47f3b 3 days ago
smash_config.json

451 Bytes

619c3bcf94c714309a23ae4ee3863767b7a1d07d3bcae08b18b85f94e739802e 3 days ago