PrunaAI
/

PowerInfer-SmallThinker-3B-Preview-bnb-8bit-smashed

8-bit precision

Model card Files Files and versions

PowerInfer-SmallThinker-3B-Preview-bnb-8bit-smashed

Ctrl+K

Ctrl+K

1 contributor

History: 3 commits

sharpenb's picture

ebe01e9368df6ef9f8ba25279c12e9f51622e3a9d03eb839508e2a6a7247ef22

425a1c1 verified 7 months ago

.gitattributes

1.52 kB

initial commit 7 months ago
README.md

5.35 kB

ebe01e9368df6ef9f8ba25279c12e9f51622e3a9d03eb839508e2a6a7247ef22 7 months ago
config.json

1.39 kB

ebe01e9368df6ef9f8ba25279c12e9f51622e3a9d03eb839508e2a6a7247ef22 7 months ago
generation_config.json

242 Bytes

ebe01e9368df6ef9f8ba25279c12e9f51622e3a9d03eb839508e2a6a7247ef22 7 months ago
model.safetensors

3.4 GB
xet

f92ab2d96a6dd4c8ea95314b401fec5d21d58d8df94304f4a4db8ac052389ac8 7 months ago
smash_config.json

1.19 kB

ebe01e9368df6ef9f8ba25279c12e9f51622e3a9d03eb839508e2a6a7247ef22 7 months ago