ModelCloud
/

gemma-2-9b-gptq-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

gemma-2-9b-gptq-4bit

Ctrl+K

Ctrl+K

2 contributors

History: 3 commits

lrl-modelcloud's picture

3511702cac83698e80cbe4c7af0d2016d52fcac13b84593d223823610e8fa565

f48ae2e verified about 1 year ago

.gitattributes

1.57 kB

3511702cac83698e80cbe4c7af0d2016d52fcac13b84593d223823610e8fa565 about 1 year ago
config.json

1.3 kB

3511702cac83698e80cbe4c7af0d2016d52fcac13b84593d223823610e8fa565 about 1 year ago
model.safetensors

8 GB
xet

ead5bf6c710d2a40e29fda5119166e0c2989454d74682a171a043e24033bc30f about 1 year ago
quantize_config.json

340 Bytes

3511702cac83698e80cbe4c7af0d2016d52fcac13b84593d223823610e8fa565 about 1 year ago
special_tokens_map.json

522 Bytes

3511702cac83698e80cbe4c7af0d2016d52fcac13b84593d223823610e8fa565 about 1 year ago
tokenizer.json

17.5 MB
xet

3511702cac83698e80cbe4c7af0d2016d52fcac13b84593d223823610e8fa565 about 1 year ago
tokenizer.model

4.24 MB
xet

3511702cac83698e80cbe4c7af0d2016d52fcac13b84593d223823610e8fa565 about 1 year ago
tokenizer_config.json

40 kB

3511702cac83698e80cbe4c7af0d2016d52fcac13b84593d223823610e8fa565 about 1 year ago