Deci
/

DeciLM-7B-instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

DeciLM-7B-instruct-GGUF

3 contributors

History: 2 commits

avideci's picture

Added DeciLM-7B-instruct model with uniform GQA in GGUF format, in multiple quantization levels.

8c84ad9 about 1 year ago

.gitattributes

1.72 kB

Added DeciLM-7B-instruct model with uniform GQA in GGUF format, in multiple quantization levels. about 1 year ago
README.md

28 Bytes

initial commit about 1 year ago
decilm-7b-uniform-gqa-f16.gguf

14.2 GB
LFS

Added DeciLM-7B-instruct model with uniform GQA in GGUF format, in multiple quantization levels. about 1 year ago
decilm-7b-uniform-gqa-f32.gguf

28.4 GB
LFS

Added DeciLM-7B-instruct model with uniform GQA in GGUF format, in multiple quantization levels. about 1 year ago
decilm-7b-uniform-gqa-q8_0.gguf

7.55 GB
LFS

Added DeciLM-7B-instruct model with uniform GQA in GGUF format, in multiple quantization levels. about 1 year ago