QuantFactory
/

llm-compiler-7b-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

llm-compiler-7b-GGUF

Commit History

Upload llm-compiler-7b.Q5_K_M.gguf with huggingface_hub

2e7b91b
verified

munish0838 commited on Jun 28, 2024

Upload llm-compiler-7b.Q6_K.gguf with huggingface_hub

eed53e8
verified

munish0838 commited on Jun 28, 2024

Upload llm-compiler-7b.Q8_0.gguf with huggingface_hub

21cb6ee
verified

munish0838 commited on Jun 28, 2024

Upload llm-compiler-7b.Q4_0.gguf with huggingface_hub

8de0160
verified

munish0838 commited on Jun 28, 2024

Upload llm-compiler-7b.Q4_1.gguf with huggingface_hub

83999aa
verified

munish0838 commited on Jun 28, 2024

Upload llm-compiler-7b.Q4_K_M.gguf with huggingface_hub

418d43f
verified

munish0838 commited on Jun 28, 2024

initial commit

41c809f
verified

munish0838 commited on Jun 28, 2024