phymbert
/

dbrx-16x12b-instruct-q4_0-gguf

Model card Files Files and versions Community

This is the Q4_0 quantum model for llama.cpp:

https://github.com/ggerganov/llama.cpp/pull/6515

Downloads last month: 8

GGUF

Model size

132B params

Architecture

dbrx

4-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including phymbert/dbrx-16x12b-instruct-q4_0-gguf

dbrx-16x12b-instruct-gguf

GGUF quantum models for DBRX: https://github.com/ggerganov/llama.cpp • 6 items • Updated Apr 14, 2024 • 1