numen-tech
/

dolphin-2.9.4-gemma2-2b-w4a16g128asym

Text Generation

4-bit precision

Model card Files Files and versions Community

4-bit OmniQuant quantized version of dolphin-2.9.4-gemma2-2b for inference with the Private LLM app.

Downloads last month: -

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for numen-tech/dolphin-2.9.4-gemma2-2b-w4a16g128asym

Base model

google/gemma-2-2b

Finetuned

dphn/dolphin-2.9.4-gemma2-2b

Quantized

(14)

this model