numen-tech
/

SauerkrautLM-gemma-2-2b-it-w4a16g128asym

Text Generation

MLC-LLM

conversational

4-bit precision

Model card Files Files and versions Community

SauerkrautLM-gemma-2-2b-it-w4a16g128asym / README.md

numen-tech

Add weights

bcc7932 4 months ago

preview code

raw

history blame contribute delete

337 Bytes

metadata

license: gemma
base_model: VAGOsolutions/SauerkrautLM-gemma-2-2b-it
base_model_relation: quantized
library_name: mlc-llm
pipeline_tag: text-generation

4-bit OmniQuant quantized version of SauerkrautLM-gemma-2-2b-it.