--- license: apache-2.0 language: - en base_model: EVA-UNIT-01/EVA-D-Qwen2.5-1.5B-v0.0 base_model_relation: quantized library_name: mlc-llm pipeline_tag: text-generation tags: - chat --- 4-bit [GPTQ](https://arxiv.org/abs/2210.17323) quantized version of [EVA-D-Qwen2.5-1.5B-v0.0](https://huggingface.co/EVA-UNIT-01/EVA-D-Qwen2.5-1.5B-v0.0) for inference with the [Private LLM](https://privatellm.app/) app.