numen-tech's picture
Add weights
2e04957
metadata
language:
  - en
license: mit
base_model: perplexity-ai/r1-1776-distill-llama-70b
base_model_relation: quantized
library_name: mlc-llm
pipeline_tag: text-generation

4-bit OmniQuant quantized version of r1-1776-distill-llama-70b for inference with the Private LLM app.