File size: 446 Bytes
d30e094
281a418
 
 
 
 
 
 
 
 
d30e094
281a418
 
 
 
d30e094
281a418
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
---

language:
- en
- fr
- it
- pt
- hi
- es
- th
- de
license: llama3.3
base_model: meta-llama/Llama-3.3-70B-Instruct
base_model_relation: quantized
library_name: mlc-llm
pipeline_tag: text-generation
---


3-bit [OmniQuant](https://arxiv.org/abs/2308.13137) quantized version of [Llama-3.3-70B-Instruct](https://huggingface.co/meta-llama/Llama-3.3-70B-Instruct/) for inference with the [Private LLM](http://privatellm.app) app.