| language: | |
| - en | |
| - de | |
| - fr | |
| - it | |
| - pt | |
| - hi | |
| - es | |
| - th | |
| license: llama3.1 | |
| base_model: meta-llama/Meta-Llama-3.1-8B-Instruct | |
| base_model_relation: quantized | |
| library_name: mlc-llm | |
| pipeline_tag: text-generation | |
| tags: | |
| - meta | |
| - pytorch | |
| - llama | |
| - llama-3 | |
| 4-bit [OmniQuant](https://arxiv.org/abs/2308.13137) quantized version of [Meta-Llama-3.1-8B-Instruct](meta-llama/Llama-3.1-8B-Instruct). | |