| base_model: mlabonne/FrankenLlama-3-12B | |
| inference: false | |
| library_name: transformers | |
| license: other | |
| merged_models: | |
| - meta-llama/Meta-Llama-3-8B | |
| - meta-llama/Meta-Llama-3-8B | |
| pipeline_tag: text-generation | |
| quantized_by: Suparious | |
| tags: | |
| - 4-bit | |
| - AWQ | |
| - text-generation | |
| - autotrain_compatible | |
| - endpoints_compatible | |
| - merge | |
| - mergekit | |
| - lazymergekit | |
| # mlabonne/FrankenLlama-3-12B AWQ | |
| - Model creator: [mlabonne](https://huggingface.co/mlabonne) | |
| - Original model: [FrankenLlama-3-12B](https://huggingface.co/mlabonne/FrankenLlama-3-12B) | |
| ## Model Summary | |
| FrankenLlama-3-12B is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing): | |
| * [meta-llama/Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) | |
| * [meta-llama/Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) | |