| license: llama2 | |
| base_model: | |
| - unsloth/llama-2-13b | |
| - layoric/llama-2-13b-code-alpaca | |
| - vanillaOVO/WizardMath-13B-V1.0 | |
| tags: | |
| - merge | |
| # AIM Paper Checkpoints Uploaded For Replication | |
| This repository includes one of the checkpoints used in the paper "Activation-Informed Merging of Large Language Models". Specifics of this model are as follows: | |
| - **Merging Method:** WIDEN | |
| - **Models Used In Merging** | |
| - ***Base Model:*** unsloth/llama-2-13b | |
| - ***Code:*** layoric/llama-2-13b-code-alpaca | |
| - ***Math:*** vanillaOVO/WizardMath-13B-V1.0 | |
| - **AIM:** True | |
| Benchmark results and paper details can be found at the official [GitHub](https://github.com/ahnobari/ActivationInformedMerging.git). | |