ahn1376's picture
Upload README.md with huggingface_hub
1d69db2 verified
metadata
license: llama2
base_model:
  - unsloth/llama-2-13b
  - layoric/llama-2-13b-code-alpaca
  - WizardLMTeam/WizardLM-13B-V1.2
tags:
  - merge

AIM Paper Checkpoints Uploaded For Replication

This repository includes one of the checkpoints used in the paper "Activation-Informed Merging of Large Language Models". Specifics of this model are as follows:

  • Merging Method: dare_ties
  • Models Used In Merging
    • Base Model: unsloth/llama-2-13b
    • Code: layoric/llama-2-13b-code-alpaca
    • Instruction Tuned: WizardLMTeam/WizardLM-13B-V1.2
  • AIM: False

Benchmark results and paper details can be found at the official GitHub.