metadata
base_model:
- meta-llama/Meta-Llama-3-8B-Instruct
- abacusai/Llama-3-Smaug-8B
library_name: transformers
tags:
- mergekit
- peft
Untitled LoRA Model (1)
This is a LoRA extracted from a language model. It was extracted using mergekit.
LoRA Details
This LoRA adapter was extracted from abacusai/Llama-3-Smaug-8B and uses meta-llama/Meta-Llama-3-8B-Instruct as a base.
Parameters
The following command was used to extract this LoRA adapter:
mergekit-extract-lora meta-llama/Meta-Llama-3-8B-Instruct abacusai/Llama-3-Smaug-8B OUTPUT_PATH --no-lazy-unpickle --rank=32 --device=cuda