thomasgauthier/OpenHermes-2.5-Mistral-7B-LoRA-extraction-r512

Untitled LoRA Model (1)

This is a LoRA extracted from a language model. It was extracted using mergekit.

LoRA Details

This LoRA adapter was extracted from /workspace/models/teknium_OpenHermes-2.5-Mistral-7B/ and uses /workspace/models/thomasgauthier_Mistral-7B-v0.1-zeroed_out-ChatML-base/ as a base.

Parameters

The following command was used to extract this LoRA adapter:

mergekit-extract-lora /workspace/models/thomasgauthier_Mistral-7B-v0.1-zeroed_out-ChatML-base/ /workspace/models/teknium_OpenHermes-2.5-Mistral-7B/ OUTPUT_PATH --rank=512 --device=cuda:0