Transformers
Safetensors
PEFT
mergekit
File size: 599 Bytes
b595e17
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
---
base_model: []
library_name: transformers
tags:
- mergekit
- peft

---
# Untitled LoRA Model (1)

This is a LoRA extracted from a language model. It was extracted using [mergekit](https://github.com/arcee-ai/mergekit).

## LoRA Details

This LoRA adapter was extracted from gradientai/Llama-3-70B-Instruct-Gradient-1048k and uses meta-llama/Meta-Llama-3-70B-Instruct as a base.

### Parameters

The following command was used to extract this LoRA adapter:

```sh
mergekit-extract-lora meta-llama/Meta-Llama-3-70B-Instruct gradientai/Llama-3-70B-Instruct-Gradient-1048k OUTPUT_PATH --rank=32
```