Update README.md
Browse files
README.md
CHANGED
@@ -13,7 +13,7 @@ tags:
|
|
13 |
# Replete-LLM-V3-Llama-3.1-8b
|
14 |
|
15 |
Replete-LLM-V3-Llama-3.1-8b is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
|
16 |
-
* [
|
17 |
* [Replete-AI/Replete-LLM-V2-Llama-3.1-8b](https://huggingface.co/Replete-AI/Replete-LLM-V2-Llama-3.1-8b)
|
18 |
|
19 |
## 🧩 Configuration
|
@@ -33,6 +33,9 @@ parameters:
|
|
33 |
int8_mask: true
|
34 |
dtype: bfloat16
|
35 |
```
|
|
|
|
|
|
|
36 |
|
37 |
## 💻 Usage
|
38 |
|
|
|
13 |
# Replete-LLM-V3-Llama-3.1-8b
|
14 |
|
15 |
Replete-LLM-V3-Llama-3.1-8b is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
|
16 |
+
* [NousResearch/Hermes-3-Llama-3.1-8B](https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-8B)
|
17 |
* [Replete-AI/Replete-LLM-V2-Llama-3.1-8b](https://huggingface.co/Replete-AI/Replete-LLM-V2-Llama-3.1-8b)
|
18 |
|
19 |
## 🧩 Configuration
|
|
|
33 |
int8_mask: true
|
34 |
dtype: bfloat16
|
35 |
```
|
36 |
+
You can find the continuous finetuning method here:
|
37 |
+
|
38 |
+
https://docs.google.com/document/d/1OjbjU5AOz4Ftn9xHQrX3oFQGhQ6RDUuXQipnQ9gn6tU/edit?usp=sharing
|
39 |
|
40 |
## 💻 Usage
|
41 |
|