Commit
·
aa49ebf
1
Parent(s):
2141791
add function calling Llama
Browse files
README.md
CHANGED
@@ -8,32 +8,35 @@ pinned: false
|
|
8 |
tags: [llama, jupyter, colab, function calling, QLoRa, fine-tuning, scripts, fine-tuning]
|
9 |
---
|
10 |
|
11 |
-
#
|
12 |
|
13 |
-
|
14 |
- Access the Google Colab script [here](https://colab.research.google.com/drive/1uMSS1o_8YOPyG1X_4k6ENEE3kJfBGGhH?usp=sharing).
|
15 |
|
16 |
- View the [Youtube Video Here](https://youtu.be/OQdp-OeG1as)
|
17 |
|
18 |
-
|
19 |
This advanced script provides improved performance when training with small datasets:
|
20 |
- Includes a prompt loss-mask for improved performance when structured responses are required.
|
21 |
- Includes a stop token after responses - allowing the model to provide a short reponse (e.g. a function call) and then stop.
|
22 |
- Request [access here](https://buy.stripe.com/5kA5l69K52Hxf3a006). €14.99 (or $16.49) per seat/user. Access will be provided within 24 hours of purchase.
|
23 |
|
24 |
-
# Function Calling Dataset
|
25 |
- Commercial dataset allowing language models to be fine-tuned for function calling ([Get access here](https://huggingface.co/datasets/Trelis/function_calling_extended)).
|
26 |
- Created using only human input or Apache 2 licensed datasets (no third party commercial licensing limitations)
|
27 |
- Models trained with this dataset:
|
28 |
- - [Llama-2-7B](https://huggingface.co/Trelis/Llama-2-7b-chat-hf-function-calling) - repo includes Google Colab notebook for inference
|
29 |
- - [Llama-2-13B](https://huggingface.co/Trelis/Llama-2-13b-chat-hf-function-calling) - repo includes Google Colab notebook for inference
|
30 |
|
31 |
-
# Jupyter
|
32 |
-
A
|
|
|
|
|
|
|
33 |
- Upload pdf or text files for analysis.
|
34 |
-
-
|
35 |
-
- No data is used for training language models.
|
36 |
|
37 |
-
|
38 |
-
-
|
39 |
-
-
|
|
|
|
8 |
tags: [llama, jupyter, colab, function calling, QLoRa, fine-tuning, scripts, fine-tuning]
|
9 |
---
|
10 |
|
11 |
+
# 1. QLoRa Fine-Tuning Scripts/Notebooks
|
12 |
|
13 |
+
**Basic Training Notebook**
|
14 |
- Access the Google Colab script [here](https://colab.research.google.com/drive/1uMSS1o_8YOPyG1X_4k6ENEE3kJfBGGhH?usp=sharing).
|
15 |
|
16 |
- View the [Youtube Video Here](https://youtu.be/OQdp-OeG1as)
|
17 |
|
18 |
+
**ADVANCED Training Notebook (PAID)**
|
19 |
This advanced script provides improved performance when training with small datasets:
|
20 |
- Includes a prompt loss-mask for improved performance when structured responses are required.
|
21 |
- Includes a stop token after responses - allowing the model to provide a short reponse (e.g. a function call) and then stop.
|
22 |
- Request [access here](https://buy.stripe.com/5kA5l69K52Hxf3a006). €14.99 (or $16.49) per seat/user. Access will be provided within 24 hours of purchase.
|
23 |
|
24 |
+
# 2. Function Calling Dataset
|
25 |
- Commercial dataset allowing language models to be fine-tuned for function calling ([Get access here](https://huggingface.co/datasets/Trelis/function_calling_extended)).
|
26 |
- Created using only human input or Apache 2 licensed datasets (no third party commercial licensing limitations)
|
27 |
- Models trained with this dataset:
|
28 |
- - [Llama-2-7B](https://huggingface.co/Trelis/Llama-2-7b-chat-hf-function-calling) - repo includes Google Colab notebook for inference
|
29 |
- - [Llama-2-13B](https://huggingface.co/Trelis/Llama-2-13b-chat-hf-function-calling) - repo includes Google Colab notebook for inference
|
30 |
|
31 |
+
# 3. Jupyter fLlama
|
32 |
+
A Llama 2 chatbot with function calling
|
33 |
+
|
34 |
+
**Basic Chatbot with function calling**
|
35 |
+
- Search Bing.
|
36 |
- Upload pdf or text files for analysis.
|
37 |
+
- Get access [here](https://colab.research.google.com/drive/1u8x41Jx8WWtI-nzHOgqTxkS3Q_lcjaSX?usp=sharing).
|
|
|
38 |
|
39 |
+
**Jupyter fLlama Pro**
|
40 |
+
- Add and call any custom function.
|
41 |
+
- Search for papers on ArXiv.
|
42 |
+
- Get access [here](https://buy.stripe.com/4gw4h27BX81R9IQaEL). €9.99 (or $10.99) per seat/user. Access will be provided within 24 hours of purchase.
|