RonanMcGovern commited on
Commit
aa49ebf
·
1 Parent(s): 2141791

add function calling Llama

Browse files
Files changed (1) hide show
  1. README.md +14 -11
README.md CHANGED
@@ -8,32 +8,35 @@ pinned: false
8
  tags: [llama, jupyter, colab, function calling, QLoRa, fine-tuning, scripts, fine-tuning]
9
  ---
10
 
11
- # *QLoRa Fine-Tuning Scripts/Notebooks for Small Datasets*
12
 
13
- ## QLoRa Training Notebook for Llama 2 (FREE)
14
  - Access the Google Colab script [here](https://colab.research.google.com/drive/1uMSS1o_8YOPyG1X_4k6ENEE3kJfBGGhH?usp=sharing).
15
 
16
  - View the [Youtube Video Here](https://youtu.be/OQdp-OeG1as)
17
 
18
- ## QLoRa ADVANCED Training Notebook (PAID)
19
  This advanced script provides improved performance when training with small datasets:
20
  - Includes a prompt loss-mask for improved performance when structured responses are required.
21
  - Includes a stop token after responses - allowing the model to provide a short reponse (e.g. a function call) and then stop.
22
  - Request [access here](https://buy.stripe.com/5kA5l69K52Hxf3a006). €14.99 (or $16.49) per seat/user. Access will be provided within 24 hours of purchase.
23
 
24
- # Function Calling Dataset
25
  - Commercial dataset allowing language models to be fine-tuned for function calling ([Get access here](https://huggingface.co/datasets/Trelis/function_calling_extended)).
26
  - Created using only human input or Apache 2 licensed datasets (no third party commercial licensing limitations)
27
  - Models trained with this dataset:
28
  - - [Llama-2-7B](https://huggingface.co/Trelis/Llama-2-7b-chat-hf-function-calling) - repo includes Google Colab notebook for inference
29
  - - [Llama-2-13B](https://huggingface.co/Trelis/Llama-2-13b-chat-hf-function-calling) - repo includes Google Colab notebook for inference
30
 
31
- # Jupyter Llama
32
- A Chat Assistant in Jupyter Notebook - Built on Llama 2.
 
 
 
33
  - Upload pdf or text files for analysis.
34
- - No data goes to OpenAI.
35
- - No data is used for training language models.
36
 
37
- Try it:
38
- - [Google Colab](https://colab.research.google.com/drive/1iRNIVACiRGjvCrCn4ClAAW9-KoHj9W2z?usp=sharing).
39
- - [Github](https://github.com/TrelisResearch/jupyter-llama/).
 
 
8
  tags: [llama, jupyter, colab, function calling, QLoRa, fine-tuning, scripts, fine-tuning]
9
  ---
10
 
11
+ # 1. QLoRa Fine-Tuning Scripts/Notebooks
12
 
13
+ **Basic Training Notebook**
14
  - Access the Google Colab script [here](https://colab.research.google.com/drive/1uMSS1o_8YOPyG1X_4k6ENEE3kJfBGGhH?usp=sharing).
15
 
16
  - View the [Youtube Video Here](https://youtu.be/OQdp-OeG1as)
17
 
18
+ **ADVANCED Training Notebook (PAID)**
19
  This advanced script provides improved performance when training with small datasets:
20
  - Includes a prompt loss-mask for improved performance when structured responses are required.
21
  - Includes a stop token after responses - allowing the model to provide a short reponse (e.g. a function call) and then stop.
22
  - Request [access here](https://buy.stripe.com/5kA5l69K52Hxf3a006). €14.99 (or $16.49) per seat/user. Access will be provided within 24 hours of purchase.
23
 
24
+ # 2. Function Calling Dataset
25
  - Commercial dataset allowing language models to be fine-tuned for function calling ([Get access here](https://huggingface.co/datasets/Trelis/function_calling_extended)).
26
  - Created using only human input or Apache 2 licensed datasets (no third party commercial licensing limitations)
27
  - Models trained with this dataset:
28
  - - [Llama-2-7B](https://huggingface.co/Trelis/Llama-2-7b-chat-hf-function-calling) - repo includes Google Colab notebook for inference
29
  - - [Llama-2-13B](https://huggingface.co/Trelis/Llama-2-13b-chat-hf-function-calling) - repo includes Google Colab notebook for inference
30
 
31
+ # 3. Jupyter fLlama
32
+ A Llama 2 chatbot with function calling
33
+
34
+ **Basic Chatbot with function calling**
35
+ - Search Bing.
36
  - Upload pdf or text files for analysis.
37
+ - Get access [here](https://colab.research.google.com/drive/1u8x41Jx8WWtI-nzHOgqTxkS3Q_lcjaSX?usp=sharing).
 
38
 
39
+ **Jupyter fLlama Pro**
40
+ - Add and call any custom function.
41
+ - Search for papers on ArXiv.
42
+ - Get access [here](https://buy.stripe.com/4gw4h27BX81R9IQaEL). €9.99 (or $10.99) per seat/user. Access will be provided within 24 hours of purchase.