AI Text Generation

This repository contains jupyter notebooks and python scripts that demo the training of a GPT model and the generation of text using the trained model.

What is GPT?

GPT is a language model that is trained on a large corpus of text. It is a deep learning model that is trained using a technique called backpropagation. GPT in full is Generative Pre-trained Transformer.

GPT has a lot of real-world applications and it can accelerate workflows of different kinds.

In summary, imagine an AI model that generates new text based on a given text. This is what GPT does.

GPT Model Generation

This is full of experiments that are based of aitextgen Python package.

How to run

Clone the repository
Create a virtual environment using pipenv
Install the dependencies using pipenv
Run the jupyter notebooks in the notebooks folder

To run the demos, simply run the python scripts after installing the dependencies.

GPT Model Training

Different notebooks are used for different experiments.