MinzaKhan
/

HGWells

@@ -15,6 +15,8 @@ The limitations of this model are that it can only generate text in the style of
 I created my own dataset to train this model. I chose 14 novels written by H G Wells for my dataset. Most of the novels in the dataset are of the genre science fiction. The dataset contains more than 1 million tokens.
 The texts included in the corpus are novels written by H G Wells. The novels in the corpus are:
 The Time Machine - 37677
@@ -47,13 +49,14 @@ The Red Room - 4618
 The total number of tokens in the corpus is 1043588.
-The corpus was created by downloading and combining 14 novels of the famous author H G Wells from Project Gutenberg. Most of these novels are science fiction novels, so this model has been trained to generate text of the science fiction genre. It produces text in the style of H G Wells.
-The corpus consists of 14 novels written by H G Wells downloaded from Project Gutenberg. The text added by Project Gutenberg at the beginning and end of each novel were removed. Then the entire text in each novel
 was converted into one line. Then the single line was broken into 20 parts. In this way 20 lines were generated for each novel. The lines from each novel were then combined and
-stored in a single text file. The text was tokenized by using the tokenizer from the GPT2Tokenizer library. This text file was then used to finetune the model.
-The values of the parameters used during finetuning are:
 batch_size = 2
@@ -65,12 +68,13 @@ learning rate = 5e-4
 warmup steps = 1e2
-The corpus has been uploaded on HuggingFace. It can be accessed from the following link: https://huggingface.co/datasets/MinzaKhan/HGWells
 Training Loss: 2.26
 Training Perplexity: 9.57
 Validation Loss: 3.84
-Validation Perplexity: 46.43

 I created my own dataset to train this model. I chose 14 novels written by H G Wells for my dataset. Most of the novels in the dataset are of the genre science fiction. The dataset contains more than 1 million tokens.
+The evaluation results are good. The model is able to generate text in the style of H G Wells. Most of the text generated is of the science fiction genre.
 The texts included in the corpus are novels written by H G Wells. The novels in the corpus are:
 The Time Machine - 37677
 The total number of tokens in the corpus is 1043588.
+The corpus was created by downloading and combining 14 novels of the famous author H G Wells from Project Gutenberg. Most of these novels are science fiction novels, so this model has been trained to generate text of the science fiction genre. It has been trained to produce text in the style of H G Wells.
+This model was created on 23rd February, 2023.
+The corpus consists of 14 novels written by H G Wells downloaded from Project Gutenberg. The text added by Project Gutenberg at the beginning and end of each novel was removed. Then the entire text in each novel
 was converted into one line. Then the single line was broken into 20 parts. In this way 20 lines were generated for each novel. The lines from each novel were then combined and
+stored in a single text file. This is the preprocessing that was done on the text files. The text was tokenized by using the GPT2Tokenizer from the transformers library. This text file was then used to finetune the model.
+The values of the hyperparameters used during finetuning are:
 batch_size = 2
 warmup steps = 1e2
 Training Loss: 2.26
 Training Perplexity: 9.57
 Validation Loss: 3.84
+Validation Perplexity: 46.43
+The corpus has been uploaded on HuggingFace. It can be accessed from the following link: https://huggingface.co/datasets/MinzaKhan/HGWells