SRDdev commited on
Commit
2f409ed
·
1 Parent(s): 961407b

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +58 -0
README.md ADDED
@@ -0,0 +1,58 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ pipeline_tag: text-generation
6
+ ---
7
+ # SCRIPTGPT
8
+ Pretrained model on the English language using a causal language modeling (CLM) objective. It was introduced in this paper and first released on this page.
9
+
10
+ ## Model description
11
+ ScriptGPT is a language model trained on a dataset of CUSTOM YouTube videos. Video_ScriptGPT-small is a Causal language transformer. The model resembles the GPT2 architecture, the model is a Causal Language model meaning it predicts the probability of a sequence of words based on the preceding words in the sequence. It generates a probability distribution over the next word given the previous words, without incorporating future words.
12
+
13
+ The goal of ScriptGPT is to generate scripts for AI videos that are coherent, informative, and engaging. This can be useful for content creators who are looking for inspiration or who want to automate the process of generating video scripts. To use ScriptGPT, users can provide a prompt or a starting sentence, and the model will generate a sequence of words that follow the context and style of the training data.
14
+
15
+ The current model is the smallest one with 124 million parameters (SRDdev/video_ScriptGPT-small)
16
+
17
+ More models are coming soon...
18
+
19
+ ## Intended uses
20
+ The intended uses of ScriptGPT include generating scripts for videos that explain artificial intelligence concepts, providing inspiration for content creators, and automating the process of generating video scripts.
21
+
22
+ ## How to use
23
+ You can use this model directly with a pipeline for text generation.
24
+
25
+ __Load Model__
26
+ ```python
27
+ from transformers import AutoTokenizer, AutoModelForCausalLM
28
+
29
+ tokenizer = AutoTokenizer.from_pretrained("SRDdev/video_ScriptGPT-small")
30
+ model = AutoModelForCausalLM.from_pretrained("SRDdev/video_ScriptGPT-small")
31
+ ```
32
+ __Pipeline__
33
+ ```python
34
+ from transformers import pipeline
35
+ generator = pipeline('text generation, model= model , tokenizer=tokenizer)
36
+
37
+ context = "This is an introduction to Keras, a high-level neural networks API that is popular among researchers and developers. The video covers the basics of Keras, how to install it, and how to use it to build and train a neural network. The presenter demonstrates building and training a simple binary classification model using Keras"
38
+ length_to_generate = 1000
39
+
40
+ script = generator(context, max_length=length_to_generate, do_sample=True)[0]['generated_text']
41
+
42
+ script
43
+ ```
44
+ Keeping the context more detailed results in better outputs
45
+
46
+ ## Limitations and bias
47
+ The model is trained on Youtube Scripts and will work better for that. It may also generate random information and users should be aware of that and cross-validate the results.
48
+
49
+
50
+ ## Citations
51
+ @model{
52
+ Name=Shreyas Dixit
53
+ framework=Pytorch
54
+ Year=Jan 2023
55
+ Pipeline=text-generation
56
+ Github=https://github.com/SRDdev
57
+ LinkedIn=https://www.linkedin.com/in/srddev
58
+ }