mynkchaudhry commited on
Commit
1980665
1 Parent(s): 6d76844

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +44 -3
README.md CHANGED
@@ -1,3 +1,44 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # PEGASUS Fine-Tuned for Dialogue Summarization
2
+
3
+ ## Introduction
4
+
5
+ This project showcases the fine-tuning of the PEGASUS model for summarizing dialogues. Leveraging the Hugging Face Transformers library, the workflow involves training the PEGASUS model on the SAMSum dataset, which consists of conversational dialogues and their summaries. The process includes data preparation, model training, evaluation using ROUGE metrics, and visualization of token lengths. The final model and tokenizer are saved and uploaded to the Hugging Face Model Hub for sharing and deployment. This setup provides an effective solution for natural language processing tasks involving dialogue summarization.
6
+
7
+ ## Fine-Tuning PEGASUS for Dialogue Summarization
8
+
9
+ This model is a fine-tuned version of the PEGASUS model, specifically adapted for summarizing dialogues. The fine-tuning was performed on the SAMSum dataset, which contains conversational dialogues and their corresponding summaries.
10
+
11
+ ### Model Details
12
+
13
+ - **Base Model:** [google/pegasus-cnn_dailymail](https://huggingface.co/google/pegasus-cnn_dailymail)
14
+ - **Fine-Tuned On:** SAMSum dataset
15
+ - **Model Type:** Sequence-to-Sequence (Seq2Seq)
16
+ - **Task:** Dialogue Summarization
17
+
18
+ ### Performance
19
+
20
+ The model's performance was evaluated using the ROUGE metric, which assesses the quality of the generated summaries compared to reference summaries. The following ROUGE scores were achieved:
21
+
22
+ | ROUGE Metric | Score |
23
+ |--------------|------------|
24
+ | ROUGE-1 | `0.015558` |
25
+ | ROUGE-2 | `0.000301` |
26
+ | ROUGE-L | `0.015546` |
27
+ | ROUGE-Lsum | `0.015532` |
28
+
29
+ ### Usage
30
+
31
+ To use this model for summarizing dialogues, you can utilize the following code:
32
+
33
+ ```python
34
+ from transformers import pipeline
35
+
36
+ # Load the fine-tuned PEGASUS model
37
+ summarizer = pipeline("summarization", model="mynkchaudhry/Summarization-Pro")
38
+
39
+ # Example dialogue
40
+ dialogue = "Your dialogue text here."
41
+
42
+ # Generate summary
43
+ summary = summarizer(dialogue)
44
+ print(summary[0]['summary_text'])