Spaces:
Runtime error
Runtime error
Delete README.md
Browse files
README.md
DELETED
@@ -1,36 +0,0 @@
|
|
1 |
-
# python-dev-task-summarization
|
2 |
-
|
3 |
-
The task has been done in two methods-
|
4 |
-
- **using traditional Python libraries (like NLTK,Sumy)**
|
5 |
-
- **using pre-trained transformers model**
|
6 |
-
|
7 |
-
# Method-1
|
8 |
-
## using traditional Python libraries
|
9 |
-
#### Web Scraping Tools:
|
10 |
-
- Selenium
|
11 |
-
#### Paraphrasing Tools:
|
12 |
-
- used [nlpaug](https://github.com/makcedward/nlpaug) library
|
13 |
-
#### Summarization Tools:
|
14 |
-
- used [sumy](https://miso-belica.github.io/sumy/) library
|
15 |
-
#### System Requirements:
|
16 |
-
- you will find it in the _requirements.txt_ file
|
17 |
-
|
18 |
-
## How to test or run this?
|
19 |
-
- just open this link and follow the instructions: _**https://shamim237-python-dev-task-app-3n18pu.streamlit.app/**_
|
20 |
-
|
21 |
-
# Method-2
|
22 |
-
## Using pre-trained transformers model
|
23 |
-
#### Web Scraping Tools:
|
24 |
-
- ScrapperAPI
|
25 |
-
- BeautifulSoup
|
26 |
-
#### Paraphrasing Tools:
|
27 |
-
- used **"ramsrigouthamg/t5-large-paraphraser-diverse-high-quality"** pre-trained model from HuggingFace
|
28 |
-
#### Summarization Tools:
|
29 |
-
- used **/"google/pegasus-cnn_dailymail"/** pre-trained model from HuggingFace
|
30 |
-
#### System Requirements:
|
31 |
-
- you will find it in the _Python_Dev_Task.ipynb_ notebook or in the below link.
|
32 |
-
|
33 |
-
## How to test or run this?
|
34 |
-
- Just open the **"Python_Dev_Task.ipynb"** file in Colab _or_ open this link: **_https://colab.research.google.com/drive/1wwaj0TobsnzQL5jMVsYrF5z6rc1944tE?usp=sharing_**
|
35 |
-
- Run all the cell
|
36 |
-
- The summarization output will show up in the last cell of the notebook.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|