Spaces:
Runtime error
Runtime error
title: T5S | |
emoji: π― | |
colorFrom: yellow | |
colorTo: red | |
sdk: streamlit | |
app_file: src/visualization/visualize.py | |
pinned: false | |
<h1 align="center">t5s</h1> | |
T5 Summarisation Using Pytorch Lightning | |
[](https://pypi.org/project/5ts/) | |
[](https://pepy.tech/project/t5s) | |
[](https://github.com/psf/black) | |
[](https://huggingface.co/spaces/gagan3012/summarization) | |
[](https://colab.research.google.com/github/gagan3012/summarization/blob/master/notebooks/t5s.ipynb) | |
## Usage | |
To use and run the DVC pipeline install the `t5s` package | |
```shell script | |
pip install t5s | |
``` | |
Instructions | |
------------ | |
1. Clone the repo. | |
1. Edit the `params.yml` to change the parameters to train the model. | |
1. Run `make dirs` to create the missing parts of the directory structure described below. | |
1. *Optional:* Run `make virtualenv` to create a python virtual environment. Skip if using conda or some other env manager. | |
1. Run `source env/bin/activate` to activate the virtualenv. | |
1. Run `make requirements` to install required python packages. | |
1. Process your data, train and evaluate your model using `make run` | |
1. When you're happy with the result, commit files (including .dvc files) to git. | |
Project Organization | |
------------ | |
βββ LICENSE | |
βββ Makefile <- Makefile with commands like `make dirs` or `make clean` | |
βββ README.md <- The top-level README for developers using this project. | |
βββ data | |
βΒ Β βββ processed <- The final, canonical data sets for modeling. | |
βΒ Β βββ raw <- The original, immutable data dump. | |
β | |
βββ models <- Trained and serialized models, model predictions, or model summaries | |
β | |
βββ notebooks <- Jupyter notebooks. Naming convention is a number (for ordering), | |
β the creator's initials, and a short `-` delimited description, e.g. | |
β `1.0-jqp-initial-data-exploration`. | |
βββ references <- Data dictionaries, manuals, and all other explanatory materials. | |
β | |
βββ reports <- Generated analysis as HTML, PDF, LaTeX, etc. | |
βΒ Β βββ metrics.txt <- Relevant metrics after evaluating the model. | |
βΒ Β βββ training_metrics.txt <- Relevant metrics from training the model. | |
β | |
βββ requirements.txt <- The requirements file for reproducing the analysis environment | |
β | |
βββ setup.py <- makes project pip installable (pip install -e .) so src can be imported | |
βββ src <- Source code for use in this project. | |
βΒ Β βββ __init__.py <- Makes src a Python module | |
β β | |
βΒ Β βββ data <- Scripts to download or generate data | |
βΒ Β βΒ Β βββ make_dataset.py | |
βΒ Β βΒ Β βββ process_data.py | |
β β | |
βΒ Β βββ models <- Scripts to train models | |
βΒ Β βΒ Β βββ predict_model.py | |
βΒ Β βΒ Β βββ train_model.py | |
βΒ Β βΒ Β βββ evaluate_model.py | |
βΒ Β βΒ Β βββ model.py | |
β β | |
βΒ Β βββ visualization <- Scripts to create exploratory and results oriented visualizations | |
βΒ Β βββ visualize.py | |
β | |
βββ tox.ini <- tox file with settings for running tox; see tox.testrun.org | |
βββ data.dvc <- Traing a model on the processed data. | |
-------- | |