Update README.md
Browse files
README.md
CHANGED
@@ -16,8 +16,13 @@ inference: false
|
|
16 |
|
17 |
> ⚠️ warning - this is a work in progress ⚠️
|
18 |
|
|
|
|
|
|
|
|
|
|
|
|
|
19 |
|
20 |
-
This model is a fine-tuned version of [google/long-t5-tglobal-xl](https://huggingface.co/google/long-t5-tglobal-xl) on the `pszemraj/qmsum-cleaned` dataset.
|
21 |
It achieves the following results on the evaluation set:
|
22 |
- Loss: 2.0505
|
23 |
- Rouge1: 35.3881
|
|
|
16 |
|
17 |
> ⚠️ warning - this is a work in progress ⚠️
|
18 |
|
19 |
+
<a href="https://colab.research.google.com/gist/pszemraj/ea0ac20dae4ad84bea4ea64543f84a85/long-t5-tglobal-xl-qmsum-wip.ipynb">
|
20 |
+
<img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/>
|
21 |
+
</a>
|
22 |
+
|
23 |
+
This model is a fine-tuned version of [google/long-t5-tglobal-xl](https://huggingface.co/google/long-t5-tglobal-xl) on the `pszemraj/qmsum-cleaned` dataset. Refer to the [dataset card](https://huggingface.co/datasets/pszemraj/qmsum-cleaned) for details but this model was trained **with the task/prompt prefixes at the start of `input`** which means that **inference should be run in a similar fashion**.
|
24 |
+
- an example of this is in the Colab notebook linked above.
|
25 |
|
|
|
26 |
It achieves the following results on the evaluation set:
|
27 |
- Loss: 2.0505
|
28 |
- Rouge1: 35.3881
|