José Ángel González
commited on
Commit
•
2592d9a
1
Parent(s):
c08b1b7
Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language: ca
|
3 |
+
tags:
|
4 |
+
- summarization
|
5 |
+
widget:
|
6 |
+
- text: "
|
7 |
+
|
8 |
+
News Abstractive Summarization for Catalan (NASCA) is a Transformer encoder-decoder model, with the same hyper-parameters than BART, to perform summarization on Catalan news articles. It is pre-trained on a combination of several self-supervised tasks that help to increase the abstractivity of the generated summaries. Four objectives have been combined: sentence permutation, text infilling, Gap Sentence Generation, and Next Segment Generation. Catalan newspapers, the Catalan subset of the OSCAR corpus and Wikipedia articles in Catalan were used for pretrain the model.
|
9 |
+
|
10 |
+
For the summarization task, it is trained on the Dataset for Automatic summarization of Catalan and Spanish newspaper Articles (DACSA) corpus.
|
11 |
+
|
12 |
+
---
|