metadata
license: apache-2.0
base_model: google/flan-t5-xl
tags:
- generated_from_trainer
datasets:
- adithya7/background-summaries
metrics:
- rouge
model-index:
- name: '2023_12_18_08_41_35'
results:
- task:
name: Sequence-to-sequence Language Modeling
type: text2text-generation
dataset:
name: background_summ
type: background_summ
config: background-summ
split: validation
args: background-summ
metrics:
- name: Rouge1
type: rouge
value: 43
widget:
- text: >-
summarize: Date: 2008-09-07, Update: The government seizes control of
mortgage giants Fannie Mae and Freddie Mac, promising to inject up to $100
billion into each if they fail. In recent months, the two companies funded
more than two-thirds of all home loans in the United States. Treasury
Secretary Henry Paulson says the government will initially buy
mortgage-backed securities worth up to $5 billion.
example_title: Example 1
- text: >-
summarize: Date: 2008-09-07, Update: The government seizes control of
mortgage giants Fannie Mae and Freddie Mac, promising to inject up to $100
billion into each if they fail. In recent months, the two companies funded
more than two-thirds of all home loans in the United States. Treasury
Secretary Henry Paulson says the government will initially buy
mortgage-backed securities worth up to $5 billion. Date: 2008-09-15,
Update: Lehman Brothers declares bankruptcy, and Bank of America agrees to
buy Merrill Lynch. Despite Wall Street's pleas and concerns about falling
global stocks, the Federal Reserve opts not to raise interest rates. Oil
falls below $100 per barrel. The state of New York has authorized AIG to
use $20 billion from its own insurance subsidiaries to lessen a financial
crisis.
example_title: Example 2
- text: >-
summarize: Date: 2008-09-07, Update: The government seizes control of
mortgage giants Fannie Mae and Freddie Mac, promising to inject up to $100
billion into each if they fail. In recent months, the two companies funded
more than two-thirds of all home loans in the United States. Treasury
Secretary Henry Paulson says the government will initially buy
mortgage-backed securities worth up to $5 billion. Date: 2008-09-15,
Update: Lehman Brothers declares bankruptcy, and Bank of America agrees to
buy Merrill Lynch. Despite Wall Street's pleas and concerns about falling
global stocks, the Federal Reserve opts not to raise interest rates. Oil
falls below $100 per barrel. The state of New York has authorized AIG to
use $20 billion from its own insurance subsidiaries to lessen a financial
crisis. Date: 2008-09-16, Update: The federal government lends $85 billion
to insurance giant American International Group in exchange for nearly 80%
of its stock. Lawmakers demand government action and are considering other
dramatic interventions. Lehman Brothers has filed for bankruptcy,
attempting to sell off parts of its business in order to ease the process.
Oil prices have dropped nearly $4.56 per barrel, continuing a two-month
decline from all-time highs. The Dow Jones industrial average goes up on
news that the federal government has agreed to assist AIG.
example_title: Example 3
- text: >-
summarize: Date: 2008-09-07, Update: The government seizes control of
mortgage giants Fannie Mae and Freddie Mac, promising to inject up to $100
billion into each if they fail. In recent months, the two companies funded
more than two-thirds of all home loans in the United States. Treasury
Secretary Henry Paulson says the government will initially buy
mortgage-backed securities worth up to $5 billion. Date: 2008-09-15,
Update: Lehman Brothers declares bankruptcy, and Bank of America agrees to
buy Merrill Lynch. Despite Wall Street's pleas and concerns about falling
global stocks, the Federal Reserve opts not to raise interest rates. Oil
falls below $100 per barrel. The state of New York has authorized AIG to
use $20 billion from its own insurance subsidiaries to lessen a financial
crisis. Date: 2008-09-16, Update: The federal government lends $85 billion
to insurance giant American International Group in exchange for nearly 80%
of its stock. Lawmakers demand government action and are considering other
dramatic interventions. Lehman Brothers has filed for bankruptcy,
attempting to sell off parts of its business in order to ease the process.
Oil prices have dropped nearly $4.56 per barrel, continuing a two-month
decline from all-time highs. The Dow Jones industrial average goes up on
news that the federal government has agreed to assist AIG. Date:
2008-09-17, Update: When banks abruptly stop lending to one another, cash
becomes scarce, raising the cost of capital. Washington Mutual decides to
sell itself. Morgan Stanley and Goldman Sachs both saw their stock prices
fall by 24 and 14 percent, respectively. Morgan Stanley and Wachovia have
begun merger discussions. The price of gold rises by more than 8%. The AIG
takeover bothers investors, causing markets to suffer significant losses.
The Securities and Exchange Commission (SEC) adopts new rules prohibiting
abusive 'naked short-selling.'
example_title: Example 4
- text: >-
summarize: Date: 2008-09-15, Update: Lehman Brothers declares bankruptcy,
and Bank of America agrees to buy Merrill Lynch. Despite Wall Street's
pleas and concerns about falling global stocks, the Federal Reserve opts
not to raise interest rates. Oil falls below $100 per barrel. The state of
New York has authorized AIG to use $20 billion from its own insurance
subsidiaries to lessen a financial crisis. Date: 2008-09-16, Update: The
federal government lends $85 billion to insurance giant American
International Group in exchange for nearly 80% of its stock. Lawmakers
demand government action and are considering other dramatic interventions.
Lehman Brothers has filed for bankruptcy, attempting to sell off parts of
its business in order to ease the process. Oil prices have dropped nearly
$4.56 per barrel, continuing a two-month decline from all-time highs. The
Dow Jones industrial average goes up on news that the federal government
has agreed to assist AIG. Date: 2008-09-17, Update: When banks abruptly
stop lending to one another, cash becomes scarce, raising the cost of
capital. Washington Mutual decides to sell itself. Morgan Stanley and
Goldman Sachs both saw their stock prices fall by 24 and 14 percent,
respectively. Morgan Stanley and Wachovia have begun merger discussions.
The price of gold rises by more than 8%. The AIG takeover bothers
investors, causing markets to suffer significant losses. The Securities
and Exchange Commission (SEC) adopts new rules prohibiting abusive 'naked
short-selling'. Date: 2008-09-18, Update: To help mitigate the cash
crunch, the Federal Government and central banks in Europe, Japan, and
Canada join forces to inject $180 billion into global markets, while
investors withdraw $80 billion from money market funds. The Bush
administration is busily preparing a massive rescue plan to revive the US
financial system by acquiring bad debts and choking financial
institutions' books. Stocks swung back and forth, ending on a high note as
word spread of the US plan to address the crisis. Putnam Investments
closes a $12.3 billion money-market fund in order to contain its
investors' losses.
example_title: Example 5
background-summaries-flan-t5-large
This model is a fine-tuned version of google/flan-t5-xl on the hf_dataset_script dataset. It achieves the following results on the evaluation set:
- Loss: 2.1489
- Rouge1: 43.0
- Rouge2: 20.2
- Rougel: 28.9
- Rougelsum: 39.5
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 1e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- distributed_type: multi-GPU
- num_devices: 2
- total_train_batch_size: 16
- total_eval_batch_size: 16
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 10
Training results
| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum |
|---|---|---|---|---|---|---|---|
| No log | 1.0 | 45 | 1.7449 | 37.9 | 17.2 | 25.4 | 34.5 |
| No log | 2.0 | 90 | 1.7964 | 40.8 | 19.0 | 27.5 | 37.3 |
| No log | 3.0 | 135 | 1.8705 | 39.5 | 18.2 | 26.7 | 36.1 |
| No log | 4.0 | 180 | 1.9253 | 40.1 | 18.7 | 27.0 | 36.6 |
| No log | 5.0 | 225 | 1.9471 | 41.8 | 19.6 | 28.0 | 38.4 |
| No log | 6.0 | 270 | 2.0004 | 42.5 | 20.0 | 28.5 | 39.0 |
| No log | 7.0 | 315 | 1.9927 | 43.2 | 20.6 | 29.1 | 39.7 |
| No log | 8.0 | 360 | 2.0119 | 42.6 | 20.4 | 28.8 | 39.1 |
| No log | 9.0 | 405 | 2.0653 | 42.7 | 20.3 | 28.7 | 39.1 |
| No log | 10.0 | 450 | 2.1489 | 43.0 | 20.2 | 28.9 | 39.5 |
Framework versions
- Transformers 4.27.4
- Pytorch 2.0.0+cu118
- Datasets 2.11.0
- Tokenizers 0.13.3