README.md

---
license: apache-2.0
base_model: google/flan-t5-xl
tags:
- generated_from_trainer
datasets:
- adithya7/background-summaries
metrics:
- rouge
model-index:
- name: '2023_12_18_08_41_35'
  results:
  - task:
      name: Sequence-to-sequence Language Modeling
      type: text2text-generation
    dataset:
      name: background_summ
      type: background_summ
      config: background-summ
      split: validation
      args: background-summ
    metrics:
    - name: Rouge1
      type: rouge
      value: 43.0
widget:
- text: "summarize:  Date: 2008-09-07, Update: The government seizes control of mortgage giants Fannie Mae and Freddie Mac, promising to inject up to $100 billion into each if they fail. In recent months, the two companies funded more than two-thirds of all home loans in the United States. Treasury Secretary Henry Paulson says the government will initially buy mortgage-backed securities worth up to $5 billion."
  example_title: "Example 1"
- text: "summarize:  Date: 2008-09-07, Update: The government seizes control of mortgage giants Fannie Mae and Freddie Mac, promising to inject up to $100 billion into each if they fail. In recent months, the two companies funded more than two-thirds of all home loans in the United States. Treasury Secretary Henry Paulson says the government will initially buy mortgage-backed securities worth up to $5 billion. Date: 2008-09-15, Update: Lehman Brothers declares bankruptcy, and Bank of America agrees to buy Merrill Lynch. Despite Wall Street's pleas and concerns about falling global stocks, the Federal Reserve opts not to raise interest rates. Oil falls below $100 per barrel. The state of New York has authorized AIG to use $20 billion from its own insurance subsidiaries to lessen a financial crisis."
  example_title: "Example 2"
- text: "summarize:  Date: 2008-09-07, Update: The government seizes control of mortgage giants Fannie Mae and Freddie Mac, promising to inject up to $100 billion into each if they fail. In recent months, the two companies funded more than two-thirds of all home loans in the United States. Treasury Secretary Henry Paulson says the government will initially buy mortgage-backed securities worth up to $5 billion. Date: 2008-09-15, Update: Lehman Brothers declares bankruptcy, and Bank of America agrees to buy Merrill Lynch. Despite Wall Street's pleas and concerns about falling global stocks, the Federal Reserve opts not to raise interest rates. Oil falls below $100 per barrel. The state of New York has authorized AIG to use $20 billion from its own insurance subsidiaries to lessen a financial crisis. Date: 2008-09-16, Update: The federal government lends $85 billion to insurance giant American International Group in exchange for nearly 80% of its stock. Lawmakers demand government action and are considering other dramatic interventions. Lehman Brothers has filed for bankruptcy, attempting to sell off parts of its business in order to ease the process. Oil prices have dropped nearly $4.56 per barrel, continuing a two-month decline from all-time highs. The Dow Jones industrial average goes up on news that the federal government has agreed to assist AIG."
  example_title: "Example 3"
- text: "summarize:  Date: 2008-09-07, Update: The government seizes control of mortgage giants Fannie Mae and Freddie Mac, promising to inject up to $100 billion into each if they fail. In recent months, the two companies funded more than two-thirds of all home loans in the United States. Treasury Secretary Henry Paulson says the government will initially buy mortgage-backed securities worth up to $5 billion. Date: 2008-09-15, Update: Lehman Brothers declares bankruptcy, and Bank of America agrees to buy Merrill Lynch. Despite Wall Street's pleas and concerns about falling global stocks, the Federal Reserve opts not to raise interest rates. Oil falls below $100 per barrel. The state of New York has authorized AIG to use $20 billion from its own insurance subsidiaries to lessen a financial crisis. Date: 2008-09-16, Update: The federal government lends $85 billion to insurance giant American International Group in exchange for nearly 80% of its stock. Lawmakers demand government action and are considering other dramatic interventions. Lehman Brothers has filed for bankruptcy, attempting to sell off parts of its business in order to ease the process. Oil prices have dropped nearly $4.56 per barrel, continuing a two-month decline from all-time highs. The Dow Jones industrial average goes up on news that the federal government has agreed to assist AIG. Date: 2008-09-17, Update: When banks abruptly stop lending to one another, cash becomes scarce, raising the cost of capital. Washington Mutual decides to sell itself. Morgan Stanley and Goldman Sachs both saw their stock prices fall by 24 and 14 percent, respectively. Morgan Stanley and Wachovia have begun merger discussions. The price of gold rises by more than 8%. The AIG takeover bothers investors, causing markets to suffer significant losses. The Securities and Exchange Commission (SEC) adopts new rules prohibiting abusive 'naked short-selling.'"
  example_title: "Example 4"
- text: "summarize:  Date: 2008-09-15, Update: Lehman Brothers declares bankruptcy, and Bank of America agrees to buy Merrill Lynch. Despite Wall Street's pleas and concerns about falling global stocks, the Federal Reserve opts not to raise interest rates. Oil falls below $100 per barrel. The state of New York has authorized AIG to use $20 billion from its own insurance subsidiaries to lessen a financial crisis. Date: 2008-09-16, Update: The federal government lends $85 billion to insurance giant American International Group in exchange for nearly 80% of its stock. Lawmakers demand government action and are considering other dramatic interventions. Lehman Brothers has filed for bankruptcy, attempting to sell off parts of its business in order to ease the process. Oil prices have dropped nearly $4.56 per barrel, continuing a two-month decline from all-time highs. The Dow Jones industrial average goes up on news that the federal government has agreed to assist AIG. Date: 2008-09-17, Update: When banks abruptly stop lending to one another, cash becomes scarce, raising the cost of capital. Washington Mutual decides to sell itself. Morgan Stanley and Goldman Sachs both saw their stock prices fall by 24 and 14 percent, respectively. Morgan Stanley and Wachovia have begun merger discussions. The price of gold rises by more than 8%. The AIG takeover bothers investors, causing markets to suffer significant losses. The Securities and Exchange Commission (SEC) adopts new rules prohibiting abusive 'naked short-selling'. Date: 2008-09-18, Update: To help mitigate the cash crunch, the Federal Government and central banks in Europe, Japan, and Canada join forces to inject $180 billion into global markets, while investors withdraw $80 billion from money market funds. The Bush administration is busily preparing a massive rescue plan to revive the US financial system by acquiring bad debts and choking financial institutions' books. Stocks swung back and forth, ending on a high note as word spread of the US plan to address the crisis. Putnam Investments closes a $12.3 billion money-market fund in order to contain its investors' losses."
  example_title: "Example 5"
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# background-summaries-flan-t5-large

This model is a fine-tuned version of [google/flan-t5-xl](https://huggingface.co/google/flan-t5-xl) on the hf_dataset_script dataset.
It achieves the following results on the evaluation set:
- Loss: 2.1489
- Rouge1: 43.0
- Rouge2: 20.2
- Rougel: 28.9
- Rougelsum: 39.5

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 1e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- distributed_type: multi-GPU
- num_devices: 2
- total_train_batch_size: 16
- total_eval_batch_size: 16
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 10

### Training results

| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum |
|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|
| No log        | 1.0   | 45   | 1.7449          | 37.9   | 17.2   | 25.4   | 34.5      |
| No log        | 2.0   | 90   | 1.7964          | 40.8   | 19.0   | 27.5   | 37.3      |
| No log        | 3.0   | 135  | 1.8705          | 39.5   | 18.2   | 26.7   | 36.1      |
| No log        | 4.0   | 180  | 1.9253          | 40.1   | 18.7   | 27.0   | 36.6      |
| No log        | 5.0   | 225  | 1.9471          | 41.8   | 19.6   | 28.0   | 38.4      |
| No log        | 6.0   | 270  | 2.0004          | 42.5   | 20.0   | 28.5   | 39.0      |
| No log        | 7.0   | 315  | 1.9927          | 43.2   | 20.6   | 29.1   | 39.7      |
| No log        | 8.0   | 360  | 2.0119          | 42.6   | 20.4   | 28.8   | 39.1      |
| No log        | 9.0   | 405  | 2.0653          | 42.7   | 20.3   | 28.7   | 39.1      |
| No log        | 10.0  | 450  | 2.1489          | 43.0   | 20.2   | 28.9   | 39.5      |


### Framework versions

- Transformers 4.27.4
- Pytorch 2.0.0+cu118
- Datasets 2.11.0
- Tokenizers 0.13.3