Adapters
t5
File size: 1,374 Bytes
a99269a
 
 
83ed8d5
a99269a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
---
tags:
- adapter-transformers
- t5
datasets:
- minh21/cpgQA-v1.0-unique-context-test-10-percent-validation-10-percent
---

# Adapter `legacy107/adapter-flan-t5-large-bottleneck-adapter-cpgQA` for google/flan-t5-large

An [adapter](https://adapterhub.ml) for the `google/flan-t5-large` model that was trained on the [minh21/cpgQA-v1.0-unique-context-test-10-percent-validation-10-percent](https://huggingface.co/datasets/minh21/cpgQA-v1.0-unique-context-test-10-percent-validation-10-percent/) dataset.

This adapter was created for usage with the **[adapter-transformers](https://github.com/Adapter-Hub/adapter-transformers)** library.

## Usage

First, install `adapter-transformers`:

```
pip install -U adapter-transformers
```
_Note: adapter-transformers is a fork of transformers that acts as a drop-in replacement with adapter support. [More](https://docs.adapterhub.ml/installation.html)_

Now, the adapter can be loaded and activated like this:

```python
from transformers import AutoAdapterModel

model = AutoAdapterModel.from_pretrained("google/flan-t5-large")
adapter_name = model.load_adapter("legacy107/adapter-flan-t5-large-bottleneck-adapter-cpgQA", source="hf", set_active=True)
```

## Architecture & Training

<!-- Add some description here -->

## Evaluation results

<!-- Add some description here -->

## Citation

<!-- Add some description here -->