atomwalk12
commited on
Commit
•
c5e70ea
1
Parent(s):
0eeba1e
Update README.md
Browse files
README.md
CHANGED
@@ -1,2 +1,20 @@
|
|
1 |
# Description
|
2 |
A Blip-2 classifier fine-tuned for classification tasks on the EasyVQA dataset. See the [github repository](https://github.com/atomwalk12/VisualQA/).
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
# Description
|
2 |
A Blip-2 classifier fine-tuned for classification tasks on the EasyVQA dataset. See the [github repository](https://github.com/atomwalk12/VisualQA/).
|
3 |
+
|
4 |
+
If you decide to reuse this model, here are the LoRa and bnb configurations that were used for training:
|
5 |
+
|
6 |
+
```python
|
7 |
+
BitsAndBytesConfig(
|
8 |
+
load_in_4bit=True,
|
9 |
+
bnb_4bit_quant_type="nf4",
|
10 |
+
bnb_4bit_compute_dtype=torch.float32,
|
11 |
+
)
|
12 |
+
|
13 |
+
LoraConfig(
|
14 |
+
r=8,
|
15 |
+
lora_alpha=8,
|
16 |
+
lora_dropout=0.1,
|
17 |
+
target_modules="all-linear",
|
18 |
+
init_lora_weights="gaussian",
|
19 |
+
)
|
20 |
+
```
|