atomwalk12 commited on
Commit
c5e70ea
1 Parent(s): 0eeba1e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -0
README.md CHANGED
@@ -1,2 +1,20 @@
1
  # Description
2
  A Blip-2 classifier fine-tuned for classification tasks on the EasyVQA dataset. See the [github repository](https://github.com/atomwalk12/VisualQA/).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  # Description
2
  A Blip-2 classifier fine-tuned for classification tasks on the EasyVQA dataset. See the [github repository](https://github.com/atomwalk12/VisualQA/).
3
+
4
+ If you decide to reuse this model, here are the LoRa and bnb configurations that were used for training:
5
+
6
+ ```python
7
+ BitsAndBytesConfig(
8
+ load_in_4bit=True,
9
+ bnb_4bit_quant_type="nf4",
10
+ bnb_4bit_compute_dtype=torch.float32,
11
+ )
12
+
13
+ LoraConfig(
14
+ r=8,
15
+ lora_alpha=8,
16
+ lora_dropout=0.1,
17
+ target_modules="all-linear",
18
+ init_lora_weights="gaussian",
19
+ )
20
+ ```