NikshepShetty commited on
Commit
542c935
·
verified ·
1 Parent(s): 4cd1b29

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -12
README.md CHANGED
@@ -21,15 +21,15 @@ model-index:
21
  type: other
22
  metrics:
23
  - type: meteor
24
- value: 0.261
25
  - type: bleu
26
- value: 0.208
27
  - type: cider
28
- value: 0.072
29
  - type: capture
30
- value: 0.565
31
  - type: rouge-l
32
- value: 0.280
33
  ---
34
  # Florence-2 DOCCI-FT LoRA Adapter
35
 
@@ -81,14 +81,15 @@ Note: Make sure you have the required libraries installed: transformers, peft, e
81
 
82
  ## Evaluation results
83
 
84
- Our LoRA adapter shows significant improvements over the base Florence-2 model across all metrics for MORE_DETAILED_CAPTION tag:
85
 
86
  | Metric | Base Model | Adapted Model | Improvement |
87
  |---------|------------|---------------|-------------|
88
- | METEOR | 0.205 | 0.261 | +27.3% |
89
- | BLEU | 0.124 | 0.208 | +67.7% |
90
- | CIDEr | 0.023 | 0.072 | +213.0% |
91
- | CAPTURE | 0.529 | 0.565 | +6.8% |
92
- | ROUGE-L | 0.265 | 0.280 | +5.7% |
93
 
94
- These results demonstrate that our LoRA adapter significantly enhances the image captioning capabilities of the Florence-2 base model, particularly in generating more detailed and accurate captions.
 
 
21
  type: other
22
  metrics:
23
  - type: meteor
24
+ value: 0.267
25
  - type: bleu
26
+ value: 0.185
27
  - type: cider
28
+ value: 0.086
29
  - type: capture
30
+ value: 0.576
31
  - type: rouge-l
32
+ value: 0.287
33
  ---
34
  # Florence-2 DOCCI-FT LoRA Adapter
35
 
 
81
 
82
  ## Evaluation results
83
 
84
+ Our LoRA adapter shows improvements over the base Florence-2 model across all metrics for MORE_DETAILED_CAPTION tag for 1000 images on the foundation-multimodal-models/DetailCaps-4870 dataset:
85
 
86
  | Metric | Base Model | Adapted Model | Improvement |
87
  |---------|------------|---------------|-------------|
88
+ | METEOR | 0.213 | 0.267 | +25.4% |
89
+ | BLEU | 0.110 | 0.185 | +68.2% |
90
+ | CIDEr | 0.031 | 0.086 | +177.4% |
91
+ | CAPTURE | 0.546 | 0.576 | +5.5% |
92
+ | ROUGE-L | 0.275 | 0.287 | +4.4% |
93
 
94
+
95
+ These results demonstrate that our LoRA adapter enhances the image captioning capabilities of the Florence-2 base model, particularly in generating more detailed and accurate captions.