File size: 102,010 Bytes
02c45be
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4c3267b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
02c45be
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4c3267b
 
02c45be
 
 
 
 
4c3267b
02c45be
 
 
4c3267b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
02c45be
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
---
tags:
- generated_from_trainer
model-index:
- name: fine_tuning_results
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# fine_tuning_results

This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.7488
- Accuracy Is there a call to go online (e.g., shop online, visit the web)? : 0.2333
- Precision Is there a call to go online (e.g., shop online, visit the web)? : 0.2333
- Recall Is there a call to go online (e.g., shop online, visit the web)? : 1.0
- F1 Is there a call to go online (e.g., shop online, visit the web)? : 0.3784
- Accuracy Is there online contact information provided (e.g., url, website)? : 0.4333
- Precision Is there online contact information provided (e.g., url, website)? : 0.4333
- Recall Is there online contact information provided (e.g., url, website)? : 1.0
- F1 Is there online contact information provided (e.g., url, website)? : 0.6047
- Accuracy Is there a visual or verbal call to purchase (e.g., buy now, order now)?: 0.3333
- Precision Is there a visual or verbal call to purchase (e.g., buy now, order now)?: 0.3333
- Recall Is there a visual or verbal call to purchase (e.g., buy now, order now)?: 1.0
- F1 Is there a visual or verbal call to purchase (e.g., buy now, order now)?: 0.5
- Accuracy Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? : 0.1333
- Precision Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? : 0.1333
- Recall Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? : 1.0
- F1 Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? : 0.2353
- Accuracy Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? : 0.3333
- Precision Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? : 0.3333
- Recall Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? : 1.0
- F1 Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? : 0.5
- Accuracy Is there offline contact information provided (e.g., phone, mail, store location)?: 0.1333
- Precision Is there offline contact information provided (e.g., phone, mail, store location)?: 0.1333
- Recall Is there offline contact information provided (e.g., phone, mail, store location)?: 1.0
- F1 Is there offline contact information provided (e.g., phone, mail, store location)?: 0.2353
- Accuracy Is there mention of something free? : 0.0333
- Precision Is there mention of something free? : 0.0333
- Recall Is there mention of something free? : 1.0
- F1 Is there mention of something free? : 0.0645
- Accuracy Does the ad mention at least one specific product or service (e.g., model, type, item)? : 0.8
- Precision Does the ad mention at least one specific product or service (e.g., model, type, item)? : 0.8
- Recall Does the ad mention at least one specific product or service (e.g., model, type, item)? : 1.0
- F1 Does the ad mention at least one specific product or service (e.g., model, type, item)? : 0.8889
- Accuracy Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times?

for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included.: 0.9
- Precision Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times?

for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included.: 0.9
- Recall Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times?

for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included.: 1.0
- F1 Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times?

for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included.: 0.9474
- Accuracy Does the ad show the brand or trademark exactly once at the end of the ad?: 0.9
- Precision Does the ad show the brand or trademark exactly once at the end of the ad?: 0.9
- Recall Does the ad show the brand or trademark exactly once at the end of the ad?: 1.0
- F1 Does the ad show the brand or trademark exactly once at the end of the ad?: 0.9474
- Accuracy Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.): 0.7667
- Precision Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.): 0.7667
- Recall Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.): 1.0
- F1 Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.): 0.8679
- Accuracy Does the ad give you a positive feeling about the brand? : 0.8333
- Precision Does the ad give you a positive feeling about the brand? : 0.8333
- Recall Does the ad give you a positive feeling about the brand? : 1.0
- F1 Does the ad give you a positive feeling about the brand? : 0.9091
- Accuracy Does the ad have a story arc, with a beginning and an end? : 0.2667
- Precision Does the ad have a story arc, with a beginning and an end? : 0.2667
- Recall Does the ad have a story arc, with a beginning and an end? : 1.0
- F1 Does the ad have a story arc, with a beginning and an end? : 0.4211
- Accuracy Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse?: 0.1
- Precision Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse?: 0.1
- Recall Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse?: 1.0
- F1 Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse?: 0.1818
- Accuracy Does the ad have relatable characters? : 0.4333
- Precision Does the ad have relatable characters? : 0.4333
- Recall Does the ad have relatable characters? : 1.0
- F1 Does the ad have relatable characters? : 0.6047
- Accuracy Is the ad creative/clever?: 0.7
- Precision Is the ad creative/clever?: 0.7
- Recall Is the ad creative/clever?: 1.0
- F1 Is the ad creative/clever?: 0.8235
- Accuracy Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) : 0.2667
- Precision Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) : 0.2667
- Recall Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) : 1.0
- F1 Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) : 0.4211
- Accuracy Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? : 0.6333
- Precision Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? : 0.6333
- Recall Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? : 1.0
- F1 Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? : 0.7755
- Accuracy Is the ad visually pleasing?: 0.7667
- Precision Is the ad visually pleasing?: 0.7667
- Recall Is the ad visually pleasing?: 1.0
- F1 Is the ad visually pleasing?: 0.8679
- Accuracy Does the ad have cute elements like animals, babies, animated, characters, etc?: 0.1333
- Precision Does the ad have cute elements like animals, babies, animated, characters, etc?: 0.1333
- Recall Does the ad have cute elements like animals, babies, animated, characters, etc?: 1.0
- F1 Does the ad have cute elements like animals, babies, animated, characters, etc?: 0.2353
- Accuracy Was there a famous person in this ad? : 0.2
- Precision Was there a famous person in this ad? : 0.2
- Recall Was there a famous person in this ad? : 1.0
- F1 Was there a famous person in this ad? : 0.3333
- Accuracy Mean: 0.4444
- Precision Mean: 0.4444
- Recall Mean: 1.0
- F1 Mean: 0.5592

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.00020308452008637912
- train_batch_size: 30
- eval_batch_size: 32
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 100
- num_epochs: 9

### Training results

| Training Loss | Epoch | Step | Validation Loss | Accuracy Is there a call to go online (e.g., shop online, visit the web)?  | Precision Is there a call to go online (e.g., shop online, visit the web)?  | Recall Is there a call to go online (e.g., shop online, visit the web)?  | F1 Is there a call to go online (e.g., shop online, visit the web)?  | Accuracy Is there online contact information provided (e.g., url, website)?  | Precision Is there online contact information provided (e.g., url, website)?  | Recall Is there online contact information provided (e.g., url, website)?  | F1 Is there online contact information provided (e.g., url, website)?  | Accuracy Is there a visual or verbal call to purchase (e.g., buy now, order now)? | Precision Is there a visual or verbal call to purchase (e.g., buy now, order now)? | Recall Is there a visual or verbal call to purchase (e.g., buy now, order now)? | F1 Is there a visual or verbal call to purchase (e.g., buy now, order now)? | Accuracy Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)?  | Precision Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)?  | Recall Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)?  | F1 Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)?  | Accuracy Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")?  | Precision Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")?  | Recall Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")?  | F1 Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")?  | Accuracy Is there offline contact information provided (e.g., phone, mail, store location)? | Precision Is there offline contact information provided (e.g., phone, mail, store location)? | Recall Is there offline contact information provided (e.g., phone, mail, store location)? | F1 Is there offline contact information provided (e.g., phone, mail, store location)? | Accuracy Is there mention of something free?  | Precision Is there mention of something free?  | Recall Is there mention of something free?  | F1 Is there mention of something free?  | Accuracy Does the ad mention at least one specific product or service (e.g., model, type, item)?  | Precision Does the ad mention at least one specific product or service (e.g., model, type, item)?  | Recall Does the ad mention at least one specific product or service (e.g., model, type, item)?  | F1 Does the ad mention at least one specific product or service (e.g., model, type, item)?  | Accuracy Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times?

for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included. | Precision Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times?

for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included. | Recall Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times?

for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included. | F1 Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times?

for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included. | Accuracy Does the ad show the brand or trademark exactly once at the end of the ad? | Precision Does the ad show the brand or trademark exactly once at the end of the ad? | Recall Does the ad show the brand or trademark exactly once at the end of the ad? | F1 Does the ad show the brand or trademark exactly once at the end of the ad? | Accuracy Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.) | Precision Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.) | Recall Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.) | F1 Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.) | Accuracy Does the ad give you a positive feeling about the brand?  | Precision Does the ad give you a positive feeling about the brand?  | Recall Does the ad give you a positive feeling about the brand?  | F1 Does the ad give you a positive feeling about the brand?  | Accuracy Does the ad have a story arc, with a beginning and an end?  | Precision Does the ad have a story arc, with a beginning and an end?  | Recall Does the ad have a story arc, with a beginning and an end?  | F1 Does the ad have a story arc, with a beginning and an end?  | Accuracy Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse? | Precision Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse? | Recall Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse? | F1 Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse? | Accuracy Does the ad have relatable characters?  | Precision Does the ad have relatable characters?  | Recall Does the ad have relatable characters?  | F1 Does the ad have relatable characters?  | Accuracy Is the ad creative/clever? | Precision Is the ad creative/clever? | Recall Is the ad creative/clever? | F1 Is the ad creative/clever? | Accuracy Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.)  | Precision Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.)  | Recall Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.)  | F1 Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.)  | Accuracy Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)?  | Precision Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)?  | Recall Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)?  | F1 Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)?  | Accuracy Is the ad visually pleasing? | Precision Is the ad visually pleasing? | Recall Is the ad visually pleasing? | F1 Is the ad visually pleasing? | Accuracy Does the ad have cute elements like animals, babies, animated, characters, etc? | Precision Does the ad have cute elements like animals, babies, animated, characters, etc? | Recall Does the ad have cute elements like animals, babies, animated, characters, etc? | F1 Does the ad have cute elements like animals, babies, animated, characters, etc? | Accuracy Was there a famous person in this ad?  | Precision Was there a famous person in this ad?  | Recall Was there a famous person in this ad?  | F1 Was there a famous person in this ad?  | Accuracy Mean | Precision Mean | Recall Mean | F1 Mean |
|:-------------:|:-----:|:----:|:---------------:|:--------------------------------------------------------------------------:|:---------------------------------------------------------------------------:|:------------------------------------------------------------------------:|:--------------------------------------------------------------------:|:----------------------------------------------------------------------------:|:-----------------------------------------------------------------------------:|:--------------------------------------------------------------------------:|:----------------------------------------------------------------------:|:---------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------:|:---------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------:|:---------------------------------------------:|:----------------------------------------------:|:-------------------------------------------:|:---------------------------------------:|:-------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------:|:-------------------------------------------------------------------:|:----------------------------------------------------------------:|:------------------------------------------------------------:|:--------------------------------------------------------------------:|:---------------------------------------------------------------------:|:------------------------------------------------------------------:|:--------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------:|:------------------------------------------------:|:-------------------------------------------------:|:----------------------------------------------:|:------------------------------------------:|:-----------------------------------:|:------------------------------------:|:---------------------------------:|:-----------------------------:|:---------------------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------:|:-------------------------------------:|:--------------------------------------:|:-----------------------------------:|:-------------------------------:|:----------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------:|:-----------------------------------------------:|:------------------------------------------------:|:---------------------------------------------:|:-----------------------------------------:|:-------------:|:--------------:|:-----------:|:-------:|
| No log        | 1.0   | 4    | 0.7488          | 0.2333                                                                     | 0.2333                                                                      | 1.0                                                                      | 0.3784                                                               | 0.4333                                                                       | 0.4333                                                                        | 1.0                                                                        | 0.6047                                                                 | 0.3333                                                                            | 0.3333                                                                             | 1.0                                                                             | 0.5                                                                         | 0.1333                                                                                                    | 0.1333                                                                                                     | 1.0                                                                                                     | 0.2353                                                                                              | 0.3333                                                                                               | 0.3333                                                                                                | 1.0                                                                                                | 0.5                                                                                            | 0.1333                                                                                      | 0.1333                                                                                       | 1.0                                                                                       | 0.2353                                                                                | 0.0333                                        | 0.0333                                         | 1.0                                         | 0.0645                                  | 0.8                                                                                               | 0.8                                                                                                | 1.0                                                                                             | 0.8889                                                                                      | 0.9                                                                                                                                                                                                                                                                                                                                  | 0.9                                                                                                                                                                                                                                                                                                                                   | 1.0                                                                                                                                                                                                                                                                                                                                | 0.9474                                                                                                                                                                                                                                                                                                                         | 0.9                                                                                 | 0.9                                                                                  | 1.0                                                                               | 0.9474                                                                        | 0.7667                                                                                                                                                                                                                                         | 0.7667                                                                                                                                                                                                                                          | 1.0                                                                                                                                                                                                                                          | 0.8679                                                                                                                                                                                                                                   | 0.8333                                                             | 0.8333                                                              | 1.0                                                              | 0.9091                                                       | 0.2667                                                               | 0.2667                                                                | 1.0                                                                | 0.4211                                                         | 0.1                                                                                                                | 0.1                                                                                                                 | 1.0                                                                                                              | 0.1818                                                                                                       | 0.4333                                           | 0.4333                                            | 1.0                                            | 0.6047                                     | 0.7                                 | 0.7                                  | 1.0                               | 0.8235                        | 0.2667                                                                                                                | 0.2667                                                                                                                 | 1.0                                                                                                                 | 0.4211                                                                                                          | 0.6333                                                                                                   | 0.6333                                                                                                    | 1.0                                                                                                    | 0.7755                                                                                             | 0.7667                                | 0.7667                                 | 1.0                                 | 0.8679                          | 0.1333                                                                                   | 0.1333                                                                                    | 1.0                                                                                    | 0.2353                                                                             | 0.2                                             | 0.2                                              | 1.0                                           | 0.3333                                    | 0.4444        | 0.4444         | 1.0         | 0.5592  |
| No log        | 2.0   | 8    | 0.7488          | 0.2333                                                                     | 0.2333                                                                      | 1.0                                                                      | 0.3784                                                               | 0.4333                                                                       | 0.4333                                                                        | 1.0                                                                        | 0.6047                                                                 | 0.3333                                                                            | 0.3333                                                                             | 1.0                                                                             | 0.5                                                                         | 0.1333                                                                                                    | 0.1333                                                                                                     | 1.0                                                                                                     | 0.2353                                                                                              | 0.3333                                                                                               | 0.3333                                                                                                | 1.0                                                                                                | 0.5                                                                                            | 0.1333                                                                                      | 0.1333                                                                                       | 1.0                                                                                       | 0.2353                                                                                | 0.0333                                        | 0.0333                                         | 1.0                                         | 0.0645                                  | 0.8                                                                                               | 0.8                                                                                                | 1.0                                                                                             | 0.8889                                                                                      | 0.9                                                                                                                                                                                                                                                                                                                                  | 0.9                                                                                                                                                                                                                                                                                                                                   | 1.0                                                                                                                                                                                                                                                                                                                                | 0.9474                                                                                                                                                                                                                                                                                                                         | 0.9                                                                                 | 0.9                                                                                  | 1.0                                                                               | 0.9474                                                                        | 0.7667                                                                                                                                                                                                                                         | 0.7667                                                                                                                                                                                                                                          | 1.0                                                                                                                                                                                                                                          | 0.8679                                                                                                                                                                                                                                   | 0.8333                                                             | 0.8333                                                              | 1.0                                                              | 0.9091                                                       | 0.2667                                                               | 0.2667                                                                | 1.0                                                                | 0.4211                                                         | 0.1                                                                                                                | 0.1                                                                                                                 | 1.0                                                                                                              | 0.1818                                                                                                       | 0.4333                                           | 0.4333                                            | 1.0                                            | 0.6047                                     | 0.7                                 | 0.7                                  | 1.0                               | 0.8235                        | 0.2667                                                                                                                | 0.2667                                                                                                                 | 1.0                                                                                                                 | 0.4211                                                                                                          | 0.6333                                                                                                   | 0.6333                                                                                                    | 1.0                                                                                                    | 0.7755                                                                                             | 0.7667                                | 0.7667                                 | 1.0                                 | 0.8679                          | 0.1333                                                                                   | 0.1333                                                                                    | 1.0                                                                                    | 0.2353                                                                             | 0.2                                             | 0.2                                              | 1.0                                           | 0.3333                                    | 0.4444        | 0.4444         | 1.0         | 0.5592  |
| 0.7357        | 3.0   | 12   | 0.7486          | 0.2333                                                                     | 0.2333                                                                      | 1.0                                                                      | 0.3784                                                               | 0.4333                                                                       | 0.4333                                                                        | 1.0                                                                        | 0.6047                                                                 | 0.3333                                                                            | 0.3333                                                                             | 1.0                                                                             | 0.5                                                                         | 0.1333                                                                                                    | 0.1333                                                                                                     | 1.0                                                                                                     | 0.2353                                                                                              | 0.3333                                                                                               | 0.3333                                                                                                | 1.0                                                                                                | 0.5                                                                                            | 0.1333                                                                                      | 0.1333                                                                                       | 1.0                                                                                       | 0.2353                                                                                | 0.0333                                        | 0.0333                                         | 1.0                                         | 0.0645                                  | 0.8                                                                                               | 0.8                                                                                                | 1.0                                                                                             | 0.8889                                                                                      | 0.9                                                                                                                                                                                                                                                                                                                                  | 0.9                                                                                                                                                                                                                                                                                                                                   | 1.0                                                                                                                                                                                                                                                                                                                                | 0.9474                                                                                                                                                                                                                                                                                                                         | 0.9                                                                                 | 0.9                                                                                  | 1.0                                                                               | 0.9474                                                                        | 0.7667                                                                                                                                                                                                                                         | 0.7667                                                                                                                                                                                                                                          | 1.0                                                                                                                                                                                                                                          | 0.8679                                                                                                                                                                                                                                   | 0.8333                                                             | 0.8333                                                              | 1.0                                                              | 0.9091                                                       | 0.2667                                                               | 0.2667                                                                | 1.0                                                                | 0.4211                                                         | 0.1                                                                                                                | 0.1                                                                                                                 | 1.0                                                                                                              | 0.1818                                                                                                       | 0.4333                                           | 0.4333                                            | 1.0                                            | 0.6047                                     | 0.7                                 | 0.7                                  | 1.0                               | 0.8235                        | 0.2667                                                                                                                | 0.2667                                                                                                                 | 1.0                                                                                                                 | 0.4211                                                                                                          | 0.6333                                                                                                   | 0.6333                                                                                                    | 1.0                                                                                                    | 0.7755                                                                                             | 0.7667                                | 0.7667                                 | 1.0                                 | 0.8679                          | 0.1333                                                                                   | 0.1333                                                                                    | 1.0                                                                                    | 0.2353                                                                             | 0.2                                             | 0.2                                              | 1.0                                           | 0.3333                                    | 0.4444        | 0.4444         | 1.0         | 0.5592  |
| 0.7357        | 4.0   | 16   | 0.7484          | 0.2333                                                                     | 0.2333                                                                      | 1.0                                                                      | 0.3784                                                               | 0.4333                                                                       | 0.4333                                                                        | 1.0                                                                        | 0.6047                                                                 | 0.3333                                                                            | 0.3333                                                                             | 1.0                                                                             | 0.5                                                                         | 0.1333                                                                                                    | 0.1333                                                                                                     | 1.0                                                                                                     | 0.2353                                                                                              | 0.3333                                                                                               | 0.3333                                                                                                | 1.0                                                                                                | 0.5                                                                                            | 0.1333                                                                                      | 0.1333                                                                                       | 1.0                                                                                       | 0.2353                                                                                | 0.0333                                        | 0.0333                                         | 1.0                                         | 0.0645                                  | 0.8                                                                                               | 0.8                                                                                                | 1.0                                                                                             | 0.8889                                                                                      | 0.9                                                                                                                                                                                                                                                                                                                                  | 0.9                                                                                                                                                                                                                                                                                                                                   | 1.0                                                                                                                                                                                                                                                                                                                                | 0.9474                                                                                                                                                                                                                                                                                                                         | 0.9                                                                                 | 0.9                                                                                  | 1.0                                                                               | 0.9474                                                                        | 0.7667                                                                                                                                                                                                                                         | 0.7667                                                                                                                                                                                                                                          | 1.0                                                                                                                                                                                                                                          | 0.8679                                                                                                                                                                                                                                   | 0.8333                                                             | 0.8333                                                              | 1.0                                                              | 0.9091                                                       | 0.2667                                                               | 0.2667                                                                | 1.0                                                                | 0.4211                                                         | 0.1                                                                                                                | 0.1                                                                                                                 | 1.0                                                                                                              | 0.1818                                                                                                       | 0.4333                                           | 0.4333                                            | 1.0                                            | 0.6047                                     | 0.7                                 | 0.7                                  | 1.0                               | 0.8235                        | 0.2667                                                                                                                | 0.2667                                                                                                                 | 1.0                                                                                                                 | 0.4211                                                                                                          | 0.6333                                                                                                   | 0.6333                                                                                                    | 1.0                                                                                                    | 0.7755                                                                                             | 0.7667                                | 0.7667                                 | 1.0                                 | 0.8679                          | 0.1333                                                                                   | 0.1333                                                                                    | 1.0                                                                                    | 0.2353                                                                             | 0.2                                             | 0.2                                              | 1.0                                           | 0.3333                                    | 0.4444        | 0.4444         | 1.0         | 0.5592  |
| 0.7379        | 5.0   | 20   | 0.7481          | 0.2333                                                                     | 0.2333                                                                      | 1.0                                                                      | 0.3784                                                               | 0.4333                                                                       | 0.4333                                                                        | 1.0                                                                        | 0.6047                                                                 | 0.3333                                                                            | 0.3333                                                                             | 1.0                                                                             | 0.5                                                                         | 0.1333                                                                                                    | 0.1333                                                                                                     | 1.0                                                                                                     | 0.2353                                                                                              | 0.3333                                                                                               | 0.3333                                                                                                | 1.0                                                                                                | 0.5                                                                                            | 0.1333                                                                                      | 0.1333                                                                                       | 1.0                                                                                       | 0.2353                                                                                | 0.0333                                        | 0.0333                                         | 1.0                                         | 0.0645                                  | 0.8                                                                                               | 0.8                                                                                                | 1.0                                                                                             | 0.8889                                                                                      | 0.9                                                                                                                                                                                                                                                                                                                                  | 0.9                                                                                                                                                                                                                                                                                                                                   | 1.0                                                                                                                                                                                                                                                                                                                                | 0.9474                                                                                                                                                                                                                                                                                                                         | 0.9                                                                                 | 0.9                                                                                  | 1.0                                                                               | 0.9474                                                                        | 0.7667                                                                                                                                                                                                                                         | 0.7667                                                                                                                                                                                                                                          | 1.0                                                                                                                                                                                                                                          | 0.8679                                                                                                                                                                                                                                   | 0.8333                                                             | 0.8333                                                              | 1.0                                                              | 0.9091                                                       | 0.2667                                                               | 0.2667                                                                | 1.0                                                                | 0.4211                                                         | 0.1                                                                                                                | 0.1                                                                                                                 | 1.0                                                                                                              | 0.1818                                                                                                       | 0.4333                                           | 0.4333                                            | 1.0                                            | 0.6047                                     | 0.7                                 | 0.7                                  | 1.0                               | 0.8235                        | 0.2667                                                                                                                | 0.2667                                                                                                                 | 1.0                                                                                                                 | 0.4211                                                                                                          | 0.6333                                                                                                   | 0.6333                                                                                                    | 1.0                                                                                                    | 0.7755                                                                                             | 0.7667                                | 0.7667                                 | 1.0                                 | 0.8679                          | 0.1333                                                                                   | 0.1333                                                                                    | 1.0                                                                                    | 0.2353                                                                             | 0.2                                             | 0.2                                              | 1.0                                           | 0.3333                                    | 0.4444        | 0.4444         | 1.0         | 0.5592  |
| 0.7379        | 6.0   | 24   | 0.7478          | 0.2333                                                                     | 0.2333                                                                      | 1.0                                                                      | 0.3784                                                               | 0.4333                                                                       | 0.4333                                                                        | 1.0                                                                        | 0.6047                                                                 | 0.3333                                                                            | 0.3333                                                                             | 1.0                                                                             | 0.5                                                                         | 0.1333                                                                                                    | 0.1333                                                                                                     | 1.0                                                                                                     | 0.2353                                                                                              | 0.3333                                                                                               | 0.3333                                                                                                | 1.0                                                                                                | 0.5                                                                                            | 0.1333                                                                                      | 0.1333                                                                                       | 1.0                                                                                       | 0.2353                                                                                | 0.0333                                        | 0.0333                                         | 1.0                                         | 0.0645                                  | 0.8                                                                                               | 0.8                                                                                                | 1.0                                                                                             | 0.8889                                                                                      | 0.9                                                                                                                                                                                                                                                                                                                                  | 0.9                                                                                                                                                                                                                                                                                                                                   | 1.0                                                                                                                                                                                                                                                                                                                                | 0.9474                                                                                                                                                                                                                                                                                                                         | 0.9                                                                                 | 0.9                                                                                  | 1.0                                                                               | 0.9474                                                                        | 0.7667                                                                                                                                                                                                                                         | 0.7667                                                                                                                                                                                                                                          | 1.0                                                                                                                                                                                                                                          | 0.8679                                                                                                                                                                                                                                   | 0.8333                                                             | 0.8333                                                              | 1.0                                                              | 0.9091                                                       | 0.2667                                                               | 0.2667                                                                | 1.0                                                                | 0.4211                                                         | 0.1                                                                                                                | 0.1                                                                                                                 | 1.0                                                                                                              | 0.1818                                                                                                       | 0.4333                                           | 0.4333                                            | 1.0                                            | 0.6047                                     | 0.7                                 | 0.7                                  | 1.0                               | 0.8235                        | 0.2667                                                                                                                | 0.2667                                                                                                                 | 1.0                                                                                                                 | 0.4211                                                                                                          | 0.6333                                                                                                   | 0.6333                                                                                                    | 1.0                                                                                                    | 0.7755                                                                                             | 0.7667                                | 0.7667                                 | 1.0                                 | 0.8679                          | 0.1333                                                                                   | 0.1333                                                                                    | 1.0                                                                                    | 0.2353                                                                             | 0.2                                             | 0.2                                              | 1.0                                           | 0.3333                                    | 0.4444        | 0.4444         | 1.0         | 0.5592  |
| 0.7379        | 7.0   | 28   | 0.7473          | 0.2333                                                                     | 0.2333                                                                      | 1.0                                                                      | 0.3784                                                               | 0.4333                                                                       | 0.4333                                                                        | 1.0                                                                        | 0.6047                                                                 | 0.3333                                                                            | 0.3333                                                                             | 1.0                                                                             | 0.5                                                                         | 0.1333                                                                                                    | 0.1333                                                                                                     | 1.0                                                                                                     | 0.2353                                                                                              | 0.3333                                                                                               | 0.3333                                                                                                | 1.0                                                                                                | 0.5                                                                                            | 0.1333                                                                                      | 0.1333                                                                                       | 1.0                                                                                       | 0.2353                                                                                | 0.0333                                        | 0.0333                                         | 1.0                                         | 0.0645                                  | 0.8                                                                                               | 0.8                                                                                                | 1.0                                                                                             | 0.8889                                                                                      | 0.9                                                                                                                                                                                                                                                                                                                                  | 0.9                                                                                                                                                                                                                                                                                                                                   | 1.0                                                                                                                                                                                                                                                                                                                                | 0.9474                                                                                                                                                                                                                                                                                                                         | 0.9                                                                                 | 0.9                                                                                  | 1.0                                                                               | 0.9474                                                                        | 0.7667                                                                                                                                                                                                                                         | 0.7667                                                                                                                                                                                                                                          | 1.0                                                                                                                                                                                                                                          | 0.8679                                                                                                                                                                                                                                   | 0.8333                                                             | 0.8333                                                              | 1.0                                                              | 0.9091                                                       | 0.2667                                                               | 0.2667                                                                | 1.0                                                                | 0.4211                                                         | 0.1                                                                                                                | 0.1                                                                                                                 | 1.0                                                                                                              | 0.1818                                                                                                       | 0.4333                                           | 0.4333                                            | 1.0                                            | 0.6047                                     | 0.7                                 | 0.7                                  | 1.0                               | 0.8235                        | 0.2667                                                                                                                | 0.2667                                                                                                                 | 1.0                                                                                                                 | 0.4211                                                                                                          | 0.6333                                                                                                   | 0.6333                                                                                                    | 1.0                                                                                                    | 0.7755                                                                                             | 0.7667                                | 0.7667                                 | 1.0                                 | 0.8679                          | 0.1333                                                                                   | 0.1333                                                                                    | 1.0                                                                                    | 0.2353                                                                             | 0.2                                             | 0.2                                              | 1.0                                           | 0.3333                                    | 0.4444        | 0.4444         | 1.0         | 0.5592  |
| 0.7351        | 8.0   | 32   | 0.7468          | 0.2333                                                                     | 0.2333                                                                      | 1.0                                                                      | 0.3784                                                               | 0.4333                                                                       | 0.4333                                                                        | 1.0                                                                        | 0.6047                                                                 | 0.3333                                                                            | 0.3333                                                                             | 1.0                                                                             | 0.5                                                                         | 0.1333                                                                                                    | 0.1333                                                                                                     | 1.0                                                                                                     | 0.2353                                                                                              | 0.3333                                                                                               | 0.3333                                                                                                | 1.0                                                                                                | 0.5                                                                                            | 0.1333                                                                                      | 0.1333                                                                                       | 1.0                                                                                       | 0.2353                                                                                | 0.0333                                        | 0.0333                                         | 1.0                                         | 0.0645                                  | 0.8                                                                                               | 0.8                                                                                                | 1.0                                                                                             | 0.8889                                                                                      | 0.9                                                                                                                                                                                                                                                                                                                                  | 0.9                                                                                                                                                                                                                                                                                                                                   | 1.0                                                                                                                                                                                                                                                                                                                                | 0.9474                                                                                                                                                                                                                                                                                                                         | 0.9                                                                                 | 0.9                                                                                  | 1.0                                                                               | 0.9474                                                                        | 0.7667                                                                                                                                                                                                                                         | 0.7667                                                                                                                                                                                                                                          | 1.0                                                                                                                                                                                                                                          | 0.8679                                                                                                                                                                                                                                   | 0.8333                                                             | 0.8333                                                              | 1.0                                                              | 0.9091                                                       | 0.2667                                                               | 0.2667                                                                | 1.0                                                                | 0.4211                                                         | 0.1                                                                                                                | 0.1                                                                                                                 | 1.0                                                                                                              | 0.1818                                                                                                       | 0.4333                                           | 0.4333                                            | 1.0                                            | 0.6047                                     | 0.7                                 | 0.7                                  | 1.0                               | 0.8235                        | 0.2667                                                                                                                | 0.2667                                                                                                                 | 1.0                                                                                                                 | 0.4211                                                                                                          | 0.6333                                                                                                   | 0.6333                                                                                                    | 1.0                                                                                                    | 0.7755                                                                                             | 0.7667                                | 0.7667                                 | 1.0                                 | 0.8679                          | 0.1333                                                                                   | 0.1333                                                                                    | 1.0                                                                                    | 0.2353                                                                             | 0.2                                             | 0.2                                              | 1.0                                           | 0.3333                                    | 0.4444        | 0.4444         | 1.0         | 0.5592  |
| 0.7351        | 9.0   | 36   | 0.7461          | 0.2333                                                                     | 0.2333                                                                      | 1.0                                                                      | 0.3784                                                               | 0.4333                                                                       | 0.4333                                                                        | 1.0                                                                        | 0.6047                                                                 | 0.3333                                                                            | 0.3333                                                                             | 1.0                                                                             | 0.5                                                                         | 0.1333                                                                                                    | 0.1333                                                                                                     | 1.0                                                                                                     | 0.2353                                                                                              | 0.3333                                                                                               | 0.3333                                                                                                | 1.0                                                                                                | 0.5                                                                                            | 0.1333                                                                                      | 0.1333                                                                                       | 1.0                                                                                       | 0.2353                                                                                | 0.0333                                        | 0.0333                                         | 1.0                                         | 0.0645                                  | 0.8                                                                                               | 0.8                                                                                                | 1.0                                                                                             | 0.8889                                                                                      | 0.9                                                                                                                                                                                                                                                                                                                                  | 0.9                                                                                                                                                                                                                                                                                                                                   | 1.0                                                                                                                                                                                                                                                                                                                                | 0.9474                                                                                                                                                                                                                                                                                                                         | 0.9                                                                                 | 0.9                                                                                  | 1.0                                                                               | 0.9474                                                                        | 0.7667                                                                                                                                                                                                                                         | 0.7667                                                                                                                                                                                                                                          | 1.0                                                                                                                                                                                                                                          | 0.8679                                                                                                                                                                                                                                   | 0.8333                                                             | 0.8333                                                              | 1.0                                                              | 0.9091                                                       | 0.2667                                                               | 0.2667                                                                | 1.0                                                                | 0.4211                                                         | 0.1                                                                                                                | 0.1                                                                                                                 | 1.0                                                                                                              | 0.1818                                                                                                       | 0.4333                                           | 0.4333                                            | 1.0                                            | 0.6047                                     | 0.7                                 | 0.7                                  | 1.0                               | 0.8235                        | 0.2667                                                                                                                | 0.2667                                                                                                                 | 1.0                                                                                                                 | 0.4211                                                                                                          | 0.6333                                                                                                   | 0.6333                                                                                                    | 1.0                                                                                                    | 0.7755                                                                                             | 0.7667                                | 0.7667                                 | 1.0                                 | 0.8679                          | 0.1333                                                                                   | 0.1333                                                                                    | 1.0                                                                                    | 0.2353                                                                             | 0.2                                             | 0.2                                              | 1.0                                           | 0.3333                                    | 0.4444        | 0.4444         | 1.0         | 0.5592  |


### Framework versions

- Transformers 4.42.4
- Pytorch 2.3.1+cu121
- Tokenizers 0.19.1