|
--- |
|
tags: |
|
- generated_from_trainer |
|
model-index: |
|
- name: fine_tuning_results |
|
results: [] |
|
--- |
|
|
|
<!-- This model card has been generated automatically according to the information the Trainer had access to. You |
|
should probably proofread and complete it, then remove this comment. --> |
|
|
|
# fine_tuning_results |
|
|
|
This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset. |
|
It achieves the following results on the evaluation set: |
|
- Loss: 0.7488 |
|
- Accuracy Is there a call to go online (e.g., shop online, visit the web)? : 0.2333 |
|
- Precision Is there a call to go online (e.g., shop online, visit the web)? : 0.2333 |
|
- Recall Is there a call to go online (e.g., shop online, visit the web)? : 1.0 |
|
- F1 Is there a call to go online (e.g., shop online, visit the web)? : 0.3784 |
|
- Accuracy Is there online contact information provided (e.g., url, website)? : 0.4333 |
|
- Precision Is there online contact information provided (e.g., url, website)? : 0.4333 |
|
- Recall Is there online contact information provided (e.g., url, website)? : 1.0 |
|
- F1 Is there online contact information provided (e.g., url, website)? : 0.6047 |
|
- Accuracy Is there a visual or verbal call to purchase (e.g., buy now, order now)?: 0.3333 |
|
- Precision Is there a visual or verbal call to purchase (e.g., buy now, order now)?: 0.3333 |
|
- Recall Is there a visual or verbal call to purchase (e.g., buy now, order now)?: 1.0 |
|
- F1 Is there a visual or verbal call to purchase (e.g., buy now, order now)?: 0.5 |
|
- Accuracy Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? : 0.1333 |
|
- Precision Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? : 0.1333 |
|
- Recall Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? : 1.0 |
|
- F1 Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? : 0.2353 |
|
- Accuracy Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? : 0.3333 |
|
- Precision Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? : 0.3333 |
|
- Recall Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? : 1.0 |
|
- F1 Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? : 0.5 |
|
- Accuracy Is there offline contact information provided (e.g., phone, mail, store location)?: 0.1333 |
|
- Precision Is there offline contact information provided (e.g., phone, mail, store location)?: 0.1333 |
|
- Recall Is there offline contact information provided (e.g., phone, mail, store location)?: 1.0 |
|
- F1 Is there offline contact information provided (e.g., phone, mail, store location)?: 0.2353 |
|
- Accuracy Is there mention of something free? : 0.0333 |
|
- Precision Is there mention of something free? : 0.0333 |
|
- Recall Is there mention of something free? : 1.0 |
|
- F1 Is there mention of something free? : 0.0645 |
|
- Accuracy Does the ad mention at least one specific product or service (e.g., model, type, item)? : 0.8 |
|
- Precision Does the ad mention at least one specific product or service (e.g., model, type, item)? : 0.8 |
|
- Recall Does the ad mention at least one specific product or service (e.g., model, type, item)? : 1.0 |
|
- F1 Does the ad mention at least one specific product or service (e.g., model, type, item)? : 0.8889 |
|
- Accuracy Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times? |
|
|
|
for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included.: 0.9 |
|
- Precision Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times? |
|
|
|
for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included.: 0.9 |
|
- Recall Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times? |
|
|
|
for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included.: 1.0 |
|
- F1 Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times? |
|
|
|
for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included.: 0.9474 |
|
- Accuracy Does the ad show the brand or trademark exactly once at the end of the ad?: 0.9 |
|
- Precision Does the ad show the brand or trademark exactly once at the end of the ad?: 0.9 |
|
- Recall Does the ad show the brand or trademark exactly once at the end of the ad?: 1.0 |
|
- F1 Does the ad show the brand or trademark exactly once at the end of the ad?: 0.9474 |
|
- Accuracy Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.): 0.7667 |
|
- Precision Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.): 0.7667 |
|
- Recall Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.): 1.0 |
|
- F1 Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.): 0.8679 |
|
- Accuracy Does the ad give you a positive feeling about the brand? : 0.8333 |
|
- Precision Does the ad give you a positive feeling about the brand? : 0.8333 |
|
- Recall Does the ad give you a positive feeling about the brand? : 1.0 |
|
- F1 Does the ad give you a positive feeling about the brand? : 0.9091 |
|
- Accuracy Does the ad have a story arc, with a beginning and an end? : 0.2667 |
|
- Precision Does the ad have a story arc, with a beginning and an end? : 0.2667 |
|
- Recall Does the ad have a story arc, with a beginning and an end? : 1.0 |
|
- F1 Does the ad have a story arc, with a beginning and an end? : 0.4211 |
|
- Accuracy Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse?: 0.1 |
|
- Precision Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse?: 0.1 |
|
- Recall Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse?: 1.0 |
|
- F1 Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse?: 0.1818 |
|
- Accuracy Does the ad have relatable characters? : 0.4333 |
|
- Precision Does the ad have relatable characters? : 0.4333 |
|
- Recall Does the ad have relatable characters? : 1.0 |
|
- F1 Does the ad have relatable characters? : 0.6047 |
|
- Accuracy Is the ad creative/clever?: 0.7 |
|
- Precision Is the ad creative/clever?: 0.7 |
|
- Recall Is the ad creative/clever?: 1.0 |
|
- F1 Is the ad creative/clever?: 0.8235 |
|
- Accuracy Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) : 0.2667 |
|
- Precision Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) : 0.2667 |
|
- Recall Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) : 1.0 |
|
- F1 Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) : 0.4211 |
|
- Accuracy Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? : 0.6333 |
|
- Precision Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? : 0.6333 |
|
- Recall Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? : 1.0 |
|
- F1 Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? : 0.7755 |
|
- Accuracy Is the ad visually pleasing?: 0.7667 |
|
- Precision Is the ad visually pleasing?: 0.7667 |
|
- Recall Is the ad visually pleasing?: 1.0 |
|
- F1 Is the ad visually pleasing?: 0.8679 |
|
- Accuracy Does the ad have cute elements like animals, babies, animated, characters, etc?: 0.1333 |
|
- Precision Does the ad have cute elements like animals, babies, animated, characters, etc?: 0.1333 |
|
- Recall Does the ad have cute elements like animals, babies, animated, characters, etc?: 1.0 |
|
- F1 Does the ad have cute elements like animals, babies, animated, characters, etc?: 0.2353 |
|
- Accuracy Was there a famous person in this ad? : 0.2 |
|
- Precision Was there a famous person in this ad? : 0.2 |
|
- Recall Was there a famous person in this ad? : 1.0 |
|
- F1 Was there a famous person in this ad? : 0.3333 |
|
- Accuracy Mean: 0.4444 |
|
- Precision Mean: 0.4444 |
|
- Recall Mean: 1.0 |
|
- F1 Mean: 0.5592 |
|
|
|
## Model description |
|
|
|
More information needed |
|
|
|
## Intended uses & limitations |
|
|
|
More information needed |
|
|
|
## Training and evaluation data |
|
|
|
More information needed |
|
|
|
## Training procedure |
|
|
|
### Training hyperparameters |
|
|
|
The following hyperparameters were used during training: |
|
- learning_rate: 0.00020308452008637912 |
|
- train_batch_size: 30 |
|
- eval_batch_size: 32 |
|
- seed: 42 |
|
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 |
|
- lr_scheduler_type: linear |
|
- lr_scheduler_warmup_steps: 100 |
|
- num_epochs: 9 |
|
|
|
### Training results |
|
|
|
| Training Loss | Epoch | Step | Validation Loss | Accuracy Is there a call to go online (e.g., shop online, visit the web)? | Precision Is there a call to go online (e.g., shop online, visit the web)? | Recall Is there a call to go online (e.g., shop online, visit the web)? | F1 Is there a call to go online (e.g., shop online, visit the web)? | Accuracy Is there online contact information provided (e.g., url, website)? | Precision Is there online contact information provided (e.g., url, website)? | Recall Is there online contact information provided (e.g., url, website)? | F1 Is there online contact information provided (e.g., url, website)? | Accuracy Is there a visual or verbal call to purchase (e.g., buy now, order now)? | Precision Is there a visual or verbal call to purchase (e.g., buy now, order now)? | Recall Is there a visual or verbal call to purchase (e.g., buy now, order now)? | F1 Is there a visual or verbal call to purchase (e.g., buy now, order now)? | Accuracy Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? | Precision Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? | Recall Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? | F1 Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? | Accuracy Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? | Precision Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? | Recall Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? | F1 Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? | Accuracy Is there offline contact information provided (e.g., phone, mail, store location)? | Precision Is there offline contact information provided (e.g., phone, mail, store location)? | Recall Is there offline contact information provided (e.g., phone, mail, store location)? | F1 Is there offline contact information provided (e.g., phone, mail, store location)? | Accuracy Is there mention of something free? | Precision Is there mention of something free? | Recall Is there mention of something free? | F1 Is there mention of something free? | Accuracy Does the ad mention at least one specific product or service (e.g., model, type, item)? | Precision Does the ad mention at least one specific product or service (e.g., model, type, item)? | Recall Does the ad mention at least one specific product or service (e.g., model, type, item)? | F1 Does the ad mention at least one specific product or service (e.g., model, type, item)? | Accuracy Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times? |
|
|
|
for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included. | Precision Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times? |
|
|
|
for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included. | Recall Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times? |
|
|
|
for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included. | F1 Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times? |
|
|
|
for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included. | Accuracy Does the ad show the brand or trademark exactly once at the end of the ad? | Precision Does the ad show the brand or trademark exactly once at the end of the ad? | Recall Does the ad show the brand or trademark exactly once at the end of the ad? | F1 Does the ad show the brand or trademark exactly once at the end of the ad? | Accuracy Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.) | Precision Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.) | Recall Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.) | F1 Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.) | Accuracy Does the ad give you a positive feeling about the brand? | Precision Does the ad give you a positive feeling about the brand? | Recall Does the ad give you a positive feeling about the brand? | F1 Does the ad give you a positive feeling about the brand? | Accuracy Does the ad have a story arc, with a beginning and an end? | Precision Does the ad have a story arc, with a beginning and an end? | Recall Does the ad have a story arc, with a beginning and an end? | F1 Does the ad have a story arc, with a beginning and an end? | Accuracy Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse? | Precision Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse? | Recall Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse? | F1 Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse? | Accuracy Does the ad have relatable characters? | Precision Does the ad have relatable characters? | Recall Does the ad have relatable characters? | F1 Does the ad have relatable characters? | Accuracy Is the ad creative/clever? | Precision Is the ad creative/clever? | Recall Is the ad creative/clever? | F1 Is the ad creative/clever? | Accuracy Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) | Precision Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) | Recall Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) | F1 Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) | Accuracy Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? | Precision Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? | Recall Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? | F1 Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? | Accuracy Is the ad visually pleasing? | Precision Is the ad visually pleasing? | Recall Is the ad visually pleasing? | F1 Is the ad visually pleasing? | Accuracy Does the ad have cute elements like animals, babies, animated, characters, etc? | Precision Does the ad have cute elements like animals, babies, animated, characters, etc? | Recall Does the ad have cute elements like animals, babies, animated, characters, etc? | F1 Does the ad have cute elements like animals, babies, animated, characters, etc? | Accuracy Was there a famous person in this ad? | Precision Was there a famous person in this ad? | Recall Was there a famous person in this ad? | F1 Was there a famous person in this ad? | Accuracy Mean | Precision Mean | Recall Mean | F1 Mean | |
|
|:-------------:|:-----:|:----:|:---------------:|:--------------------------------------------------------------------------:|:---------------------------------------------------------------------------:|:------------------------------------------------------------------------:|:--------------------------------------------------------------------:|:----------------------------------------------------------------------------:|:-----------------------------------------------------------------------------:|:--------------------------------------------------------------------------:|:----------------------------------------------------------------------:|:---------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------:|:---------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------:|:---------------------------------------------:|:----------------------------------------------:|:-------------------------------------------:|:---------------------------------------:|:-------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------:|:-------------------------------------------------------------------:|:----------------------------------------------------------------:|:------------------------------------------------------------:|:--------------------------------------------------------------------:|:---------------------------------------------------------------------:|:------------------------------------------------------------------:|:--------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------:|:------------------------------------------------:|:-------------------------------------------------:|:----------------------------------------------:|:------------------------------------------:|:-----------------------------------:|:------------------------------------:|:---------------------------------:|:-----------------------------:|:---------------------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------:|:-------------------------------------:|:--------------------------------------:|:-----------------------------------:|:-------------------------------:|:----------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------:|:-----------------------------------------------:|:------------------------------------------------:|:---------------------------------------------:|:-----------------------------------------:|:-------------:|:--------------:|:-----------:|:-------:| |
|
| No log | 1.0 | 4 | 0.7488 | 0.2333 | 0.2333 | 1.0 | 0.3784 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.0333 | 0.0333 | 1.0 | 0.0645 | 0.8 | 0.8 | 1.0 | 0.8889 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.8333 | 0.8333 | 1.0 | 0.9091 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.1 | 0.1 | 1.0 | 0.1818 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.7 | 0.7 | 1.0 | 0.8235 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.6333 | 0.6333 | 1.0 | 0.7755 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.2 | 0.2 | 1.0 | 0.3333 | 0.4444 | 0.4444 | 1.0 | 0.5592 | |
|
| No log | 2.0 | 8 | 0.7488 | 0.2333 | 0.2333 | 1.0 | 0.3784 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.0333 | 0.0333 | 1.0 | 0.0645 | 0.8 | 0.8 | 1.0 | 0.8889 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.8333 | 0.8333 | 1.0 | 0.9091 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.1 | 0.1 | 1.0 | 0.1818 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.7 | 0.7 | 1.0 | 0.8235 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.6333 | 0.6333 | 1.0 | 0.7755 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.2 | 0.2 | 1.0 | 0.3333 | 0.4444 | 0.4444 | 1.0 | 0.5592 | |
|
| 0.7357 | 3.0 | 12 | 0.7486 | 0.2333 | 0.2333 | 1.0 | 0.3784 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.0333 | 0.0333 | 1.0 | 0.0645 | 0.8 | 0.8 | 1.0 | 0.8889 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.8333 | 0.8333 | 1.0 | 0.9091 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.1 | 0.1 | 1.0 | 0.1818 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.7 | 0.7 | 1.0 | 0.8235 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.6333 | 0.6333 | 1.0 | 0.7755 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.2 | 0.2 | 1.0 | 0.3333 | 0.4444 | 0.4444 | 1.0 | 0.5592 | |
|
| 0.7357 | 4.0 | 16 | 0.7484 | 0.2333 | 0.2333 | 1.0 | 0.3784 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.0333 | 0.0333 | 1.0 | 0.0645 | 0.8 | 0.8 | 1.0 | 0.8889 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.8333 | 0.8333 | 1.0 | 0.9091 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.1 | 0.1 | 1.0 | 0.1818 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.7 | 0.7 | 1.0 | 0.8235 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.6333 | 0.6333 | 1.0 | 0.7755 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.2 | 0.2 | 1.0 | 0.3333 | 0.4444 | 0.4444 | 1.0 | 0.5592 | |
|
| 0.7379 | 5.0 | 20 | 0.7481 | 0.2333 | 0.2333 | 1.0 | 0.3784 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.0333 | 0.0333 | 1.0 | 0.0645 | 0.8 | 0.8 | 1.0 | 0.8889 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.8333 | 0.8333 | 1.0 | 0.9091 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.1 | 0.1 | 1.0 | 0.1818 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.7 | 0.7 | 1.0 | 0.8235 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.6333 | 0.6333 | 1.0 | 0.7755 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.2 | 0.2 | 1.0 | 0.3333 | 0.4444 | 0.4444 | 1.0 | 0.5592 | |
|
| 0.7379 | 6.0 | 24 | 0.7478 | 0.2333 | 0.2333 | 1.0 | 0.3784 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.0333 | 0.0333 | 1.0 | 0.0645 | 0.8 | 0.8 | 1.0 | 0.8889 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.8333 | 0.8333 | 1.0 | 0.9091 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.1 | 0.1 | 1.0 | 0.1818 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.7 | 0.7 | 1.0 | 0.8235 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.6333 | 0.6333 | 1.0 | 0.7755 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.2 | 0.2 | 1.0 | 0.3333 | 0.4444 | 0.4444 | 1.0 | 0.5592 | |
|
| 0.7379 | 7.0 | 28 | 0.7473 | 0.2333 | 0.2333 | 1.0 | 0.3784 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.0333 | 0.0333 | 1.0 | 0.0645 | 0.8 | 0.8 | 1.0 | 0.8889 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.8333 | 0.8333 | 1.0 | 0.9091 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.1 | 0.1 | 1.0 | 0.1818 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.7 | 0.7 | 1.0 | 0.8235 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.6333 | 0.6333 | 1.0 | 0.7755 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.2 | 0.2 | 1.0 | 0.3333 | 0.4444 | 0.4444 | 1.0 | 0.5592 | |
|
| 0.7351 | 8.0 | 32 | 0.7468 | 0.2333 | 0.2333 | 1.0 | 0.3784 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.0333 | 0.0333 | 1.0 | 0.0645 | 0.8 | 0.8 | 1.0 | 0.8889 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.8333 | 0.8333 | 1.0 | 0.9091 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.1 | 0.1 | 1.0 | 0.1818 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.7 | 0.7 | 1.0 | 0.8235 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.6333 | 0.6333 | 1.0 | 0.7755 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.2 | 0.2 | 1.0 | 0.3333 | 0.4444 | 0.4444 | 1.0 | 0.5592 | |
|
| 0.7351 | 9.0 | 36 | 0.7461 | 0.2333 | 0.2333 | 1.0 | 0.3784 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.0333 | 0.0333 | 1.0 | 0.0645 | 0.8 | 0.8 | 1.0 | 0.8889 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.8333 | 0.8333 | 1.0 | 0.9091 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.1 | 0.1 | 1.0 | 0.1818 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.7 | 0.7 | 1.0 | 0.8235 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.6333 | 0.6333 | 1.0 | 0.7755 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.2 | 0.2 | 1.0 | 0.3333 | 0.4444 | 0.4444 | 1.0 | 0.5592 | |
|
|
|
|
|
### Framework versions |
|
|
|
- Transformers 4.42.4 |
|
- Pytorch 2.3.1+cu121 |
|
- Tokenizers 0.19.1 |
|
|
