Training in progress, epoch 1, checkpoint

last-checkpoint/README.md

@@ -7,9 +7,9 @@ tags:
 - sentence-similarity
 - feature-extraction
 - generated_from_trainer
-- dataset_size:96781
+- dataset_size:689221
 - loss:MultipleNegativesRankingLoss
-- loss:AnglELoss
+- loss:CoSENTLoss
 - loss:GISTEmbedLoss
 - loss:OnlineContrastiveLoss
 - loss:MultipleNegativesSymmetricRankingLoss
@@ -23,48 +23,43 @@ datasets:
 - sentence-transformers/xsum
 - sentence-transformers/sentence-compression
 widget:
-- source_sentence: What dual titles did Frederick William hold?
+- source_sentence: What are the exceptions in the constitution  that require special
+    considerations to amend?
   sentences:
-  - The impact was increased by chronic overfishing, and by eutrophication that gave
-    the entire ecosystem a short-term boost, causing the Mnemiopsis population to
-    increase even faster than normal – and above all by the absence of efficient predators
-    on these introduced ctenophores.
-  - The "European Council" (rather than the Council, made up of different government
-    Ministers) is composed of the Prime Ministers or executive Presidents of the member
-    states.
-  - Nearly 50,000 Huguenots established themselves in Germany, 20,000 of whom were
-    welcomed in Brandenburg-Prussia, where they were granted special privileges (Edict
-    of Potsdam) and churches in which to worship (such as the Church of St. Peter
-    and St. Paul, Angermünde) by Frederick William, Elector of Brandenburg and Duke
-    of Prussia.
-- source_sentence: the Great Internet Mersenne Prime Search, what was the prize for
-    finding a prime with at least 10 million digits?
+  - The river makes a distinctive turn to the north near Chur.
+  - The Victorian Constitution can be amended by the Parliament of Victoria, except
+    for certain "entrenched" provisions that require either an absolute majority in
+    both houses, a three-fifths majority in both houses, or the approval of the Victorian
+    people in a referendum, depending on the provision.
+  - A new arrangement of the theme, once again by Gold, was introduced in the 2007
+    Christmas special episode, "Voyage of the Damned"; Gold returned as composer for
+    the 2010 series.
+- source_sentence: What is the name of a Bodhisattva vow?
   sentences:
-  - Since September 2004, the official home of the Scottish Parliament has been a
-    new Scottish Parliament Building, in the Holyrood area of Edinburgh.
-  - The roughly half-mile stretch of Kearney Boulevard between Fresno Street and Thorne
-    Ave was at one time the preferred neighborhood for Fresno's elite African-American
-    families.
-  - In 2009, the Great Internet Mersenne Prime Search project was awarded a US$100,000
-    prize for first discovering a prime with at least 10 million digits.
-- source_sentence: A woman is tugging on a white sheet and laughing
+  - In Tibetan Buddhism the teachers of Dharma in Tibet are most commonly called a
+    Lama.
+  - This origin of chloroplasts was first suggested by the Russian biologist Konstantin
+    Mereschkowski in 1905 after Andreas Schimper observed in 1883 that chloroplasts
+    closely resemble cyanobacteria.
+  - The announcement came a day after Setanta Sports confirmed that it would launch
+    in March as a subscription service on the digital terrestrial platform, and on
+    the same day that NTL's services re-branded as Virgin Media.
+- source_sentence: Two dogs run around inside a fence.
   sentences:
-  - Fruit characters decorate this child's bib
-  - The person is amused.
-  - Farmers preparing to feed their animals.
-- source_sentence: A hispanic fruit market with many different fruits and vegetables
-    in view on a city street with a man passing the store dressed in dark pants and
-    a hoodie.
+  - A young woman tennis player have many tennis balls.
+  - Two dogs are inside a fence.
+  - A little girl in red plays tennis.
+- source_sentence: A little boy wearing a blue stiped shirt has a party hat on his
+    head and is playing in a puddle.
   sentences:
-  - A fruit market and a man
-  - The guys have guns.
-  - Two people are playing an instruments on stage.
-- source_sentence: Two Asian children, a boy and a girl, the girl looking squarely
-    at the camera and the boy making a face.
+  - The party boy is playing in a puddle.
+  - There is a crowd
+  - Four people are skiing
+- source_sentence: Two wrestlers jump in a ring while an official watches.
   sentences:
-  - A woman is outside.
-  - there are children near the camera
-  - A boy is playing on an inflatable ride.
+  - The man was walking.
+  - Two men are dressed in makeup
+  - Two wrestlers were just tagged in on a tag team match.
 pipeline_tag: sentence-similarity
 ---
 
@@ -125,9 +120,9 @@ from sentence_transformers import SentenceTransformer
 model = SentenceTransformer("bobox/DeBERTaV3-small-GeneralSentenceTransformer-checkpoints-tmp")
 # Run inference
 sentences = [
-    'Two Asian children, a boy and a girl, the girl looking squarely at the camera and the boy making a face.',
-    'there are children near the camera',
-    'A boy is playing on an inflatable ride.',
+    'Two wrestlers jump in a ring while an official watches.',
+    'Two wrestlers were just tagged in on a tag team match.',
+    'Two men are dressed in makeup',
 ]
 embeddings = model.encode(sentences)
 print(embeddings.shape)
@@ -182,7 +177,7 @@ You can finetune this model on your own dataset.
 #### nli-pairs
 
 * Dataset: [nli-pairs](https://huggingface.co/datasets/sentence-transformers/all-nli) at [d482672](https://huggingface.co/datasets/sentence-transformers/all-nli/tree/d482672c8e74ce18da116f430137434ba2e52fab)
-* Size: 7,500 training samples
+* Size: 150,000 training samples
 * Columns: <code>sentence1</code> and <code>sentence2</code>
 * Approximate statistics based on the first 1000 samples:
   |         | sentence1                                                                         | sentence2                                                                        |
@@ -219,30 +214,30 @@ You can finetune this model on your own dataset.
   | <code>A plane is taking off.</code>                        | <code>An air plane is taking off.</code>                              | <code>1.0</code>  |
   | <code>A man is playing a large flute.</code>               | <code>A man is playing a flute.</code>                                | <code>0.76</code> |
   | <code>A man is spreading shreded cheese on a pizza.</code> | <code>A man is spreading shredded cheese on an uncooked pizza.</code> | <code>0.76</code> |
-* Loss: [<code>AnglELoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#angleloss) with these parameters:
+* Loss: [<code>CoSENTLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#cosentloss) with these parameters:
   ```json
   {
       "scale": 20.0,
-      "similarity_fct": "pairwise_angle_sim"
+      "similarity_fct": "pairwise_cos_sim"
   }
   ```
 
 #### vitaminc-pairs
 
 * Dataset: [vitaminc-pairs](https://huggingface.co/datasets/tals/vitaminc) at [be6febb](https://huggingface.co/datasets/tals/vitaminc/tree/be6febb761b0b2807687e61e0b5282e459df2fa0)
-* Size: 3,695 training samples
+* Size: 75,142 training samples
 * Columns: <code>label</code>, <code>sentence1</code>, and <code>sentence2</code>
 * Approximate statistics based on the first 1000 samples:
-  |         | label                        | sentence1                                                                         | sentence2                                                                          |
-  |:--------|:-----------------------------|:----------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------|
-  | type    | int                          | string                                                                            | string                                                                             |
-  | details | <ul><li>1: 100.00%</li></ul> | <ul><li>min: 6 tokens</li><li>mean: 16.21 tokens</li><li>max: 67 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 37.22 tokens</li><li>max: 224 tokens</li></ul> |
+  |         | label                        | sentence1                                                                         | sentence2                                                                         |
+  |:--------|:-----------------------------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|
+  | type    | int                          | string                                                                            | string                                                                            |
+  | details | <ul><li>1: 100.00%</li></ul> | <ul><li>min: 7 tokens</li><li>mean: 17.44 tokens</li><li>max: 53 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 38.0 tokens</li><li>max: 151 tokens</li></ul> |
 * Samples:
-  | label          | sentence1                                                         | sentence2                                                                                                                                                                                                                                                                                                                                                      |
-  |:---------------|:------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
-  | <code>1</code> | <code>Ginn filled out the lineup in 2015 .</code>                 | <code>In 2015 , Ginn filled out the line up with adding new members Tyler Smith on bass , and Brandon Pertzborn on drums.</code>                                                                                                                                                                                                                               |
-  | <code>1</code> | <code>Brent Grimes is a free agent .</code>                       | <code>Brent Omar Grimes ( born July 19 , 1983 ) is an American football cornerback who is currently a free agent .</code>                                                                                                                                                                                                                                      |
-  | <code>1</code> | <code>The Symphony by Erich Korngold is in F-sharp Major .</code> | <code>`` Classical music critic Mark Swed of the Los Angeles Times pointed out that many classical composers used material from previous composers saying that `` '' John Williams all but lifted the core idea of his Star Wars soundtrack score from the Scherzo of Erich Korngold 's Symphony in F-sharp Major , written 25 years earlier . '' '' ''</code> |
+  | label          | sentence1                                                                                                                                                     | sentence2                                                                                                                                                                                                           |
+  |:---------------|:--------------------------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>1</code> | <code>Penguins has a rating of less than 92 % , defined by more than 20 reviews on Rotten Tomatoes .</code>                                                   | <code>On review aggregator Rotten Tomatoes , the film holds an approval rating of 91 % based on 22 reviews , with an average rating of 7.14/10 .</code>                                                             |
+  | <code>1</code> | <code>Fluoxetine , acts as a positive allosteric modulator of the GABAA receptor at high concentrations , as does norfluoxetine though more potently .</code> | <code>In addition , it acts as a positive allosteric modulator of the GABAA receptor at high concentrations , and norfluoxetine does the same but more potently , actions which may be clinically-relevant .</code> |
+  | <code>1</code> | <code>Andrew Robertson is considered by many experts to be one of the best left backs .</code>                                                                | <code>He is considered by many pundits to be one of the best left backs in the world due to his pace and crossing ability.</code>                                                                                   |
 * Loss: [<code>GISTEmbedLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#gistembedloss) with these parameters:
   ```json
   {'guide': SentenceTransformer(
@@ -255,19 +250,19 @@ You can finetune this model on your own dataset.
 #### qnli-contrastive
 
 * Dataset: [qnli-contrastive](https://huggingface.co/datasets/nyu-mll/glue) at [bcdcba7](https://huggingface.co/datasets/nyu-mll/glue/tree/bcdcba79d07bc864c1c254ccfcedcce55bcc9a8c)
-* Size: 7,500 training samples
+* Size: 104,743 training samples
 * Columns: <code>sentence1</code>, <code>sentence2</code>, and <code>label</code>
 * Approximate statistics based on the first 1000 samples:
   |         | sentence1                                                                         | sentence2                                                                          | label                        |
   |:--------|:----------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------|:-----------------------------|
   | type    | string                                                                            | string                                                                             | int                          |
-  | details | <ul><li>min: 6 tokens</li><li>mean: 13.84 tokens</li><li>max: 30 tokens</li></ul> | <ul><li>min: 7 tokens</li><li>mean: 34.77 tokens</li><li>max: 166 tokens</li></ul> | <ul><li>0: 100.00%</li></ul> |
+  | details | <ul><li>min: 3 tokens</li><li>mean: 13.82 tokens</li><li>max: 39 tokens</li></ul> | <ul><li>min: 5 tokens</li><li>mean: 34.56 tokens</li><li>max: 110 tokens</li></ul> | <ul><li>0: 100.00%</li></ul> |
 * Samples:
-  | sentence1                                                                                  | sentence2                                                                                                                                                                                                                                                                                                            | label          |
-  |:-------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------|
-  | <code>The term, the New Haven Approach was what exactly?</code>                            | <code>A theory of international law, which argues for a sociological normative approach in regards to jurisprudence, is named the New Haven Approach, after the city.</code>                                                                                                                                         | <code>0</code> |
-  | <code>As of April 2014, how many albums have Jay Z and Beyonce sold together?</code>       | <code>As of April 2014, the couple have sold a combined 300 million records together.</code>                                                                                                                                                                                                                         | <code>0</code> |
-  | <code>Most U.S law, the kind of law we live everyday, consists of what kind of law?</code> | <code>In the dual-sovereign system of American federalism (actually tripartite because of the presence of Indian reservations), states are the plenary sovereigns, each with their own constitution, while the federal sovereign possesses only the limited supreme authority enumerated in the Constitution.</code> | <code>0</code> |
+  | sentence1                                                                          | sentence2                                                                                                                                                                                                                       | label          |
+  |:-----------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------|
+  | <code>Which Formula One racing team developed the C-X75's used for filming.</code> | <code>The C-X75s used for filming were developed by the engineering division of Formula One racing team Williams, who built the original C-X75 prototype for Jaguar.</code>                                                     | <code>0</code> |
+  | <code>When did the University of Michigan leave Detroit?</code>                    | <code>In June 2009, the Michigan State University College of Osteopathic Medicine which is based in East Lansing opened a satellite campus located at the Detroit Medical Center.</code>                                        | <code>0</code> |
+  | <code>When did the Vlachs migrate into the region?</code>                          | <code>The Gorals of southern Poland and northern Slovakia are partially descended from Romance-speaking Vlachs who migrated into the region from the 14th to 17th centuries and were absorbed into the local population.</code> | <code>0</code> |
 * Loss: [<code>OnlineContrastiveLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#onlinecontrastiveloss)
 
 #### scitail-pairs-qa
@@ -276,16 +271,16 @@ You can finetune this model on your own dataset.
 * Size: 14,987 training samples
 * Columns: <code>sentence2</code> and <code>sentence1</code>
 * Approximate statistics based on the first 1000 samples:
-  |         | sentence2                                                                         | sentence1                                                                        |
-  |:--------|:----------------------------------------------------------------------------------|:---------------------------------------------------------------------------------|
-  | type    | string                                                                            | string                                                                           |
-  | details | <ul><li>min: 7 tokens</li><li>mean: 15.73 tokens</li><li>max: 41 tokens</li></ul> | <ul><li>min: 6 tokens</li><li>mean: 14.9 tokens</li><li>max: 33 tokens</li></ul> |
+  |         | sentence2                                                                         | sentence1                                                                         |
+  |:--------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|
+  | type    | string                                                                            | string                                                                            |
+  | details | <ul><li>min: 7 tokens</li><li>mean: 16.04 tokens</li><li>max: 41 tokens</li></ul> | <ul><li>min: 6 tokens</li><li>mean: 15.14 tokens</li><li>max: 34 tokens</li></ul> |
 * Samples:
-  | sentence2                                                                                                                            | sentence1                                                                                                    |
-  |:-------------------------------------------------------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------|
-  | <code>The nervous system plays a critical role in the regulation of vascular homeostasis.</code>                                     | <code>What system plays a critical role in the regulation of vascular homeostasis?</code>                    |
-  | <code>A moose eats a plant is an example of a living thing that depends on another living thing to survive.</code>                   | <code>Which statement best identifies a living thing that depends on another living thing to survive?</code> |
-  | <code>Single-celled organisms and multicellular organisms have this in common: both have a way to get rid of waste materials.</code> | <code>Which characteristic do single-celled organisms and multicellular organisms have in common?</code>     |
+  | sentence2                                                                             | sentence1                                                                               |
+  |:--------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------|
+  | <code>Voltage is not the same as energy, but means the energy per unit charge.</code> | <code>What term is not the same as energy, but means the energy per unit charge?</code> |
+  | <code>A jellyfish does not have a circulatory system.</code>                          | <code>Name the type of system that a jellyfish does not have?</code>                    |
+  | <code>Insight learning is based on past experience and reasoning.</code>              | <code>What type of learning is based on past experience and reasoning?</code>           |
 * Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
   ```json
   {
@@ -303,13 +298,13 @@ You can finetune this model on your own dataset.
   |         | sentence1                                                                         | sentence2                                                                         |
   |:--------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|
   | type    | string                                                                            | string                                                                            |
-  | details | <ul><li>min: 6 tokens</li><li>mean: 23.64 tokens</li><li>max: 69 tokens</li></ul> | <ul><li>min: 7 tokens</li><li>mean: 15.52 tokens</li><li>max: 36 tokens</li></ul> |
+  | details | <ul><li>min: 6 tokens</li><li>mean: 23.99 tokens</li><li>max: 65 tokens</li></ul> | <ul><li>min: 7 tokens</li><li>mean: 15.54 tokens</li><li>max: 39 tokens</li></ul> |
 * Samples:
-  | sentence1                                                                                                                             | sentence2                                                                                                  |
-  |:--------------------------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------|
-  | <code>population A group of organisms of the same species that occupy a particular geographic area or region.</code>                  | <code>You call a group of organisms of the same species that live in the same area a(n) population.</code> |
-  | <code>A galaxy is a vast island of hundreds of billions of stars (solar systems), nebulas and star clusters.</code>                   | <code>A galaxy is best described as a cluster of billions of stars.</code>                                 |
-  | <code>Photosynthesis is an anabolic process by which plants synthesize glucose from the raw products carbon dioxide and water.</code> | <code>Photosynthesis converts carbon dioxide and water into glucose.</code>                                |
+  | sentence1                                                                                                        | sentence2                                                                                                         |
+  |:-----------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------|
+  | <code>A) A calorie is a unit of measure used to express the amount of energy a food produces in the body.</code> | <code>Another unit of energy, used widely in the health professions and everyday life, is calorie ( cal )?</code> |
+  | <code>solid 1 A state that retains shape independent of the shape of the container it occupies.</code>           | <code>Solid takes neither the shape nor the volume of its container.</code>                                       |
+  | <code>Sometimes the two sides of a fracture moved due to the pressure and a fault was formed.</code>             | <code>A fault is the fracture caused when rocks on both sides move.</code>                                        |
 * Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
   ```json
   {
@@ -321,19 +316,19 @@ You can finetune this model on your own dataset.
 #### xsum-pairs
 
 * Dataset: [xsum-pairs](https://huggingface.co/datasets/sentence-transformers/xsum) at [788ddaf](https://huggingface.co/datasets/sentence-transformers/xsum/tree/788ddafe04e539956d56b567bc32a036ee7b9206)
-* Size: 3,750 training samples
+* Size: 150,000 training samples
 * Columns: <code>sentence1</code> and <code>sentence2</code>
 * Approximate statistics based on the first 1000 samples:
   |         | sentence1                                                                            | sentence2                                                                         |
   |:--------|:-------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|
   | type    | string                                                                               | string                                                                            |
-  | details | <ul><li>min: 35 tokens</li><li>mean: 353.88 tokens</li><li>max: 512 tokens</li></ul> | <ul><li>min: 8 tokens</li><li>mean: 26.93 tokens</li><li>max: 67 tokens</li></ul> |
+  | details | <ul><li>min: 13 tokens</li><li>mean: 346.32 tokens</li><li>max: 512 tokens</li></ul> | <ul><li>min: 7 tokens</li><li>mean: 26.95 tokens</li><li>max: 66 tokens</li></ul> |
 * Samples:
-  | sentence1                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     | sentence2                                                                                                                                                   |
-  |:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------|
-  | <code>About 24 of the rocks, known as Hertfordshire Puddingstone, were removed from the former St Albans Museum grounds.<br>It is thought they were taken from the garden between the 3 and 14 April.<br>Hertfordshire Police said the theft of the rare rock was being treated as a heritage crime.<br>PC Sean Lannon said Hertfordshire Puddingstone was "one of the world's rarest rocks" and part of the county's heritage.<br>"We are doing all we can to ensure that these stones are returned to the museum," he said.<br>The force has appealed for witnesses or anyone who may have been offered the rocks for sale to come forward.<br>Hertfordshire Puddingstone is a naturally occurring conglomerate consisting of rounded flint pebbles bound in silica cement, found mostly within the county.<br>It is thought to have originated from deposits laid down millions of years ago and is called puddingstone because the flints resemble the plums in a Christmas pudding.<br>Most of the rocks taken came from the site of the Seventh Day Adventist Church during the late 1970s.<br>St Albans Museum in Hatfield Road closed earlier this year ahead of its move to a new site in the Town Hall which is due to open next year.</code>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       | <code>A collection of prehistoric stones thought be about 54 million years old has been stolen from a former museum site, police have said.</code>          |
-  | <code>Instead, in today's ever more fitness and fashion conscious world, a growing number are willing to pay as much for a new gym outfit as they do for a new formal party dress.<br>This has led to a big increase over recent years in the value of the women's sportswear market.<br>In the US alone, combined sales of such products - from yoga leggings, sports bras and vests, to tracksuits - totalled $15.1bn (£10.3bn) in the 12 months to August 2011, according to research firm NPD Group. It said this was 10% higher than the prior year.<br>Meanwhile, sportswear giant Nike said last October that the rate of sales growth in its female clothing ranges was outpacing that of its products for men.<br>Analysts say that the rise in sales of women's sportswear has been helped by an increased emphasis on the style of the clothing - making them look and feel as good as possible - which in turn has led to an increase in the number of women wearing such items as fashionable leisurewear.<br>And with the market being so valuable, it is not surprising that a growing number of small companies - predominantly led by women - are launching their own ranges of upmarket female sportswear.<br>Katy Biddulph didn't need gym membership when she launched her women's sportswear brand Striders Edge in London back in 2011.<br>Initially running the business from a second floor one-bedroom flat, she would get her exercise by carrying all her deliveries up and down the stairs.<br>The 31-year-old says: "It looked like a fairly big business to the outside world when I was just starting out, but I was receiving all my goods from the manufacturer in Portugal from a truck outside my flat.<br>"I had hundreds of garments landing in the street, and I had to get all the boxes up the stairs by myself. I never slept that first year, but I just knew there was a gap in the market that I could fill.<br>"Now I've got an office that overlooks the London Eye."<br>Ms Biddulph set up the business after previously working for fellow British women's sportswear company Sweaty Betty, where she designed and managed a number of product ranges.<br>Her industry experience and knowledge persuaded a number of private investors to back her venture.<br>Striders Edge's clothes are now stocked by UK retailers Harrods, John Lewis and House of Fraser, and the brand launched in the US in February. It also sells globally via its website.<br>Now with nine members of staff, Ms Biddulph says she wants to hit £2m in sales within the next 12 months.<br>She adds: "You want your customer to feel great and part of something. As a female, you know the standard concerns."<br>But just how do you convince women to spend more than £60 on a t-shirt or a pair of leggings?<br>"It's not as hard as you would think," says Brittany Morris-Asquith, spokesperson and designer for Titika Active Couture, a Canadian brand based in Toronto. "Women are always looking for something different.<br>"They're asking more questions about fabrics, and if they understand the construction that goes into it, they're willing to pay for a better product."<br>Since Titika's founder Eileen Zhang, 32, opened her first shop in Toronto in 2009, Titika has expanded to seven stores across the province of Ontario.<br>And in March of this year it expended its online sales to the US, with plans to ship globally later this year.<br>Ms Morris-Asquith adds: "We provide clothing to women that make them feel good, we encourage them to try on things that they would never think about."<br>Titika also offers free in-store exercise classes to promote a healthy lifestyle - from yoga and kickboxing, to zumba dance workouts. And inspirational slogans affixed above fitting room mirrors urge against body shaming.<br>Catherine Elliott, a professor at the Telfer School of Management at the University of Ottawa, says that businesses such as Striders Edge and Titika share an ethos which is typical for female-led companies.<br>"They tend to have a double bottom line - to create wealth, but also to make positive change for girls and women," says Prof Elliott, who is co-author of a recently published book on the subject called Feminine Capital.<br>"When women are defining the objectives of [a clothing] business, they're going to see it as something that empowers women as opposed to just making them look sexy.<br>"The sports clothing industry is about feeling good about yourself, and wearing clothing that fits and makes you feel comfortable."<br>She adds: "A lot of women have talked about how being in sports and fitness has given them the leadership skills and confidence to be successful in corporate settings and entrepreneurship."<br>At New York-based women's sportswear business Live The Process, founder Robyn Berkley says the aim is for the brand to not just be about clothing, and instead "offer authenticity, honesty, and embrace the idealism of wellness".<br>Its website features editorial content from 32 contributors, offering tips ranging from changing careers to taking care of your skin.<br>Established in 2013, the company's clothing range was an immediate hit, with sales topping £1m in its first year.</code> | <code>The days when women would simply throw on an old T-shirt to do some exercise are long gone.</code>                                                    |
-  | <code>Bovis Homes wanted to build the new estate on land between Collingtree Park and Collingtree village to the south of Northampton.<br>The plans were rejected by Northampton Borough Council in January.<br>Now a report to the council's planning committee, meeting next week, says Bovis Home intends to appeal.<br>The plans, for the site to the north of the M1, also included community buildings, a site for a primary school and open space.<br>Council officers said in the report that if the appeal was successful it would be important to have in place an agreement with the developer for it to help fund play areas, footpath improvements and a school and community buildings.<br>The original plans were recommended for approval by council officers but rejected by the council after fears were raised about flooding in the area and some homes being sited too near the M1.</code>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               | <code>Developers who saw their plans for 1,000 homes near a Northamptonshire village rejected by councillors are set to appeal against the decision.</code> |
+  | sentence1                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             | sentence2                                                                                                                                                      |
+  |:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>Jacob Murphy fired in his 10th goal of the season from inside the box to give the Canaries the lead at the break.<br>Adam Hammill, Angus MacDonald and Marley Watkins all went close for the visitors after the restart.<br>Norwich then stretched their lead thanks to MacDonald's own goal to leave them five points behind sixth-placed Sheffield Wednesday.<br>Victory means caretaker boss Alan Irvine has now claimed four points from a possible six since the departure of Alex Neil.<br>The hosts dominated the early proceedings, with Jonny Howson and Alex Pritchard both being denied by Barnsley keeper Adam Davies.<br>After Hammill had a goal ruled out for a clear offside at the other end, winger Murphy gave the Canaries a deserved lead moments before the break when, having being picked out by Cameron Jerome, he drilled a shot low and into the corner of the net.<br>Hammill was unlucky to not get a strong enough flick on Andy Yiadom's cross to make it 1-1 after the restart and MacDonald saw a close-range effort well saved by Michael McGovern from the resulting corner.<br>But, after Steven Naismith fired over for the Canaries with just the keeper to beat, they doubled their lead in fortunate circumstances as an effort from Murphy deflected off MacDonald into the net.<br>Jerome and Howson then went close to adding a third as Norwich coasted to three points.<br>Norwich caretaker manager Alan Irvine:<br>"I was asked to take charge for two games and I have done that. I haven't heard anything more about what happens going forward, but I should imagine I will be speaking to someone soon to find out what happens next week.<br>"If that is to be my last game in charge it was a good way to finish - and the win certainly makes it interesting as far as the play-offs are concerned.<br>"Being five points behind sounds a lot better than being eight points behind - and as I said last week there are still plenty of points to play for."<br>Barnsley manager Paul Heckingbottom:<br>"The take-away message from that game is hit the target, score goals.<br>"There were plenty of positives to take away from it, but if you are going to get anything in this league you have got to be clinical in front of goal.<br>"It's frustrating, but there is still plenty to play for. We will keep striving to get that perfect performance and obviously want to win as many games as possible between now and the end of the season."<br>Match ends, Norwich City 2, Barnsley 0.<br>Second Half ends, Norwich City 2, Barnsley 0.<br>Hand ball by Nélson Oliveira (Norwich City).<br>Attempt missed. Ryan Kent (Barnsley) right footed shot from the centre of the box is close, but misses to the left. Assisted by Ryan Hedges with a cross.<br>Attempt saved. Nélson Oliveira (Norwich City) left footed shot from outside the box is saved in the centre of the goal.<br>Alex Pritchard (Norwich City) wins a free kick in the attacking half.<br>Foul by Alex Mowatt (Barnsley).<br>Corner,  Barnsley. Conceded by Jonny Howson.<br>Foul by Graham Dorrans (Norwich City).<br>Matthew James (Barnsley) wins a free kick in the defensive half.<br>Attempt missed. Tom Bradshaw (Barnsley) left footed shot from the centre of the box is too high. Assisted by Gethin Jones with a cross.<br>Attempt missed. Steven Naismith (Norwich City) right footed shot from the right side of the box misses to the left. Assisted by Alex Pritchard.<br>Corner,  Norwich City. Conceded by Angus MacDonald.<br>Attempt blocked. Jonny Howson (Norwich City) right footed shot from the right side of the box is blocked. Assisted by Graham Dorrans with a through ball.<br>Substitution, Norwich City. Graham Dorrans replaces Jacob Murphy.<br>Substitution, Norwich City. Nélson Oliveira replaces Cameron Jerome.<br>Substitution, Barnsley. Ryan Hedges replaces Adam Hammill.<br>Attempt missed. Ryan Kent (Barnsley) left footed shot from the centre of the box is high and wide to the left. Assisted by Matthew James with a cross.<br>Attempt saved. Cameron Jerome (Norwich City) right footed shot from the centre of the box is saved in the bottom right corner. Assisted by Jacob Murphy with a through ball.<br>Substitution, Barnsley. Alex Mowatt replaces Marley Watkins.<br>Corner,  Barnsley. Conceded by Ivo Pinto.<br>Corner,  Barnsley. Conceded by Russell Martin.<br>Attempt blocked. Tom Bradshaw (Barnsley) right footed shot from the right side of the box is blocked. Assisted by Ryan Kent.<br>Own Goal by Angus MacDonald, Barnsley.  Norwich City 2, Barnsley 0.<br>Attempt saved. Jacob Murphy (Norwich City) right footed shot from the centre of the box is saved in the bottom right corner. Assisted by Alex Pritchard.<br>Attempt saved. Steven Naismith (Norwich City) left footed shot from the centre of the box is saved in the bottom left corner. Assisted by Steven Whittaker with a cross.<br>Ivo Pinto (Norwich City) wins a free kick in the defensive half.<br>Foul by Adam Hammill (Barnsley).<br>Attempt saved. Ryan Kent (Barnsley) right footed shot from outside the box is saved in the centre of the goal. Assisted by Marley Watkins.<br>Attempt missed. Josh Scowen (Barnsley) right footed shot from outside the box is high and wide to the right. Assisted by Adam Hammill.<br>Jacob Murphy (Norwich City) wins a free kick in the attacking half.<br>Foul by Angus MacDonald (Barnsley).<br>Ryan Bennett (Norwich City) wins a free kick in the defensive half.<br>Foul by Marc Roberts (Barnsley).<br>Ivo Pinto (Norwich City) is shown the yellow card for a bad foul.<br>Foul by Ivo Pinto (Norwich City).<br>Ryan Kent (Barnsley) wins a free kick in the attacking half.<br>Foul by Ryan Bennett (Norwich City).<br>Tom Bradshaw (Barnsley) wins a free kick in the attacking half.<br>Attempt missed. Steven Naismith (Norwich City) left footed shot from the left side of the box is too high. Assisted by Alex Pritchard.</code> | <code>Norwich City kept their Championship play-off hopes alive by beating Barnsley at Carrow Road.</code>                                                     |
+  | <code>Political reporter Samantha Maiden said the offensive text, which also contained strong language, was intended for disgraced ex-minister Jamie Briggs.<br>She said Mr Dutton apologised for the message about her article referring to Mr Briggs' recent resignation.<br>The BBC has approached Mr Dutton's office for comment.<br>He reportedly told News Corp in a statement he is expecting a "tough time" in Ms Maiden's next article.<br>"Sam and I have exchanged some robust language over the years so we had a laugh after this and I apologised to her straightaway, which she took in good faith," Mr Dutton was quoted as saying.<br>Former Cities Minister Jamie Briggs resigned last week following a complaint from a female public servant over his alleged conduct during a night out in Hong Kong.</code>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     | <code>Australia's Immigration Minister Peter Dutton has reportedly apologised for mistakenly sending an SMS to a journalist, calling her a "mad witch".</code> |
+  | <code>Demonstrators have moved around several sites since April to highlight a crisis in temporary housing.<br>The council's lawyer told the court "trespass, highways and planning laws" were the grounds for the case.<br>The cost to the council in terms of additional policing, security and legal costs has exceeded £100,000, he added.<br>Ahead of the hearing, tents were set up and a banner reading "The homeless resistance" was hung outside Manchester Civil Justice Centre.<br>'Grave and serious'<br>Protesters said they hoped to be offered "permanent, suitable accommodation".<br>Some had earlier refused temporary accommodation offered by the council because they said it was "not suitable" and they felt unsafe.<br>The council said it had engaged with the protestors and had offered them support, but it could not accept anti-social behaviour and disruption to residents and businesses.<br>Councillor Nigel Murphy added the exclusion order was "designed to prevent the recurrence of camps and not targeted at individual rough sleepers".<br>He said the council would work with police and court bailiffs to "regain possession" of areas taken over by camps in St Ann's Square and Castlefield as soon as possible.<br>John Clegg, from Unison's community branch, said there was a lack of social housing in Manchester.<br>He added: "There is a large amount of money for building private flats, more hotels are going up all the time, but there are no plans to build any social housing. That's wrong. That's absolutely wrong."<br>"In our view an injunction is a form of gating, and sending out a message that poor people are not wanted and should not be coming in to the city centre."</code>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               | <code>A Manchester City Council application for an injunction to stop the setting up of homeless camps in the city centre has been granted.</code>             |
 * Loss: [<code>MultipleNegativesSymmetricRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativessymmetricrankingloss) with these parameters:
   ```json
   {
@@ -345,19 +340,19 @@ You can finetune this model on your own dataset.
 #### compression-pairs
 
 * Dataset: [compression-pairs](https://huggingface.co/datasets/sentence-transformers/sentence-compression) at [605bc91](https://huggingface.co/datasets/sentence-transformers/sentence-compression/tree/605bc91d95631895ba25b6eda51a3cb596976c90)
-* Size: 45,000 training samples
+* Size: 180,000 training samples
 * Columns: <code>sentence1</code> and <code>sentence2</code>
 * Approximate statistics based on the first 1000 samples:
   |         | sentence1                                                                           | sentence2                                                                         |
   |:--------|:------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|
   | type    | string                                                                              | string                                                                            |
-  | details | <ul><li>min: 10 tokens</li><li>mean: 31.78 tokens</li><li>max: 170 tokens</li></ul> | <ul><li>min: 5 tokens</li><li>mean: 10.14 tokens</li><li>max: 29 tokens</li></ul> |
+  | details | <ul><li>min: 10 tokens</li><li>mean: 31.89 tokens</li><li>max: 125 tokens</li></ul> | <ul><li>min: 5 tokens</li><li>mean: 10.21 tokens</li><li>max: 28 tokens</li></ul> |
 * Samples:
-  | sentence1                                                                                                                                                                                                                                          | sentence2                                                                                                  |
-  |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------|
-  | <code>The USHL completed an expansion draft on Monday as 10 players who were on the rosters of USHL teams during the 2009-10 season were selected by the League's two newest entries, the Muskegon Lumberjacks and Dubuque Fighting Saints.</code> | <code>USHL completes expansion draft</code>                                                                |
-  | <code>NRT LLC, one of the nation's largest residential real estate brokerage companies, announced several executive appointments within its Coldwell Banker Residential Brokerage operations in Southern California.</code>                        | <code>NRT announces executive appointments at its Coldwell Banker operations in Southern California</code> |
-  | <code>A new survey shows 30 percent of Californians use Twitter, and more and more of us are using our smart phones to go online.</code>                                                                                                           | <code>Survey: 30 percent of Californians use Twitter</code>                                                |
+  | sentence1                                                                                                                                                                                                                                          | sentence2                                              |
+  |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-------------------------------------------------------|
+  | <code>The USHL completed an expansion draft on Monday as 10 players who were on the rosters of USHL teams during the 2009-10 season were selected by the League's two newest entries, the Muskegon Lumberjacks and Dubuque Fighting Saints.</code> | <code>USHL completes expansion draft</code>            |
+  | <code>Major League Baseball Commissioner Bud Selig will be speaking at St. Norbert College next month.</code>                                                                                                                                      | <code>Bud Selig to speak at St. Norbert College</code> |
+  | <code>It's fresh cherry time in Michigan and the best time to enjoy this delicious and nutritious fruit.</code>                                                                                                                                    | <code>It's cherry time</code>                          |
 * Loss: [<code>MultipleNegativesSymmetricRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativessymmetricrankingloss) with these parameters:
   ```json
   {
@@ -371,7 +366,7 @@ You can finetune this model on your own dataset.
 #### nli-pairs
 
 * Dataset: [nli-pairs](https://huggingface.co/datasets/sentence-transformers/all-nli) at [d482672](https://huggingface.co/datasets/sentence-transformers/all-nli/tree/d482672c8e74ce18da116f430137434ba2e52fab)
-* Size: 2,000 evaluation samples
+* Size: 6,808 evaluation samples
 * Columns: <code>sentence1</code> and <code>sentence2</code>
 * Approximate statistics based on the first 1000 samples:
   |         | sentence1                                                                         | sentence2                                                                        |
@@ -395,7 +390,7 @@ You can finetune this model on your own dataset.
 #### qnli-contrastive
 
 * Dataset: [qnli-contrastive](https://huggingface.co/datasets/nyu-mll/glue) at [bcdcba7](https://huggingface.co/datasets/nyu-mll/glue/tree/bcdcba79d07bc864c1c254ccfcedcce55bcc9a8c)
-* Size: 2,000 evaluation samples
+* Size: 5,463 evaluation samples
 * Columns: <code>sentence1</code>, <code>sentence2</code>, and <code>label</code>
 * Approximate statistics based on the first 1000 samples:
   |         | sentence1                                                                         | sentence2                                                                          | label                        |
@@ -414,11 +409,11 @@ You can finetune this model on your own dataset.
 #### Non-Default Hyperparameters
 
 - `eval_strategy`: steps
-- `per_device_train_batch_size`: 64
-- `per_device_eval_batch_size`: 16
-- `learning_rate`: 3e-06
+- `per_device_train_batch_size`: 94
+- `per_device_eval_batch_size`: 32
+- `learning_rate`: 2e-05
 - `weight_decay`: 1e-10
-- `num_train_epochs`: 5
+- `num_train_epochs`: 2
 - `lr_scheduler_type`: cosine
 - `warmup_ratio`: 0.33
 - `save_safetensors`: False
@@ -427,7 +422,6 @@ You can finetune this model on your own dataset.
 - `hub_model_id`: bobox/DeBERTaV3-small-GeneralSentenceTransformer-checkpoints-tmp
 - `hub_strategy`: checkpoint
 - `batch_sampler`: no_duplicates
-- `multi_dataset_batch_sampler`: round_robin
 
 #### All Hyperparameters
 <details><summary>Click to expand</summary>
@@ -436,19 +430,19 @@ You can finetune this model on your own dataset.
 - `do_predict`: False
 - `eval_strategy`: steps
 - `prediction_loss_only`: True
-- `per_device_train_batch_size`: 64
-- `per_device_eval_batch_size`: 16
+- `per_device_train_batch_size`: 94
+- `per_device_eval_batch_size`: 32
 - `per_gpu_train_batch_size`: None
 - `per_gpu_eval_batch_size`: None
 - `gradient_accumulation_steps`: 1
 - `eval_accumulation_steps`: None
-- `learning_rate`: 3e-06
+- `learning_rate`: 2e-05
 - `weight_decay`: 1e-10
 - `adam_beta1`: 0.9
 - `adam_beta2`: 0.999
 - `adam_epsilon`: 1e-08
 - `max_grad_norm`: 1.0
-- `num_train_epochs`: 5
+- `num_train_epochs`: 2
 - `max_steps`: -1
 - `lr_scheduler_type`: cosine
 - `lr_scheduler_kwargs`: {}
@@ -539,34 +533,23 @@ You can finetune this model on your own dataset.
 - `optim_target_modules`: None
 - `batch_eval_metrics`: False
 - `batch_sampler`: no_duplicates
-- `multi_dataset_batch_sampler`: round_robin
+- `multi_dataset_batch_sampler`: proportional
 
 </details>
 
 ### Training Logs
 | Epoch  | Step | Training Loss | qnli-contrastive loss | nli-pairs loss |
 |:------:|:----:|:-------------:|:---------------------:|:--------------:|
-| None   | 0    | -             | 6.0041                | 4.0946         |
-| 0.25   | 116  | 4.9013        | 5.9679                | 4.0430         |
-| 0.5    | 232  | 4.6399        | 5.5328                | 3.8479         |
-| 0.75   | 348  | 4.4683        | 4.2996                | 3.6937         |
-| 1.0    | 464  | 3.8129        | 2.8062                | 3.4773         |
-| 1.2457 | 580  | 3.3971        | 1.8330                | 3.1263         |
-| 1.4957 | 696  | 2.7459        | 1.2780                | 2.7294         |
-| 1.7457 | 812  | 2.8721        | 0.9296                | 2.2870         |
-| 1.9957 | 928  | 2.5066        | 0.6388                | 2.0548         |
-| 2.2414 | 1044 | 2.3223        | 0.5312                | 1.8876         |
-| 2.4914 | 1160 | 2.1771        | 0.4300                | 1.7922         |
-| 2.7414 | 1276 | 2.2549        | 0.3610                | 1.6473         |
-| 2.9914 | 1392 | 2.2168        | 0.2929                | 1.5590         |
-| 3.2371 | 1508 | 2.0581        | 0.2678                | 1.5177         |
-| 3.4871 | 1624 | 1.9654        | 0.2392                | 1.5037         |
-| 3.7371 | 1740 | 2.1107        | 0.2234                | 1.4557         |
-| 3.9871 | 1856 | 2.0709        | 0.2094                | 1.4287         |
-| 4.2328 | 1972 | 1.9489        | 0.2072                | 1.4167         |
-| 4.4828 | 2088 | 1.8238        | 0.2019                | 1.4155         |
-| 4.7328 | 2204 | 2.1587        | 0.2005                | 1.4136         |
-| 4.9828 | 2320 | 1.929         | 0.2005                | 1.4132         |
+| None   | 0    | -             | 20.1737               | 4.0959         |
+| 0.1001 | 734  | 4.796         | -                     | -              |
+| 0.2001 | 1468 | 1.3015        | 0.0358                | 0.9115         |
+| 0.3002 | 2202 | 0.89          | -                     | -              |
+| 0.4002 | 2936 | 0.716         | 0.0168                | 0.5944         |
+| 0.5003 | 3670 | 0.6365        | -                     | -              |
+| 0.6003 | 4404 | 0.5883        | 0.0164                | 0.4975         |
+| 0.7004 | 5138 | 0.5192        | -                     | -              |
+| 0.8004 | 5872 | 0.4961        | 0.0288                | 0.4450         |
+| 0.9005 | 6606 | 0.6035        | -                     | -              |
 
 
 ### Framework Versions
@@ -607,15 +590,14 @@ You can finetune this model on your own dataset.
 }
 ```
 
-#### AnglELoss
+#### CoSENTLoss
 ```bibtex
-@misc{li2023angleoptimized,
-    title={AnglE-optimized Text Embeddings}, 
-    author={Xianming Li and Jing Li},
-    year={2023},
-    eprint={2309.12871},
-    archivePrefix={arXiv},
-    primaryClass={cs.CL}
+@online{kexuefm-8847,
+    title={CoSENT: A more efficient sentence vector scheme than Sentence-BERT},
+    author={Su Jianlin},
+    year={2022},
+    month={Jan},
+    url={https://kexue.fm/archives/8847},
 }
 ```
 

last-checkpoint/optimizer.pt

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2415efd86ddb31b8ccd116ba8fb00cf3a2bb32e6d5d2ef1d307b59571c494cb5
+oid sha256:6a749be1ff609ad2bded40d5b2fb1132d3d648b50ef1b7246d14619faa8c58f8
 size 1130520122

last-checkpoint/pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:aa6de6db3864cbe5490abac662a29ae3c7a4c0dce0a1063f4172a3ba474b3b0e
+oid sha256:5b7a78caf0b7de88dddf8c331c22dc8a0c8a8173693518132a3c2bc00703c2dc
 size 565251810

last-checkpoint/rng_state.pth

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ee7def8d6e19abe0010fc23ee8ceef6f2e3224be5f40cd1c4f4ae996d6eab300
+oid sha256:cdc73eeb20f0bc899b26bfb3842397bedfaaf0599682feea9dcc50aa3a5f6766
 size 14180

last-checkpoint/scheduler.pt

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0d07db50179fc1817acd2aeda9c1e69355a330f49f4a4908ab69b93d19e89e01
+oid sha256:c524663492ab13642dabc57fe5921f5cabb07eb2dedd76a5d83a640195afeb24
 size 1064

last-checkpoint/trainer_state.json

@@ -1,479 +1,146 @@
 {
   "best_metric": null,
   "best_model_checkpoint": null,
-  "epoch": 4.982758620689655,
-  "eval_steps": 116,
-  "global_step": 2320,
+  "epoch": 1.0,
+  "eval_steps": 1468,
+  "global_step": 7336,
   "is_hyper_param_search": false,
   "is_local_process_zero": true,
   "is_world_process_zero": true,
   "log_history": [
     {
-      "epoch": 0.25,
-      "grad_norm": 34.43177795410156,
-      "learning_rate": 4.386422976501306e-07,
-      "loss": 4.9013,
-      "step": 116
+      "epoch": 0.10005452562704471,
+      "grad_norm": 11.328764915466309,
+      "learning_rate": 3.0111524163568777e-06,
+      "loss": 4.796,
+      "step": 734
     },
     {
-      "epoch": 0.25,
-      "eval_nli-pairs_loss": 4.042984962463379,
-      "eval_nli-pairs_runtime": 1.346,
-      "eval_nli-pairs_samples_per_second": 1485.842,
-      "eval_nli-pairs_steps_per_second": 92.865,
-      "step": 116
+      "epoch": 0.20010905125408943,
+      "grad_norm": 8.898218154907227,
+      "learning_rate": 6.042957455596862e-06,
+      "loss": 1.3015,
+      "step": 1468
     },
     {
-      "epoch": 0.25,
-      "eval_qnli-contrastive_loss": 5.967944145202637,
-      "eval_qnli-contrastive_runtime": 1.4504,
-      "eval_qnli-contrastive_samples_per_second": 1378.915,
-      "eval_qnli-contrastive_steps_per_second": 86.182,
-      "step": 116
+      "epoch": 0.20010905125408943,
+      "eval_nli-pairs_loss": 0.9115270376205444,
+      "eval_nli-pairs_runtime": 3.7365,
+      "eval_nli-pairs_samples_per_second": 1822.03,
+      "eval_nli-pairs_steps_per_second": 57.005,
+      "step": 1468
     },
     {
-      "epoch": 0.5,
-      "grad_norm": 12.268269538879395,
-      "learning_rate": 8.929503916449087e-07,
-      "loss": 4.6399,
-      "step": 232
+      "epoch": 0.20010905125408943,
+      "eval_qnli-contrastive_loss": 0.03581170365214348,
+      "eval_qnli-contrastive_runtime": 3.4652,
+      "eval_qnli-contrastive_samples_per_second": 1576.52,
+      "eval_qnli-contrastive_steps_per_second": 49.347,
+      "step": 1468
     },
     {
-      "epoch": 0.5,
-      "eval_nli-pairs_loss": 3.8479082584381104,
-      "eval_nli-pairs_runtime": 1.2981,
-      "eval_nli-pairs_samples_per_second": 1540.739,
-      "eval_nli-pairs_steps_per_second": 96.296,
-      "step": 232
+      "epoch": 0.30016357688113415,
+      "grad_norm": 5.427567005157471,
+      "learning_rate": 9.074762494836845e-06,
+      "loss": 0.89,
+      "step": 2202
     },
     {
-      "epoch": 0.5,
-      "eval_qnli-contrastive_loss": 5.532758712768555,
-      "eval_qnli-contrastive_runtime": 1.4399,
-      "eval_qnli-contrastive_samples_per_second": 1388.943,
-      "eval_qnli-contrastive_steps_per_second": 86.809,
-      "step": 232
+      "epoch": 0.40021810250817885,
+      "grad_norm": 3.5350825786590576,
+      "learning_rate": 1.210656753407683e-05,
+      "loss": 0.716,
+      "step": 2936
     },
     {
-      "epoch": 0.75,
-      "grad_norm": 41.44931411743164,
-      "learning_rate": 1.343342036553525e-06,
-      "loss": 4.4683,
-      "step": 348
+      "epoch": 0.40021810250817885,
+      "eval_nli-pairs_loss": 0.5944256782531738,
+      "eval_nli-pairs_runtime": 3.5093,
+      "eval_nli-pairs_samples_per_second": 1940.006,
+      "eval_nli-pairs_steps_per_second": 60.696,
+      "step": 2936
     },
     {
-      "epoch": 0.75,
-      "eval_nli-pairs_loss": 3.69368314743042,
-      "eval_nli-pairs_runtime": 1.304,
-      "eval_nli-pairs_samples_per_second": 1533.712,
-      "eval_nli-pairs_steps_per_second": 95.857,
-      "step": 348
+      "epoch": 0.40021810250817885,
+      "eval_qnli-contrastive_loss": 0.016810204833745956,
+      "eval_qnli-contrastive_runtime": 3.3523,
+      "eval_qnli-contrastive_samples_per_second": 1629.638,
+      "eval_qnli-contrastive_steps_per_second": 51.01,
+      "step": 2936
     },
     {
-      "epoch": 0.75,
-      "eval_qnli-contrastive_loss": 4.299612998962402,
-      "eval_qnli-contrastive_runtime": 1.4461,
-      "eval_qnli-contrastive_samples_per_second": 1383.027,
-      "eval_qnli-contrastive_steps_per_second": 86.439,
-      "step": 348
+      "epoch": 0.5002726281352236,
+      "grad_norm": 9.52629280090332,
+      "learning_rate": 1.5134242048740192e-05,
+      "loss": 0.6365,
+      "step": 3670
     },
     {
-      "epoch": 1.0,
-      "grad_norm": 16.208133697509766,
-      "learning_rate": 1.7976501305483032e-06,
-      "loss": 3.8129,
-      "step": 464
+      "epoch": 0.6003271537622683,
+      "grad_norm": 11.004107475280762,
+      "learning_rate": 1.8166047087980174e-05,
+      "loss": 0.5883,
+      "step": 4404
     },
     {
-      "epoch": 1.0,
-      "eval_nli-pairs_loss": 3.477344036102295,
-      "eval_nli-pairs_runtime": 1.2934,
-      "eval_nli-pairs_samples_per_second": 1546.283,
-      "eval_nli-pairs_steps_per_second": 96.643,
-      "step": 464
+      "epoch": 0.6003271537622683,
+      "eval_nli-pairs_loss": 0.49746155738830566,
+      "eval_nli-pairs_runtime": 3.5691,
+      "eval_nli-pairs_samples_per_second": 1907.459,
+      "eval_nli-pairs_steps_per_second": 59.678,
+      "step": 4404
     },
     {
-      "epoch": 1.0,
-      "eval_qnli-contrastive_loss": 2.806222915649414,
-      "eval_qnli-contrastive_runtime": 1.4307,
-      "eval_qnli-contrastive_samples_per_second": 1397.948,
-      "eval_qnli-contrastive_steps_per_second": 87.372,
-      "step": 464
+      "epoch": 0.6003271537622683,
+      "eval_qnli-contrastive_loss": 0.016411835327744484,
+      "eval_qnli-contrastive_runtime": 3.3328,
+      "eval_qnli-contrastive_samples_per_second": 1639.167,
+      "eval_qnli-contrastive_steps_per_second": 51.308,
+      "step": 4404
     },
     {
-      "epoch": 1.2456896551724137,
-      "grad_norm": 98.47541046142578,
-      "learning_rate": 2.251958224543081e-06,
-      "loss": 3.3971,
-      "step": 580
+      "epoch": 0.700381679389313,
+      "grad_norm": 9.219084739685059,
+      "learning_rate": 1.995708117651556e-05,
+      "loss": 0.5192,
+      "step": 5138
     },
     {
-      "epoch": 1.2456896551724137,
-      "eval_nli-pairs_loss": 3.126293182373047,
-      "eval_nli-pairs_runtime": 1.3419,
-      "eval_nli-pairs_samples_per_second": 1490.389,
-      "eval_nli-pairs_steps_per_second": 93.149,
-      "step": 580
+      "epoch": 0.8004362050163577,
+      "grad_norm": 7.066645622253418,
+      "learning_rate": 1.946925849011595e-05,
+      "loss": 0.4961,
+      "step": 5872
     },
     {
-      "epoch": 1.2456896551724137,
-      "eval_qnli-contrastive_loss": 1.8329846858978271,
-      "eval_qnli-contrastive_runtime": 1.5173,
-      "eval_qnli-contrastive_samples_per_second": 1318.109,
-      "eval_qnli-contrastive_steps_per_second": 82.382,
-      "step": 580
+      "epoch": 0.8004362050163577,
+      "eval_nli-pairs_loss": 0.44500303268432617,
+      "eval_nli-pairs_runtime": 3.6078,
+      "eval_nli-pairs_samples_per_second": 1887.014,
+      "eval_nli-pairs_steps_per_second": 59.038,
+      "step": 5872
     },
     {
-      "epoch": 1.4956896551724137,
-      "grad_norm": 16.574974060058594,
-      "learning_rate": 2.706266318537859e-06,
-      "loss": 2.7459,
-      "step": 696
+      "epoch": 0.8004362050163577,
+      "eval_qnli-contrastive_loss": 0.028794871643185616,
+      "eval_qnli-contrastive_runtime": 3.335,
+      "eval_qnli-contrastive_samples_per_second": 1638.074,
+      "eval_qnli-contrastive_steps_per_second": 51.274,
+      "step": 5872
     },
     {
-      "epoch": 1.4956896551724137,
-      "eval_nli-pairs_loss": 2.72936749458313,
-      "eval_nli-pairs_runtime": 1.3359,
-      "eval_nli-pairs_samples_per_second": 1497.081,
-      "eval_nli-pairs_steps_per_second": 93.568,
-      "step": 696
-    },
-    {
-      "epoch": 1.4956896551724137,
-      "eval_qnli-contrastive_loss": 1.2779531478881836,
-      "eval_qnli-contrastive_runtime": 1.4644,
-      "eval_qnli-contrastive_samples_per_second": 1365.702,
-      "eval_qnli-contrastive_steps_per_second": 85.356,
-      "step": 696
-    },
-    {
-      "epoch": 1.7456896551724137,
-      "grad_norm": 201.21456909179688,
-      "learning_rate": 2.9950983500630964e-06,
-      "loss": 2.8721,
-      "step": 812
-    },
-    {
-      "epoch": 1.7456896551724137,
-      "eval_nli-pairs_loss": 2.2870194911956787,
-      "eval_nli-pairs_runtime": 1.3503,
-      "eval_nli-pairs_samples_per_second": 1481.188,
-      "eval_nli-pairs_steps_per_second": 92.574,
-      "step": 812
-    },
-    {
-      "epoch": 1.7456896551724137,
-      "eval_qnli-contrastive_loss": 0.9296175837516785,
-      "eval_qnli-contrastive_runtime": 1.4485,
-      "eval_qnli-contrastive_samples_per_second": 1380.738,
-      "eval_qnli-contrastive_steps_per_second": 86.296,
-      "step": 812
-    },
-    {
-      "epoch": 1.9956896551724137,
-      "grad_norm": 12.68950366973877,
-      "learning_rate": 2.9260214825373185e-06,
-      "loss": 2.5066,
-      "step": 928
-    },
-    {
-      "epoch": 1.9956896551724137,
-      "eval_nli-pairs_loss": 2.0547828674316406,
-      "eval_nli-pairs_runtime": 1.2929,
-      "eval_nli-pairs_samples_per_second": 1546.937,
-      "eval_nli-pairs_steps_per_second": 96.684,
-      "step": 928
-    },
-    {
-      "epoch": 1.9956896551724137,
-      "eval_qnli-contrastive_loss": 0.6387521028518677,
-      "eval_qnli-contrastive_runtime": 1.4598,
-      "eval_qnli-contrastive_samples_per_second": 1370.032,
-      "eval_qnli-contrastive_steps_per_second": 85.627,
-      "step": 928
-    },
-    {
-      "epoch": 2.2413793103448274,
-      "grad_norm": 12.477553367614746,
-      "learning_rate": 2.7788810181030676e-06,
-      "loss": 2.3223,
-      "step": 1044
-    },
-    {
-      "epoch": 2.2413793103448274,
-      "eval_nli-pairs_loss": 1.8876054286956787,
-      "eval_nli-pairs_runtime": 1.4105,
-      "eval_nli-pairs_samples_per_second": 1417.897,
-      "eval_nli-pairs_steps_per_second": 88.619,
-      "step": 1044
-    },
-    {
-      "epoch": 2.2413793103448274,
-      "eval_qnli-contrastive_loss": 0.5312397480010986,
-      "eval_qnli-contrastive_runtime": 1.4798,
-      "eval_qnli-contrastive_samples_per_second": 1351.505,
-      "eval_qnli-contrastive_steps_per_second": 84.469,
-      "step": 1044
-    },
-    {
-      "epoch": 2.4913793103448274,
-      "grad_norm": 7.06378173828125,
-      "learning_rate": 2.5617317540023054e-06,
-      "loss": 2.1771,
-      "step": 1160
-    },
-    {
-      "epoch": 2.4913793103448274,
-      "eval_nli-pairs_loss": 1.7922124862670898,
-      "eval_nli-pairs_runtime": 1.392,
-      "eval_nli-pairs_samples_per_second": 1436.768,
-      "eval_nli-pairs_steps_per_second": 89.798,
-      "step": 1160
-    },
-    {
-      "epoch": 2.4913793103448274,
-      "eval_qnli-contrastive_loss": 0.4299691915512085,
-      "eval_qnli-contrastive_runtime": 1.4683,
-      "eval_qnli-contrastive_samples_per_second": 1362.111,
-      "eval_qnli-contrastive_steps_per_second": 85.132,
-      "step": 1160
-    },
-    {
-      "epoch": 2.7413793103448274,
-      "grad_norm": 11.377643585205078,
-      "learning_rate": 2.286460925335848e-06,
-      "loss": 2.2549,
-      "step": 1276
-    },
-    {
-      "epoch": 2.7413793103448274,
-      "eval_nli-pairs_loss": 1.647322177886963,
-      "eval_nli-pairs_runtime": 1.3347,
-      "eval_nli-pairs_samples_per_second": 1498.487,
-      "eval_nli-pairs_steps_per_second": 93.655,
-      "step": 1276
-    },
-    {
-      "epoch": 2.7413793103448274,
-      "eval_qnli-contrastive_loss": 0.36095327138900757,
-      "eval_qnli-contrastive_runtime": 1.5309,
-      "eval_qnli-contrastive_samples_per_second": 1306.387,
-      "eval_qnli-contrastive_steps_per_second": 81.649,
-      "step": 1276
-    },
-    {
-      "epoch": 2.9913793103448274,
-      "grad_norm": 8.12272834777832,
-      "learning_rate": 1.968137471297685e-06,
-      "loss": 2.2168,
-      "step": 1392
-    },
-    {
-      "epoch": 2.9913793103448274,
-      "eval_nli-pairs_loss": 1.5589631795883179,
-      "eval_nli-pairs_runtime": 1.2874,
-      "eval_nli-pairs_samples_per_second": 1553.463,
-      "eval_nli-pairs_steps_per_second": 97.091,
-      "step": 1392
-    },
-    {
-      "epoch": 2.9913793103448274,
-      "eval_qnli-contrastive_loss": 0.2929060459136963,
-      "eval_qnli-contrastive_runtime": 1.4489,
-      "eval_qnli-contrastive_samples_per_second": 1380.312,
-      "eval_qnli-contrastive_steps_per_second": 86.269,
-      "step": 1392
-    },
-    {
-      "epoch": 3.2370689655172415,
-      "grad_norm": 14.837372779846191,
-      "learning_rate": 1.6241871278299807e-06,
-      "loss": 2.0581,
-      "step": 1508
-    },
-    {
-      "epoch": 3.2370689655172415,
-      "eval_nli-pairs_loss": 1.5176913738250732,
-      "eval_nli-pairs_runtime": 1.3641,
-      "eval_nli-pairs_samples_per_second": 1466.194,
-      "eval_nli-pairs_steps_per_second": 91.637,
-      "step": 1508
-    },
-    {
-      "epoch": 3.2370689655172415,
-      "eval_qnli-contrastive_loss": 0.2678474187850952,
-      "eval_qnli-contrastive_runtime": 1.5105,
-      "eval_qnli-contrastive_samples_per_second": 1324.09,
-      "eval_qnli-contrastive_steps_per_second": 82.756,
-      "step": 1508
-    },
-    {
-      "epoch": 3.4870689655172415,
-      "grad_norm": 145.98458862304688,
-      "learning_rate": 1.2734385039668851e-06,
-      "loss": 1.9654,
-      "step": 1624
-    },
-    {
-      "epoch": 3.4870689655172415,
-      "eval_nli-pairs_loss": 1.5036982297897339,
-      "eval_nli-pairs_runtime": 1.3348,
-      "eval_nli-pairs_samples_per_second": 1498.309,
-      "eval_nli-pairs_steps_per_second": 93.644,
-      "step": 1624
-    },
-    {
-      "epoch": 3.4870689655172415,
-      "eval_qnli-contrastive_loss": 0.23919104039669037,
-      "eval_qnli-contrastive_runtime": 1.5129,
-      "eval_qnli-contrastive_samples_per_second": 1321.928,
-      "eval_qnli-contrastive_steps_per_second": 82.621,
-      "step": 1624
-    },
-    {
-      "epoch": 3.737068965517241,
-      "grad_norm": 10.36633586883545,
-      "learning_rate": 9.350923617759733e-07,
-      "loss": 2.1107,
-      "step": 1740
-    },
-    {
-      "epoch": 3.737068965517241,
-      "eval_nli-pairs_loss": 1.4556528329849243,
-      "eval_nli-pairs_runtime": 1.4177,
-      "eval_nli-pairs_samples_per_second": 1410.69,
-      "eval_nli-pairs_steps_per_second": 88.168,
-      "step": 1740
-    },
-    {
-      "epoch": 3.737068965517241,
-      "eval_qnli-contrastive_loss": 0.22335131466388702,
-      "eval_qnli-contrastive_runtime": 1.5405,
-      "eval_qnli-contrastive_samples_per_second": 1298.243,
-      "eval_qnli-contrastive_steps_per_second": 81.14,
-      "step": 1740
-    },
-    {
-      "epoch": 3.987068965517241,
-      "grad_norm": 178.8499755859375,
-      "learning_rate": 6.276705238124942e-07,
-      "loss": 2.0709,
-      "step": 1856
-    },
-    {
-      "epoch": 3.987068965517241,
-      "eval_nli-pairs_loss": 1.4286649227142334,
-      "eval_nli-pairs_runtime": 1.2929,
-      "eval_nli-pairs_samples_per_second": 1546.95,
-      "eval_nli-pairs_steps_per_second": 96.684,
-      "step": 1856
-    },
-    {
-      "epoch": 3.987068965517241,
-      "eval_qnli-contrastive_loss": 0.2093583047389984,
-      "eval_qnli-contrastive_runtime": 1.4454,
-      "eval_qnli-contrastive_samples_per_second": 1383.695,
-      "eval_qnli-contrastive_steps_per_second": 86.481,
-      "step": 1856
-    },
-    {
-      "epoch": 4.232758620689655,
-      "grad_norm": 4.497424602508545,
-      "learning_rate": 3.680019472369961e-07,
-      "loss": 1.9489,
-      "step": 1972
-    },
-    {
-      "epoch": 4.232758620689655,
-      "eval_nli-pairs_loss": 1.4166995286941528,
-      "eval_nli-pairs_runtime": 1.3578,
-      "eval_nli-pairs_samples_per_second": 1472.956,
-      "eval_nli-pairs_steps_per_second": 92.06,
-      "step": 1972
-    },
-    {
-      "epoch": 4.232758620689655,
-      "eval_qnli-contrastive_loss": 0.2071654498577118,
-      "eval_qnli-contrastive_runtime": 1.489,
-      "eval_qnli-contrastive_samples_per_second": 1343.182,
-      "eval_qnli-contrastive_steps_per_second": 83.949,
-      "step": 1972
-    },
-    {
-      "epoch": 4.482758620689655,
-      "grad_norm": 8.940858840942383,
-      "learning_rate": 1.7030146916085187e-07,
-      "loss": 1.8238,
-      "step": 2088
-    },
-    {
-      "epoch": 4.482758620689655,
-      "eval_nli-pairs_loss": 1.4154555797576904,
-      "eval_nli-pairs_runtime": 1.4109,
-      "eval_nli-pairs_samples_per_second": 1417.564,
-      "eval_nli-pairs_steps_per_second": 88.598,
-      "step": 2088
-    },
-    {
-      "epoch": 4.482758620689655,
-      "eval_qnli-contrastive_loss": 0.20185217261314392,
-      "eval_qnli-contrastive_runtime": 1.4817,
-      "eval_qnli-contrastive_samples_per_second": 1349.799,
-      "eval_qnli-contrastive_steps_per_second": 84.362,
-      "step": 2088
-    },
-    {
-      "epoch": 4.732758620689655,
-      "grad_norm": 4.952300548553467,
-      "learning_rate": 4.5391654754460885e-08,
-      "loss": 2.1587,
-      "step": 2204
-    },
-    {
-      "epoch": 4.732758620689655,
-      "eval_nli-pairs_loss": 1.4136021137237549,
-      "eval_nli-pairs_runtime": 1.3576,
-      "eval_nli-pairs_samples_per_second": 1473.214,
-      "eval_nli-pairs_steps_per_second": 92.076,
-      "step": 2204
-    },
-    {
-      "epoch": 4.732758620689655,
-      "eval_qnli-contrastive_loss": 0.20051518082618713,
-      "eval_qnli-contrastive_runtime": 1.585,
-      "eval_qnli-contrastive_samples_per_second": 1261.81,
-      "eval_qnli-contrastive_steps_per_second": 78.863,
-      "step": 2204
-    },
-    {
-      "epoch": 4.982758620689655,
-      "grad_norm": 10.16062068939209,
-      "learning_rate": 1.1034588846758897e-10,
-      "loss": 1.929,
-      "step": 2320
-    },
-    {
-      "epoch": 4.982758620689655,
-      "eval_nli-pairs_loss": 1.4131741523742676,
-      "eval_nli-pairs_runtime": 1.2998,
-      "eval_nli-pairs_samples_per_second": 1538.653,
-      "eval_nli-pairs_steps_per_second": 96.166,
-      "step": 2320
-    },
-    {
-      "epoch": 4.982758620689655,
-      "eval_qnli-contrastive_loss": 0.2004699856042862,
-      "eval_qnli-contrastive_runtime": 1.449,
-      "eval_qnli-contrastive_samples_per_second": 1380.303,
-      "eval_qnli-contrastive_steps_per_second": 86.269,
-      "step": 2320
+      "epoch": 0.9004907306434023,
+      "grad_norm": 0.0,
+      "learning_rate": 1.8462745233342613e-05,
+      "loss": 0.6035,
+      "step": 6606
     }
   ],
-  "logging_steps": 116,
-  "max_steps": 2320,
+  "logging_steps": 734,
+  "max_steps": 14672,
   "num_input_tokens_seen": 0,
-  "num_train_epochs": 5,
-  "save_steps": 1160,
+  "num_train_epochs": 2,
+  "save_steps": 7336,
   "stateful_callbacks": {
     "TrainerControl": {
       "args": {
@@ -481,13 +148,13 @@
         "should_evaluate": false,
         "should_log": false,
         "should_save": true,
-        "should_training_stop": true
+        "should_training_stop": false
       },
       "attributes": {}
     }
   },
   "total_flos": 0.0,
-  "train_batch_size": 64,
+  "train_batch_size": 94,
   "trial_name": null,
   "trial_params": null
 }

last-checkpoint/training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e3927bcd6a0300af031763633963eca0939bd43c5b1e09d98c207a1618aa7358
+oid sha256:3b7d09e178b7126106b67daae47202be477d3e950354366f995c79aad0ae7f8f
 size 5624