diff --git "a/checkpoint-219/README.md" "b/checkpoint-219/README.md" --- "a/checkpoint-219/README.md" +++ "b/checkpoint-219/README.md" @@ -10,99 +10,92 @@ tags: - loss:GISTEmbedLoss base_model: BAAI/bge-m3 widget: -- source_sentence: when was the venetian built in las vegas +- source_sentence: friday night lights season 2 how many episodes sentences: - - The Venetian Las Vegas In April 1996, Sheldon Adelson announced plans to create - on the property the largest resort on the Strip. This project would be situated - on the former Sands property. On November 26, 1996, eight years after it was purchased - by the owners of The Interface Group—Adelson, Richard Katzeff, Ted Cutler, Irwin - Chafetz and Jordan Shapiro, the Sands Hotel was imploded to make way for The Venetian - Resort Hotel Casino. Groundbreaking for the hotel began on April 14, 1997. - - 8 Out of 10 Cats The show is currently recorded at Pinewood Studios, previously - at BBC Television Centre, typically the day before transmission. However, in the - past few years, due to Jimmy Carr's stand-up schedule, certain episodes are pretaped - and broadcast later as "special" episodes dealing with a particular subject.[5] - - Hurricane Harvey The eighth named storm, third hurricane, and the first major - hurricane of the extremely active 2017 Atlantic hurricane season, Harvey developed - from a tropical wave to the east of the Lesser Antilles, reaching tropical storm - status on August 17. The storm crossed through the Windward Islands on the following - day, passing just south of Barbados and later near Saint Vincent. Upon entering - the Caribbean Sea, Harvey began to weaken due to moderate wind shear and degenerated - into a tropical wave north of Colombia early on August 20. The remnants were monitored - for regeneration as it continued west-northwestward across the Caribbean and the - Yucatán Peninsula, before redeveloping over the Bay of Campeche on August 23. - Harvey then began to rapidly intensify on August 24, regaining tropical storm - status and becoming a hurricane later that day. While the storm moved generally - northwest, Harvey's intensification phase stalled slightly overnight from August 24–25; - however, Harvey soon resumed strengthening and quickly became a major hurricane - and attained Category 4 intensity later that day. Hours later, Harvey made landfall - near Rockport, Texas, at peak intensity. Afterwards, rapid weakening ensued, and - Harvey had downgraded to a tropical storm as it stalled near the coastline of - the state, dropping torrential and unprecedented amounts of rainfall over the - Lone Star state. On August 28, it emerged back over the Gulf of Mexico, strengthening - slightly before making a third and final landfall in Louisiana on August 29. As - Harvey drifted inland, it quickly weakened again as it became extratropical on - September 1, before dissipating two days later. -- source_sentence: Over 435,000 coronavirus cases had been confirmed around the world - by March 25 , while more than 110,000 people had recovered . + - Ossicles The ossicles (also called auditory ossicles) are three bones in either + middle ear that are among the smallest bones in the human body. They serve to + transmit sounds from the air to the fluid-filled labyrinth (cochlea). The absence + of the auditory ossicles would constitute a moderate-to-severe hearing loss. The + term "ossicle" literally means "tiny bone". Though the term may refer to any small + bone throughout the body, it typically refers to the malleus, incus, and stapes + (hammer, anvil, and stirrup) of the middle ear. + - 'Ring a Ring o'' Roses It is unknown what the earliest version of the rhyme was + or when it began. Many incarnations of the game have a group of children form + a ring, dance in a circle around a person, and stoop or curtsy with the final + line. The slowest child to do so is faced with a penalty or becomes the "rosie" + (literally: rose tree, from the French rosier) and takes their place in the center + of the ring.' + - Friday Night Lights (season 2) The second season of the American serial drama + television series Friday Night Lights commenced airing in the United States and + Canada on October 5, 2007 and concluded its 15-episode season on February 7, 2008, + on NBC. While initially renewed for a 22-episode full season, the show ended production + for the season after filming the 15th episode, due to the 2007–08 Writers Guild + of America strike.[1] The series' future was once again placed in doubt as it + did not return to production once the strike ended, and it continued to suffer + from low ratings in its new Friday at 9:00 pm time slot. However, NBC announced + in April 2008 that the show would return for a third season, with first-run broadcasts + airing on DirecTV's The 101 Network.[2] The second season was released on DVD + in region 1 on April 22, 2008.[3] +- source_sentence: More than 273 people have died from the 2019-20 coronavirus outside + mainland China . sentences: - - As of 25 March , more than 445,000 cases of COVID-19 have been reported in more - than 190 countries and territories , resulting in more than 19,700 deaths and - more than 112,000 recoveries . - - As of 25 March , more than 435,000 cases of COVID-19 have been reported in more - than 190 countries and territories , resulting in more than 19,600 deaths and - more than 111,000 recoveries . - - As of 23 March , more than 372,000 cases of COVID-19 have been reported in over - 190 countries and territories , resulting in more than 16,300 deaths and over - 101,000 recoveries . -- source_sentence: When it rains, some animals will move to seek shelter. + - 'More than 3,700 people have died : around 3,100 in mainland China and around + 550 in all other countries combined .' + - 'More than 3,200 people have died : almost 3,000 in mainland China and around + 275 in other countries .' + - more than 4,900 deaths have been attributed to COVID-19 . +- source_sentence: Life cycle is the term for the span in the life of an organism + from one generation to the next. sentences: - - What is the term for cellular eating? - - What kind of family is haumea part of? - - When it rains, some animals will -- source_sentence: Pyramid ecosystem modeling can also be used to show energy flow - through the trophic levels; pyramids of energy are always upright since energy - decreases at each trophic level. + - What is the term for the span in the life of an organism from one generation to + the next? + - While spermatogenesis produces four haploid sperm cells, oogenesis produces one + mature what? + - In what type of climate might one find deciduous trees? +- source_sentence: The source of geothermal power is the heat contained inside the + Earth; sentences: - - Pyramid ecosystem is used to show energy flow through the trophic levels. - - The extensive property is a property that depends on the amount of matter in a - sample. - - Other than gametes, normal human cells have a total of 46 chromosomes per cell. -- source_sentence: Where is the White Desert National Park situated? + - A ribosome consists of two elements, rrna and proteins. + - Geothermal power is generated via underground sources of heat. + - The ph scale measures acids and bases and has 7 as a neutral value. +- source_sentence: Which hand puppet would you associate with Shari Lewis? sentences: - - 'Victoria, the Capital of British Columbia, Canada Updated: 12/16/2014 About the - City of Victoria, British Columbia Victoria is the capital city of the province - of British Columbia , Canada. Victoria is a gateway to the Pacific Rim, is close - to U.S. Markets, and has many sea and air links that make it a business hub. With - the mildest climate in Canada, Victoria is known for its gardens and is a clean - and charming city. Victoria holds many reminders of both its native and British - heritage, and views of totem poles combine with afternoon tea. The focus of downtown - Victoria is the inner harbour, overlooked by the Parliament Buildings and the - historic Fairmont Empress Hotel. Location of Victoria, British Columbia Victoria - is located on the southern tip of Vancouver Island.' - - Egyptian Tourism Authority HOME > Adventure The White Desert The White Desert - is justifiably the most well-known desert destination in Egypt – and for a good - reason. The quantity of unearthly and beautiful wind-carved rock formations shaped - in the form of giant mushrooms or pebbles is unequalled in any desert in the world. - Farafra is nearer than Bahariya to this 300 kilometres protectorate, yet it offers - a more limited choice of tours and safaris. However, it is still the perfect starting - point for an overnight journey into the infinite whiteness. - - Madness Concert Music Dubai Madness live concert, Dubai Concert, Dubai live entertainment,Dubai - Duty Free Tennis Stadium British music legends Madness have been confirmed to - play at the Dubai Duty Free Tennis Stadium on Thursday October 6. One of the most - prominent bands of the late 1970s and early 1980s, Madness are an English SKA - band that formed in Camden, London and were part of the 2Tone Ska revival. They - were hugely popular in the 1980s, spending over 214 weeks in the UK singles chart - between 1980 and 1986, including 15 singles in the Top 10. They had only one No.1 - during their career, but House of Fun is still a current radio favourite. Led - by gang leader Suggs, Madness are still a band in demand and in February 2015 - the band announced the Grandslam tour, taking in 20 outdoor venues.The band shot - back into prominence in 2012 when they performed at the Queen's Diamond Jubilee - Concert at Buckingham Palace, and then played at the closing Ceremony for the - London Olympics. Madness also announced their new album Can't Touch Us Now which - is due to be released 21st October 2016 and a tour to follow in December 2016. - Doors open at 7PM. Tickets for the show on October 6 are available from Platinumlist.net, - with seated tickets AED250 and standing AED300. + - Names of Presidents and First Ladies President's and First Ladies' Names Alphabetically + Presidents' First Names Presidents' Middle Names Presidents' Last Names First + Ladies' First Names First Ladies' Maiden names Abraham Abram Adams x 2 Abigail + Appleton Andrew Alan Arthur Anna x 3 Bouvier Andrew Baines Buchanan Barbara Carow + Benjamin Birchard Bush x 2 Caroline Childress Calvin Clark Carter Claudia "Lady + Bird" Custis Chester David Cleveland Dolly Davis Dwight Delano Clinton Edith x + 2 Dent Franklin x 2 Earl Coolidge Eleanor x 2 deWolf George x 3 Fitzgerald Eisenhower + Eliza Doud Gerald Gamaliel Fillmore Elizabeth "Bess" Fulsom Grover Henry Ford + Elizabeth "Betty" Galt Harry Herbert Walker Garfield Elizabeth "Eliza" Gardiner + Herbert Howard Grant Ellen Goodhew James x 5 Jefferson Harding Florence Henry + John x 4 Knox Harrison x 2 Frances Herndon Lyndon Milhous Hayes Hannah Herron + Martin Quincy Hoover Helen Hoes Millard Rudolph Jackson Hillary Johnson Richard + S Jefferson Ida Kortright Ronald Simpson Johnson x 2 Jacqueline McCardle Rutherford + Walker Kennedy Jane Pierce Theodore Wilson Lincoln Julia x 2 Powers Thomas Madison + Laura Robards Ulysses McKinley Lou Rodham Warren Monroe Louisa Roosevelt William + x 4 Nixon Lucretia Rudolph Woodrow Pierce Lucy Ryan Zachary Polk Margaret Saxton + Reagan Martha x 2 Scott Roosevelt x 2 Mary Skelton Taft Mary "Mamie" Smith x 3 + Taylor Nancy Symmes Truman Rachel Taylor Tyler Rosalynn Todd x 2 VanBuren Sarah + Wallace Washington Thelma "Patricia" Warren Wilson Webb Welch + - 'Shari Lewis Puppets | eBay Shari Lewis Puppets Buy It Now Free Shipping This + baby doll puppet was part of my mom''s doll collection. Shari''s Baby: Teach Baby + to Talk. Baby Puppet with Blanket. This doll has been on display, but has not + been played with. It comes from a smo... $11.70 Buy It Now Shari Lewis. Lamb Chop + and 2 Charlie the Horse Puppets. lamb chop: 5" X 8". horse: 6" X 11". horse: 5.5" + X 10". Classic children''s entertainer!all the rubber faces have some areas of + rubbing and tiny ...' + - 'What is the chemical formula for gold? | Reference.com What is the chemical formula + for gold? A: Quick Answer The chemical formula for gold is Au, which is its periodic + table symbol. The symbol comes from the Latin word for gold, "aurum." Full Answer + Gold is a highly valued metal that has been known about for roughly 5,500 years. + It can sometimes be found on its own, but it is more often found mixed with silver, + quartz, lead, zinc and copper. There is also approximately 1 milligram of gold + dissolved in every ton of seawater, but it would cost more to extract it than + the gold is worth. Gold is valuable because it is malleable, a good conductor + of heat and electricity and does not tarnish when exposed to air. Plus, it sparkles + which pleases jewelry lovers.' datasets: - bobox/enhanced_NLI-50K - tals/vitaminc @@ -138,10 +131,10 @@ model-index: type: sts-test metrics: - type: pearson_cosine - value: 0.8508165029528609 + value: 0.9026620207137961 name: Pearson Cosine - type: spearman_cosine - value: 0.8665992028008191 + value: 0.913678627606199 name: Spearman Cosine - task: type: binary-classification @@ -151,25 +144,25 @@ model-index: type: allNLI-dev metrics: - type: cosine_accuracy - value: 0.7451171875 + value: 0.76953125 name: Cosine Accuracy - type: cosine_accuracy_threshold - value: 0.7058684229850769 + value: 0.7752166986465454 name: Cosine Accuracy Threshold - type: cosine_f1 - value: 0.6633039092055485 + value: 0.6624737945492662 name: Cosine F1 - type: cosine_f1_threshold - value: 0.6644865274429321 + value: 0.6564935445785522 name: Cosine F1 Threshold - type: cosine_precision - value: 0.579295154185022 + value: 0.5197368421052632 name: Cosine Precision - type: cosine_recall - value: 0.775811209439528 + value: 0.9132947976878613 name: Cosine Recall - type: cosine_ap - value: 0.6358738534384165 + value: 0.6627175481841632 name: Cosine Ap - task: type: binary-classification @@ -179,25 +172,25 @@ model-index: type: Qnli-dev metrics: - type: cosine_accuracy - value: 0.7353515625 + value: 0.705078125 name: Cosine Accuracy - type: cosine_accuracy_threshold - value: 0.641769528388977 + value: 0.6866907477378845 name: Cosine Accuracy Threshold - type: cosine_f1 - value: 0.7255734919286321 + value: 0.6931818181818182 name: Cosine F1 - type: cosine_f1_threshold - value: 0.533623456954956 + value: 0.6343963146209717 name: Cosine F1 Threshold - type: cosine_precision - value: 0.6170520231213873 + value: 0.6267123287671232 name: Cosine Precision - type: cosine_recall - value: 0.8804123711340206 + value: 0.7754237288135594 name: Cosine Recall - type: cosine_ap - value: 0.7934694922676566 + value: 0.7567018413685389 name: Cosine Ap --- @@ -245,6 +238,12 @@ SentenceTransformer( (mha): MultiheadAttention( (out_proj): NonDynamicallyQuantizableLinear(in_features=1024, out_features=1024, bias=True) ) + (MLP): Sequential( + (0): Linear(in_features=1024, out_features=2048, bias=True) + (1): ReLU() + (2): Linear(in_features=2048, out_features=1024, bias=True) + ) + (layernorm): LayerNorm((1024,), eps=1e-05, elementwise_affine=True) ) ) ``` @@ -267,9 +266,9 @@ from sentence_transformers import SentenceTransformer model = SentenceTransformer("bobox/XLMRoBERTaM3-CustomPoolin-v1-s1-checkpoints-tmp") # Run inference sentences = [ - 'Where is the White Desert National Park situated?', - 'Egyptian Tourism Authority HOME > Adventure The White Desert The White Desert is justifiably the most well-known desert destination in Egypt – and for a good reason. The quantity of unearthly and beautiful wind-carved rock formations shaped in the form of giant mushrooms or pebbles is unequalled in any desert in the world. Farafra is nearer than Bahariya to this 300 kilometres protectorate, yet it offers a more limited choice of tours and safaris. However, it is still the perfect starting point for an overnight journey into the infinite whiteness.', - "Madness Concert Music Dubai Madness live concert, Dubai Concert, Dubai live entertainment,Dubai Duty Free Tennis Stadium British music legends Madness have been confirmed to play at the Dubai Duty Free Tennis Stadium on Thursday October 6. One of the most prominent bands of the late 1970s and early 1980s, Madness are an English SKA band that formed in Camden, London and were part of the 2Tone Ska revival. They were hugely popular in the 1980s, spending over 214 weeks in the UK singles chart between 1980 and 1986, including 15 singles in the Top 10. They had only one No.1 during their career, but House of Fun is still a current radio favourite. Led by gang leader Suggs, Madness are still a band in demand and in February 2015 the band announced the Grandslam tour, taking in 20 outdoor venues.The band shot back into prominence in 2012 when they performed at the Queen's Diamond Jubilee Concert at Buckingham Palace, and then played at the closing Ceremony for the London Olympics. Madness also announced their new album Can't Touch Us Now which is due to be released 21st October 2016 and a tour to follow in December 2016. Doors open at 7PM. Tickets for the show on October 6 are available from Platinumlist.net, with seated tickets AED250 and standing AED300.", + 'Which hand puppet would you associate with Shari Lewis?', + 'Shari Lewis Puppets | eBay Shari Lewis Puppets Buy It Now Free Shipping This baby doll puppet was part of my mom\'s doll collection. Shari\'s Baby: Teach Baby to Talk. Baby Puppet with Blanket. This doll has been on display, but has not been played with. It comes from a smo... $11.70 Buy It Now Shari Lewis. Lamb Chop and 2 Charlie the Horse Puppets. lamb chop: 5" X 8". horse: 6" X 11". horse: 5.5" X 10". Classic children\'s entertainer!all the rubber faces have some areas of rubbing and tiny ...', + 'Names of Presidents and First Ladies President\'s and First Ladies\' Names Alphabetically Presidents\' First Names Presidents\' Middle Names Presidents\' Last Names First Ladies\' First Names First Ladies\' Maiden names Abraham Abram Adams x 2 Abigail Appleton Andrew Alan Arthur Anna x 3 Bouvier Andrew Baines Buchanan Barbara Carow Benjamin Birchard Bush x 2 Caroline Childress Calvin Clark Carter Claudia "Lady Bird" Custis Chester David Cleveland Dolly Davis Dwight Delano Clinton Edith x 2 Dent Franklin x 2 Earl Coolidge Eleanor x 2 deWolf George x 3 Fitzgerald Eisenhower Eliza Doud Gerald Gamaliel Fillmore Elizabeth "Bess" Fulsom Grover Henry Ford Elizabeth "Betty" Galt Harry Herbert Walker Garfield Elizabeth "Eliza" Gardiner Herbert Howard Grant Ellen Goodhew James x 5 Jefferson Harding Florence Henry John x 4 Knox Harrison x 2 Frances Herndon Lyndon Milhous Hayes Hannah Herron Martin Quincy Hoover Helen Hoes Millard Rudolph Jackson Hillary Johnson Richard S Jefferson Ida Kortright Ronald Simpson Johnson x 2 Jacqueline McCardle Rutherford Walker Kennedy Jane Pierce Theodore Wilson Lincoln Julia x 2 Powers Thomas Madison Laura Robards Ulysses McKinley Lou Rodham Warren Monroe Louisa Roosevelt William x 4 Nixon Lucretia Rudolph Woodrow Pierce Lucy Ryan Zachary Polk Margaret Saxton Reagan Martha x 2 Scott Roosevelt x 2 Mary Skelton Taft Mary "Mamie" Smith x 3 Taylor Nancy Symmes Truman Rachel Taylor Tyler Rosalynn Todd x 2 VanBuren Sarah Wallace Washington Thelma "Patricia" Warren Wilson Webb Welch', ] embeddings = model.encode(sentences) print(embeddings.shape) @@ -316,8 +315,8 @@ You can finetune this model on your own dataset. | Metric | Value | |:--------------------|:-----------| -| pearson_cosine | 0.8508 | -| **spearman_cosine** | **0.8666** | +| pearson_cosine | 0.9027 | +| **spearman_cosine** | **0.9137** | #### Binary Classification @@ -326,13 +325,13 @@ You can finetune this model on your own dataset. | Metric | allNLI-dev | Qnli-dev | |:--------------------------|:-----------|:-----------| -| cosine_accuracy | 0.7451 | 0.7354 | -| cosine_accuracy_threshold | 0.7059 | 0.6418 | -| cosine_f1 | 0.6633 | 0.7256 | -| cosine_f1_threshold | 0.6645 | 0.5336 | -| cosine_precision | 0.5793 | 0.6171 | -| cosine_recall | 0.7758 | 0.8804 | -| **cosine_ap** | **0.6359** | **0.7935** | +| cosine_accuracy | 0.7695 | 0.7051 | +| cosine_accuracy_threshold | 0.7752 | 0.6867 | +| cosine_f1 | 0.6625 | 0.6932 | +| cosine_f1_threshold | 0.6565 | 0.6344 | +| cosine_precision | 0.5197 | 0.6267 | +| cosine_recall | 0.9133 | 0.7754 | +| **cosine_ap** | **0.6627** | **0.7567** |