README.md

metadata

library_name: setfit
tags:
  - setfit
  - sentence-transformers
  - text-classification
  - generated_from_setfit_trainer
metrics:
  - accuracy
widget:
  - text: >-
      so the representative presentative that i talked to a nine o'clock this
      morning but it said that they were gonna call the customer service my
      service or whatever that they were gonna call to to see if they dispute it
      and i didn't get a call back bags i'm a mother of three kids i worked were
      two job i can't have a phone that that's not on and i don't have the money
      the money to pay a hundred and fifty six eighty six dollars you guys want
      me to pay right now it's restore my service
  - text: >-
      i understand kelly yes let me send you a little bit about be a moment okay
      is is that the pin number that you have the four days four digits that you
      have with us is
  - text: >-
      yeah 'cause that that's that's really that's ridiculous you know that's
      ridiculous for her to do that i like i have you know all the time in the
      world okay all right okay okay no i got my card no cathy she asked me for
      my last time and i did not have it i'm
  - text: >-
      ma'am uh thanks for holding for holding by the way everything upon
      checking i'm checking here a record ma'am aah for your for your current a
      hot spot you said you said you still have twenty gigabytes left
  - text: >-
      and then when i asked i didn't even get to speak to the supervisor
      provider i just got hung up on
pipeline_tag: text-classification
inference: true
base_model: sentence-transformers/all-mpnet-base-v2
model-index:
  - name: SetFit with sentence-transformers/all-mpnet-base-v2
    results:
      - task:
          type: text-classification
          name: Text Classification
        dataset:
          name: Unknown
          type: unknown
          split: test
        metrics:
          - type: accuracy
            value: 0.5463414634146342
            name: Accuracy

SetFit with sentence-transformers/all-mpnet-base-v2

This is a SetFit model that can be used for Text Classification. This SetFit model uses sentence-transformers/all-mpnet-base-v2 as the Sentence Transformer embedding model. A LogisticRegression instance is used for classification.

The model has been trained using an efficient few-shot learning technique that involves:

1. Fine-tuning a Sentence Transformer with contrastive learning.
2. Training a classification head with features from the fine-tuned Sentence Transformer.

Model Details

Model Description

• Model Type: SetFit
• Sentence Transformer body: sentence-transformers/all-mpnet-base-v2
• Classification head: a LogisticRegression instance
• Maximum Sequence Length: 384 tokens
• Number of Classes: 64 classes

Model Sources

• Repository: SetFit on GitHub
• Paper: Efficient Few-Shot Learning Without Prompts
• Blogpost: SetFit: Efficient Few-Shot Learning Without Prompts

Model Labels

Label	Examples
0	"yeah and in case you you forget it's actually future date your data so that the one aah you know you know when the bill cycle comes you would just need to pay the the amount of the new of the new plan and you should be good to go" "you are eligible for is four one for one upright discount if you want to have once you have a cell phone for free you can uh bring it bring a number from in our account our company explode in verizon i'm i'm sorry it's closed exploding an a t and t" "okay so i'm gonna look into look into this of an s that i'll just have have to check in our system if the phone is right one is already eligible for the unlock code okay i'll just have to place you on hold for a minute or two to i'll gonna get right back to you just don't hang up all right all right so"
20	'hmm hmm alright alright just a moment alright great like rechecking further as of you will be checking your e b b b alright so for your your e bebe this will be applied to your to your account on the twenty third third of august yet in the amount of fifty dollars dollars so currently aah for your because your cycle has has started so your autopay has they have taken an amount of seventy one twenty one dollars for your bill now when when that fifty dollar will come in that will be will be charged to the next billing so on so on your next billing so your your aah billed you would only be twenty one ninety one dollars' 'will be charged' "thank you right right so while i'm pulling up your account here like the like to tell you about aah autopay so for so for this one here autopay is actually an auto an auto payment in which aah they they uh we take the aah payment on and on your card a day before your due date due date so where this one here upon checking here checking use your next two days is on the sixth of september number which means that your card will be will be charged on the fifth of the number and and on the fourth you will actually be texted and i'll be reminded that our system system we'll take the payment on the card a baby a day before the due date okay"
11	'shit sorry can you sorry can you say that one more time' 'oh bitch pay' 'moron'
16	'i was not trying to rush you into a decision' 'understand your concern' 'your concern is valid'
35	"aah uh okay if ever though aah aah you decide to aah get a new a new phone you're eligible for this time that aah the phones from our cricket store and from our website website aah just get a quick a cricket phone to make sure that we can really get we guarantee that are hot spot will work on it you can aah get discounted cricket phone the phones okay" "able to have it replaced for these um usage of a year here so since you do have your a device we simply been activated that you're actually currently um eligible for the warranty" 'aah okay i okay aah yeah sure um yes um peggy take your account is eligible for um which bridge pay'
21	'thank you would you mind if i can add not going to ask to put you on hold for a manager okay' 'thank you the four digit pin under your account' 'thank you what is the what is the four digit pin on the trip that account'
46	"just wanna make sure that sure the seat like to get you an answer to see if it's maybe just something just something in the maintenance because if" 'yes sir thank you so much for making your bill your payment that we already have receive what happened you did you did you receive the message on for me sign in your end and just to make sure' "okay so you're so you're trying to process on the i v r on the automated system which system"
47	'network is not stable' "can't connect" 'drop my call'
6	"i'm sorry is that and emelia" 'i d i do understand you let me go ahead and check your information here on your phone okay' "i see i see right now oh i got something here thing here already i noticed it by the way let me assist you with since you with this i'm sorry that happened but we'll see what's going on going on i get an account and get the name of calvin birth been burns west"
51	"hmm hmm hmm hmm i can barely hear you sir i'm sorry" "i can't hear you" 'no i say that again'
27	'oh i understand and yes i can definitely assist you with be doing that assist me so can i can i please have your phone number' "if you're having having a hard time to do it on your phone uh to call with me with me then you can just go ahead and aah visit a visit at the store and they can actually assist you with and even they can go ahead and uh you know uh click on it with uh forget pass got password they're using your device and that's and that's the best option for you um to call if you're having have the option to do" "thanks for calling to try to me destination my name is that where it's how can i help you"
19	'buy cable protector' 'get screen protection' 'need cable protector'
62	'arsehole' 'fool' 'bastard'
12	"i just want i just want the number it's this not not a transfer anything for a new phone it's phone it's the same phone" 'when i got i got the other new phones on' 'aah yeah do you need to you need to put my new aah i m e i number in from in for my new phone'
13	'web site was confusing' 'placeholder' 'could not find app'
56	"yes yesterday yesterday i called to add her mobile hot spot to my phone and then phone and it isn't working" "remember to sent the customer for their business hi frank uh this is aah meredith there it is i was calling aah to see to see what we can do about my cell phone i got it hmm uh maybe a week or two ago i mean i and it's coming up restricted or private five it when i called people it's not even showing my number my number and i know it's nothing in my phone in my phone or if it is i haven't learned how to fix it" "uh huh oh shit i'm by the little boy almost does it is there no knowing some come up come up please stay on the line yes that's what i need my gas for for people that so have no z four for people in the philippines they don't they don't know what they don't know what do you then hit no other information phone number nothing to do all that yeah with the mail when i called what other m b a"
31	"yes of course aah she can just you know really visa i mean visit our website cause it round while dot com and you know see a c a check for this phone and you can just and you can just you know um select the option that and that can customer and i'm upgrading my phone phone and just add to the card and you know you know it will continuously have have it place you'll just need to put your bill you know billing address that you're info so that you could have you can have it successfully" 'yeah yeah you can go to the store uh by twenty the twenty first' "gigabytes okay okay she's aah just still work still working on it by the way if you have any have any increase you can also visit our website and you can and you can make a payment online are our cricket up for you to avoid for four dollars of assistance fee"
49	"let me double check hold check hold on um we actually actually have as well the samsung galaxy i'll see a twelve for or aah one hundred nine dollars and ninety nine cents nine cents" 'thank you very much let me go ahead and process the payment the payment for just allow me one moment' 'okay so let me see okay mister and what you say you were trying to ask to activate a new device right'
15	"all that's all okay thank you so much how much glad i was able to help out online lucky your device your device once again the supervisor from cricket do you have a great day and stay safe bye now" 'no no no when i was um um the last person that i talked to the one i hung up hung up on me was supposed to be the supervisor okay' "and then when i asked i didn't even get to speak to the supervisor provider i just got hung up on"
60	'okay okay do you have this this number this number next to you right now this device' 'uh i mean do you want to speak with a spam with a spanish the sedative' 'to go and content the number her aah let me know if you get the i d the i m e i or if the call will went through through and then um once you have do you have it just put me on hold and i will be waiting for the for the i m e i d okay'
7	"i i can't fight it but it's frustrating you know" "and and sometimes it's like the weather i hear i hear a horrible well" "i just need to work working phone and and it's it's been like oh like a ridiculous you two months about this office and then when i called and they told me they told me that i have the proof of this whole time but it doesn't make sense because i just was never never told that"
33	'i hate the new system' 'do what ever you want' 'i do not have time for your stories'
4	'hello welcome to correct to cricket this is my nonna can i get your name please please' 'welcome to cricket click admission my name is john can i have your name please name please' "thank you for calling verizon wireless my name yes my name is better which one will i be having a pleasure let's you're speaking with"
3	'thank you so very much for waiting waiting and i was able to verify all this information in the house and the hot spot has been successfully add it just to make sure to make sure the services are working aah uh i can give you a call back but what you will need to do be do be to restart your phone turn it off and then turn it back turn it back on and then i can give you a call back in call back in two to three minutes' "okay okay you know you're almost there it's until september september the twenty sixth that this phone is due is due to be unlocked" 'okay can you try to go to go and not just like to internet google google good up or something like that there'
61	'very good thank you so much' 'so much higher i appreciate that' "okay well thank you so i'm not sure"
22	'i was put on hold' 'i v r is terrible' 'i v r has too many options'
30	'service has been a bit unpredictable' 'outage will continue' 'network outages'
48	"was able to resolve it it's of your concern today but simply performing it troubleshooting shipping for your service uh miss is everything" "you're welcome and before i let you go to i just want to just want to let you know i'm happy i was able to resolve your concern your concern" "hmm but the question is how come i wasn't able to able to when i go there and now i'm not able to connect when i so um"
39	'send the document' 'email the document' 'email the details'
10	'all right well thank you so much for that one for that one month um can you please tell me how can i assist you today' "you're welcome other back thank you so much for your patience patience um i already restore the line" "okay okay all righty aah aah we'll do that today thank you so much"
57	'to add line' 'add a new one' 'like to add a line'
50	"all right okay that's fine so on the records answer the and before we can to cancel the line of what i can see it here you do you have three lines lines active for fifty five dollar plan a plan so on the monthly basis you're paying one one hundred one dollars because there is like an insurance sure it's on the line and then once it would be me remove the insurance also be removed it as well this line okay and once it will be you will be removed there's also changes on the bill so if the line will be canceled it will be out of the automated that it was aah the effective today though okay that will be cancelling the line and then the line the line going to be ported out anymore and also so then you service as of the line will not be refund refunded nor credited and that's what i can see here here on the eighteenth would be your do right" "or the kitchen so before before we can do to where it's supposed to be used let me pull me once you cancel the line if you change your change your mind you will need to pay fifteen dollars it's for the reactivation" "okay so before we cancel the line is there some there's something else on your account that i can help you with or with or only will be the cancellation"
8	'okay just stay on the line while i work on your on your account can i put you on a brief hold a logging into logging' 'okay let me let me put you on put you on a brief hold for a moment okay' 'please christopher open aah confirm it here material quick i place you on hold for a minute one moment'
36	"yeah sure thing sure thank you so much for your patience waiting on the line and and and i'm so sorry for the long hold while i while i really do appreciate the again i understand how important port and this is for you and appreciate also that time time that you really drop by on the tickets to worry about this about this concern but as i check for back further here um as i can it's confirmed it it's really not in the sim card but okay but instead on the device that you're using right using right now aah the i m e i i of the device ending in zero nine zero nine zero five this phone is no longer no longer compatible here with a service it it said cricket and that's the reason right now now that the service will not work call because of the phone so we can we can confirm right here that on the like lines that things that you have right here on the account this is the only one one that is currently an active so i even way like it like either to inquire on the crickets for it's for because we can see right here if maybe you are you are qualified for a device upgrade or maybe if you have if you have a spare phone now we can check if this is the this is still compatible with the service at cricket because we can update the i m e i of i of this phone" "hmm okay so if you're if you were to have it activated right right now you the the phone will be eligible for an locked bye by upto per ten" "if you upgrade as per as per checking here you're eligible for a device that hi discount so that means if you plan you plan on upgrading your device you can definitely and i only have a discount as long as you're logged log in your account over cricket wireless dot com com you can choose your device will recover device device if you should be able to receive a discount discount"
54	'thank you got this one not this one here and this is for me to send to get your get your account can i have the four digit pin please' 'the forgot user name' 'oh four alrighty all righty thank you and how about the four digit pin digit pin on the account to verify'
63	'um are there any way i can call back back in a few minutes' "the aah assurance taken off of the other line other line that's on my account but aah okay you got already a letter to the end of it told me that because my account was account was credited eight dollars from the check in the insurance off i thought i only two dollars so when i call back uh to so the card information to you to pay it it tells me that aah or whoever whoever told me that there is no no um i haven't shown in the system but there was any changes made" "i will give you all a call back when i'm ready i'm ready"
43	'i know who i am seeing' "add add in that case i'm glad i was able to provide the details this is my callaghan from cricket stay safe always and bye for now" 'welcome to cricket the coordination this is josie may i have your name please please'
55	'and one day at one on my account not the not and they brought a blocked or lot layest balance and she said it said it would phone was sound to call back all that and they did take the block fully at all all' "thank you for free you were picking up the phone call but anyway if there's anything else feel free feel free to call us back where aah always open aah before also nine" "in this case then um mister mister walker where we'll need to do is i will need you to wanting you to turn off your device for uh um five minutes and then turn it back on and i and i'll be calling them back in around ten minutes okay for you not you not to call back customer care new for you not to wait and to wait anymore okay"
5	"yes sir in this case uh from meanwhile it we're doing this jamie name is uh you can also get enroll or roll on the autopay you have aah you have a single line uh recommend you to ready to do that so you can have the five dollar discount setup in" "okay okay and you may add on a debit or credit card with them them and aah that will provide you five dollar discount a discount on your next month's bill right" "okay and usually usually um regarding here on the account do you have autopay autopay on the account and that's why i'm just aah we're just paying for fifty eight dollars a month instead of start of sixty three so here it's aah um too early for us to like give the credit credit on the account because we're crediting over give were giving the five dollar discount or credit aah aah five days before the due date to tech so technically that will be on the twentieth twenty second of august the starting that day what day you can see that the new amount is just it's just fifty eight instead of sixty three okay"
14	'hold on hold on twenty alright allen so i' 'okay yeah then well hold on hold on a shit to that should i would like to me maybe somebody know lane okay aah are you ready' "so hold on hold on we're on the side okay i sent a text message search that you receive uh any text message text message coming from cricket"
2	"wasn't aware of the fee" 'a lot of hidden cost' 'high price'
58	"i'm gonna go ahead and you transfer" "i'm happy to transfer you" 'uh yes i can transfer transfer you to record to the insurance aah i can aah i can give you the number there'
37	'okay tell me apart from that anything else that you might want you might want to apply to your account' 'this do you have any other concerns' 'no problem and yeah and yes now that we have successfully aah process aah process the payment andrea do you have any other question the questions or concerns'
23	"okay just timing can i be lohman here okay perfect just a moment one moment here it may i please you in a brief hold ma'am" 'okay just stay on the line while i work on your on your account can i put you on a brief hold a logging into logging' "okay thank you so much for that information shannon for your help as well now let me go ahead go ahead and just work on my system i cage if you don't mind don't mind going to put you just on a brief hold once i have the i have"
52	"thank you you're welcome" "all i'm really i'm really sorry that your son is having issues with this so the services no worries let me pull up your account account so i could help you check it may i have your i have your" "no worries no worries no worries thank you very much for verifying the confirmation make sure that i hear me okay yeah no worries take your time when you're ready tony okay tony okay"
28	"i do not i do not have the wifi on um and i only have my daughter on like i been i've been i've been dealing with us from going on three three days and i'm like on so so frustrated cricket stores i tried calling calling them right please are closed today cause labor day okay" "yeah well aah i i think you need to have your manager go back and listen to the into the call that's recorded because clearly he told me on help me on the phone that i could say uh my bank is thank you should probably have your manager go back and listen to the to the phone call so she can hear what he said" 'aah if you will enroll that counterfeits which way you can get seven extension mention aah for example you an android that kind of which the bitch paid today your aah your your um your page pay your extension this time start on the twenty second upon but yeah one two nine two three four five six saffron up until the twenty eight twenty eight of august'
59	'instructions not clear' 'waiting for installation' 'slow installation process'
53	"thank you so much and i'm glad i was and i was able to resolve your concern by uh now so that you can now enjoy the retail services once once again nicole this is berna and thank you purchasing cricket and have a great day bye" 'thank you sir thank you so much so right now sage i would just like the car to clarify are you trying to pay your bill on your bill on your online cricket account however you forgot your forgot your password or you forgot' "okay perfect so thank you so much for being part we type precondition my name is marlin and i hope you have a wonderful day ma'am"
45	'brian high ryan how are you doing how are you doing today' "i'm great sir um um how about you" 'agent how are you today'
41	'all right just can i can i have the card number to process the payment one more time' 'okay hmm um we will also going to uh verify that one to for you okay for you okay the way alright so let me check check here and it seems like that that the um card that decline here can you please give me please give me one more time the card number just to make sure i have' 'you know that person that you really really you know who will actually receive this phone they might be able to at least activate the one with one with cricket number that way they can actually surely continue the six months aah can you repeat it written requirements so they can use it with different carrier carrier'
17	'welcome to recap my name is sheila hello how can i help you today' 'just a great week quick recap um corban you calling because one because you wanted' 'i woke up to recap my name is sheila uh how can i help you today'
34	'i am definitely interested' 'what is the extended warranty' 'what are the accessories'
25	"my pleasure sir and and uh and uh remember also that all of your lines right now in this case this account i already active okay i don't know uh there's uh there's anything else i can do for you today mister word" "i don't know if it's in there" "hmm okay okay remember that some well oh i old i don't know if you have well well do you have a p s four o a place agent or an excellent"
24	'choosing cricket just my name is danielle how may i have the pleasure to speak to thank you' 'welcome to pick condition my name and my name is judy may i have your name please' "me the opportunity to assist you in it see i explained to you about your services again my name is arlene enjoy the rest of the day ma'am stay safe and happy weekend"
9	'how many times to call' 'kept calling' 'did not get an answer before'
1	"okay i understand and i know it's kind of kind of frustrating to get uh try to just you just a services and that isn't working working but no worries is going to be my pleasure today sure today to check up your account and see what's going what's going on so can you please provide me your phone number number" "hi victoria toria um thanks for patiently waiting all right so i check your account further further and i also check um the payment that you made paid and um the payment the payment was already posted um i believe leave um you made the payment today and it was so do as of um is it and it's um sixty dollars dollars right but um your account is already cancelled that's why the that's why the system will require the system will require required to pay aah are we activation fee of five days five dollars okay so looking into the account right now right now there is a balance here or here on five dollars okay so this check just charge is valid this is for for the for the activation fee okay but don't worry okay um let me go ahead go ahead and ask permission from my support my supervisor if we can do something about the five the five dollars amount onto your account okay" "joe your account to reach pay we will extend extend your services for seven days with a process processing the full payment on the account on the on the seven days which is the twenty second second you need to process the the whole amount or you need the price to process the second payment since you're rate plan is sixty five or your bill is sixty sixty five then the only paying payment that you going to process next time is the is the amount of fifty five dollars ten ten dollars go to your services five dollars there's to your account then as well as well as you have credit as well so i'll just set up you set up the bitch pay okay"
29	'when will the enrollment be done' 'when will the offer be activated' 'how long will it take to be delivered'
32	'always data issues' "don't use this" 'data plan not suffice'
18	'not interested' 'i dont want it' 'not for me'
44	'customer service sucks here' 'service agent scheduled didnt come' 'i have been waiting on the automated system forever'
26	'yes lets go ahead' 'sure i like the deal' 'please proceed with the offer'
42	'includes more data' "they don't charge for" 'plan was good'
40	'upgrading to the plan will resolve this issue' 'upgrade plan to resolve issue'
38	'not a great equipment' 'battery runs out' 'problems with your equipment'

Evaluation

Metrics

Label	Accuracy
all	0.5463

Uses

Direct Use for Inference

First install the SetFit library:

pip install setfit

Then you can load this model and run inference.

from setfit import SetFitModel

# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("Jalajkx/all_mpnetcric-setfit-model")
# Run inference
preds = model("and then when i asked i didn't even get to speak to the supervisor provider i just got hung up on")

Training Details

Training Set Metrics

Training set	Min	Median	Max
Word count	1	32.4224	283

Label	Training Sample Count
0	36
1	36
2	36
3	36
4	36
5	36
6	36
7	36
8	36
9	6
10	36
11	36
12	36
13	9
14	36
15	36
16	17
17	36
18	4
19	29
20	30
21	36
22	25
23	36
24	36
25	36
26	4
27	36
28	36
29	4
30	8
31	36
32	4
33	36
34	11
35	36
36	36
37	36
38	10
39	13
40	2
41	36
42	9
43	36
44	10
45	36
46	36
47	14
48	36
49	36
50	36
51	36
52	36
53	36
54	36
55	36
56	36
57	36
58	36
59	8
60	36
61	36
62	36
63	36

Training Hyperparameters

• batch_size: (4, 4)
• num_epochs: (1, 1)
• max_steps: -1
• sampling_strategy: oversampling
• num_iterations: 25
• body_learning_rate: (2e-05, 2e-05)
• head_learning_rate: 2e-05
• loss: CosineSimilarityLoss
• distance_metric: cosine_distance
• margin: 0.25
• end_to_end: False
• use_amp: False
• warmup_proportion: 0.1
• seed: 42
• eval_max_steps: -1
• load_best_model_at_end: False

Training Results

Epoch	Step	Training Loss	Validation Loss
0.0000	1	0.2196	-
0.0022	50	0.2183	-
0.0044	100	0.3574	-
0.0065	150	0.1756	-
0.0087	200	0.1396	-
0.0109	250	0.2875	-
0.0131	300	0.1307	-
0.0152	350	0.1465	-
0.0174	400	0.1503	-
0.0196	450	0.1579	-
0.0218	500	0.3216	-
0.0240	550	0.2399	-
0.0261	600	0.2824	-
0.0283	650	0.1217	-
0.0305	700	0.0647	-
0.0327	750	0.2651	-
0.0348	800	0.1792	-
0.0370	850	0.1461	-
0.0392	900	0.0256	-
0.0414	950	0.1175	-
0.0435	1000	0.2394	-
0.0457	1050	0.1582	-
0.0479	1100	0.2785	-
0.0501	1150	0.0611	-
0.0523	1200	0.1937	-
0.0544	1250	0.0804	-
0.0566	1300	0.0811	-
0.0588	1350	0.0663	-
0.0610	1400	0.2148	-
0.0631	1450	0.0428	-
0.0653	1500	0.0083	-
0.0675	1550	0.0884	-
0.0697	1600	0.1341	-
0.0719	1650	0.0949	-
0.0740	1700	0.1839	-
0.0762	1750	0.2244	-
0.0784	1800	0.0309	-
0.0806	1850	0.0277	-
0.0827	1900	0.2016	-
0.0849	1950	0.1174	-
0.0871	2000	0.0942	-
0.0893	2050	0.0483	-
0.0915	2100	0.2057	-
0.0936	2150	0.0151	-
0.0958	2200	0.023	-
0.0980	2250	0.0514	-
0.1002	2300	0.1541	-
0.1023	2350	0.1426	-
0.1045	2400	0.0187	-
0.1067	2450	0.0386	-
0.1089	2500	0.274	-
0.1110	2550	0.0723	-
0.1132	2600	0.0115	-
0.1154	2650	0.053	-
0.1176	2700	0.2371	-
0.1198	2750	0.2472	-
0.1219	2800	0.0386	-
0.1241	2850	0.0159	-
0.1263	2900	0.0276	-
0.1285	2950	0.1229	-
0.1306	3000	0.0037	-
0.1328	3050	0.0029	-
0.1350	3100	0.0037	-
0.1372	3150	0.022	-
0.1394	3200	0.0389	-
0.1415	3250	0.0146	-
0.1437	3300	0.0034	-
0.1459	3350	0.0721	-
0.1481	3400	0.0462	-
0.1502	3450	0.0039	-
0.1524	3500	0.1225	-
0.1546	3550	0.0009	-
0.1568	3600	0.1005	-
0.1590	3650	0.008	-
0.1611	3700	0.121	-
0.1633	3750	0.2982	-
0.1655	3800	0.008	-
0.1677	3850	0.001	-
0.1698	3900	0.216	-
0.1720	3950	0.0458	-
0.1742	4000	0.0155	-
0.1764	4050	0.1235	-
0.1785	4100	0.0059	-
0.1807	4150	0.2421	-
0.1829	4200	0.2232	-
0.1851	4250	0.0396	-
0.1873	4300	0.2164	-
0.1894	4350	0.0839	-
0.1916	4400	0.0116	-
0.1938	4450	0.2666	-
0.1960	4500	0.0648	-
0.1981	4550	0.074	-
0.2003	4600	0.077	-
0.2025	4650	0.0739	-
0.2047	4700	0.0029	-
0.2069	4750	0.0679	-
0.2090	4800	0.0049	-
0.2112	4850	0.0281	-
0.2134	4900	0.049	-
0.2156	4950	0.0052	-
0.2177	5000	0.1657	-
0.2199	5050	0.0005	-
0.2221	5100	0.0041	-
0.2243	5150	0.0008	-
0.2265	5200	0.0587	-
0.2286	5250	0.0753	-
0.2308	5300	0.1744	-
0.2330	5350	0.0055	-
0.2352	5400	0.0023	-
0.2373	5450	0.0002	-
0.2395	5500	0.0472	-
0.2417	5550	0.0042	-
0.2439	5600	0.0137	-
0.2460	5650	0.1646	-
0.2482	5700	0.0509	-
0.2504	5750	0.0062	-
0.2526	5800	0.0019	-
0.2548	5850	0.0048	-
0.2569	5900	0.0031	-
0.2591	5950	0.0011	-
0.2613	6000	0.004	-
0.2635	6050	0.0498	-
0.2656	6100	0.0042	-
0.2678	6150	0.0018	-
0.2700	6200	0.0061	-
0.2722	6250	0.1355	-
0.2744	6300	0.0039	-
0.2765	6350	0.0044	-
0.2787	6400	0.001	-
0.2809	6450	0.0011	-
0.2831	6500	0.0302	-
0.2852	6550	0.1502	-
0.2874	6600	0.0029	-
0.2896	6650	0.0016	-
0.2918	6700	0.0232	-
0.2940	6750	0.176	-
0.2961	6800	0.0323	-
0.2983	6850	0.0818	-
0.3005	6900	0.0427	-
0.3027	6950	0.1716	-
0.3048	7000	0.0137	-
0.3070	7050	0.0032	-
0.3092	7100	0.0095	-
0.3114	7150	0.177	-
0.3135	7200	0.0005	-
0.3157	7250	0.0157	-
0.3179	7300	0.0012	-
0.3201	7350	0.0027	-
0.3223	7400	0.1351	-
0.3244	7450	0.0019	-
0.3266	7500	0.0009	-
0.3288	7550	0.2017	-
0.3310	7600	0.0059	-
0.3331	7650	0.0013	-
0.3353	7700	0.0377	-
0.3375	7750	0.0056	-
0.3397	7800	0.0055	-
0.3419	7850	0.0745	-
0.3440	7900	0.0046	-
0.3462	7950	0.002	-
0.3484	8000	0.0355	-
0.3506	8050	0.0004	-
0.3527	8100	0.0004	-
0.3549	8150	0.0072	-
0.3571	8200	0.0013	-
0.3593	8250	0.0032	-
0.3615	8300	0.0006	-
0.3636	8350	0.0095	-
0.3658	8400	0.0006	-
0.3680	8450	0.0005	-
0.3702	8500	0.0004	-
0.3723	8550	0.0019	-
0.3745	8600	0.0002	-
0.3767	8650	0.0015	-
0.3789	8700	0.0117	-
0.3810	8750	0.002	-
0.3832	8800	0.0005	-
0.3854	8850	0.0009	-
0.3876	8900	0.0041	-
0.3898	8950	0.0484	-
0.3919	9000	0.0058	-
0.3941	9050	0.0027	-
0.3963	9100	0.0002	-
0.3985	9150	0.2323	-
0.4006	9200	0.0163	-
0.4028	9250	0.0333	-
0.4050	9300	0.0033	-
0.4072	9350	0.0023	-
0.4094	9400	0.0044	-
0.4115	9450	0.0142	-
0.4137	9500	0.0261	-
0.4159	9550	0.004	-
0.4181	9600	0.027	-
0.4202	9650	0.0104	-
0.4224	9700	0.0005	-
0.4246	9750	0.2452	-
0.4268	9800	0.0069	-
0.4290	9850	0.0245	-
0.4311	9900	0.0005	-
0.4333	9950	0.0041	-
0.4355	10000	0.1058	-
0.4377	10050	0.0009	-
0.4398	10100	0.0067	-
0.4420	10150	0.0832	-
0.4442	10200	0.0016	-
0.4464	10250	0.039	-
0.4485	10300	0.0078	-
0.4507	10350	0.0013	-
0.4529	10400	0.0003	-
0.4551	10450	0.0259	-
0.4573	10500	0.008	-
0.4594	10550	0.2137	-
0.4616	10600	0.0083	-
0.4638	10650	0.0206	-
0.4660	10700	0.0039	-
0.4681	10750	0.2205	-
0.4703	10800	0.0072	-
0.4725	10850	0.0436	-
0.4747	10900	0.071	-
0.4769	10950	0.0004	-
0.4790	11000	0.0147	-
0.4812	11050	0.0095	-
0.4834	11100	0.0069	-
0.4856	11150	0.0027	-
0.4877	11200	0.0151	-
0.4899	11250	0.0076	-
0.4921	11300	0.0016	-
0.4943	11350	0.1457	-
0.4965	11400	0.1454	-
0.4986	11450	0.0013	-
0.5008	11500	0.0027	-
0.5030	11550	0.0583	-
0.5052	11600	0.0029	-
0.5073	11650	0.0139	-
0.5095	11700	0.0004	-
0.5117	11750	0.0098	-
0.5139	11800	0.0009	-
0.5160	11850	0.0003	-
0.5182	11900	0.0009	-
0.5204	11950	0.0088	-
0.5226	12000	0.0006	-
0.5248	12050	0.0014	-
0.5269	12100	0.0008	-
0.5291	12150	0.0008	-
0.5313	12200	0.0008	-
0.5335	12250	0.0005	-
0.5356	12300	0.0028	-
0.5378	12350	0.0011	-
0.5400	12400	0.0136	-
0.5422	12450	0.0318	-
0.5444	12500	0.0037	-
0.5465	12550	0.0029	-
0.5487	12600	0.0073	-
0.5509	12650	0.0099	-
0.5531	12700	0.015	-
0.5552	12750	0.0047	-
0.5574	12800	0.0891	-
0.5596	12850	0.0007	-
0.5618	12900	0.0784	-
0.5640	12950	0.0636	-
0.5661	13000	0.0029	-
0.5683	13050	0.0048	-
0.5705	13100	0.0698	-
0.5727	13150	0.0002	-
0.5748	13200	0.0734	-
0.5770	13250	0.0004	-
0.5792	13300	0.0135	-
0.5814	13350	0.0034	-
0.5835	13400	0.0018	-
0.5857	13450	0.0175	-
0.5879	13500	0.0003	-
0.5901	13550	0.0002	-
0.5923	13600	0.0032	-
0.5944	13650	0.0007	-
0.5966	13700	0.0021	-
0.5988	13750	0.0019	-
0.6010	13800	0.0006	-
0.6031	13850	0.0014	-
0.6053	13900	0.0011	-
0.6075	13950	0.2383	-
0.6097	14000	0.0009	-
0.6119	14050	0.0863	-
0.6140	14100	0.0005	-
0.6162	14150	0.0017	-
0.6184	14200	0.0003	-
0.6206	14250	0.0025	-
0.6227	14300	0.0008	-
0.6249	14350	0.0005	-
0.6271	14400	0.0006	-
0.6293	14450	0.0517	-
0.6315	14500	0.0005	-
0.6336	14550	0.0075	-
0.6358	14600	0.0004	-
0.6380	14650	0.0003	-
0.6402	14700	0.0003	-
0.6423	14750	0.0045	-
0.6445	14800	0.0005	-
0.6467	14850	0.0002	-
0.6489	14900	0.0125	-
0.6510	14950	0.0015	-
0.6532	15000	0.0017	-
0.6554	15050	0.0011	-
0.6576	15100	0.0207	-
0.6598	15150	0.0002	-
0.6619	15200	0.0252	-
0.6641	15250	0.0006	-
0.6663	15300	0.0015	-
0.6685	15350	0.0018	-
0.6706	15400	0.0386	-
0.6728	15450	0.0011	-
0.6750	15500	0.0003	-
0.6772	15550	0.0007	-
0.6794	15600	0.0028	-
0.6815	15650	0.0056	-
0.6837	15700	0.0005	-
0.6859	15750	0.0002	-
0.6881	15800	0.0305	-
0.6902	15850	0.0005	-
0.6924	15900	0.0018	-
0.6946	15950	0.0011	-
0.6968	16000	0.0006	-
0.6990	16050	0.0072	-
0.7011	16100	0.0224	-
0.7033	16150	0.0011	-
0.7055	16200	0.0005	-
0.7077	16250	0.0007	-
0.7098	16300	0.0005	-
0.7120	16350	0.0028	-
0.7142	16400	0.0017	-
0.7164	16450	0.2294	-
0.7185	16500	0.0253	-
0.7207	16550	0.0122	-
0.7229	16600	0.0001	-
0.7251	16650	0.0327	-
0.7273	16700	0.0042	-
0.7294	16750	0.0008	-
0.7316	16800	0.0004	-
0.7338	16850	0.0003	-
0.7360	16900	0.0005	-
0.7381	16950	0.0003	-
0.7403	17000	0.0021	-
0.7425	17050	0.2041	-
0.7447	17100	0.0002	-
0.7469	17150	0.0006	-
0.7490	17200	0.0002	-
0.7512	17250	0.0008	-
0.7534	17300	0.068	-
0.7556	17350	0.0016	-
0.7577	17400	0.0006	-
0.7599	17450	0.0005	-
0.7621	17500	0.0011	-
0.7643	17550	0.2192	-
0.7665	17600	0.0006	-
0.7686	17650	0.0003	-
0.7708	17700	0.0017	-
0.7730	17750	0.0033	-
0.7752	17800	0.0001	-
0.7773	17850	0.0011	-
0.7795	17900	0.0302	-
0.7817	17950	0.0004	-
0.7839	18000	0.2921	-
0.7860	18050	0.0001	-
0.7882	18100	0.006	-
0.7904	18150	0.0164	-
0.7926	18200	0.0003	-
0.7948	18250	0.0021	-
0.7969	18300	0.0094	-
0.7991	18350	0.002	-
0.8013	18400	0.0405	-
0.8035	18450	0.001	-
0.8056	18500	0.2594	-
0.8078	18550	0.0075	-
0.8100	18600	0.0003	-
0.8122	18650	0.0009	-
0.8144	18700	0.0018	-
0.8165	18750	0.0007	-
0.8187	18800	0.0006	-
0.8209	18850	0.0009	-
0.8231	18900	0.0003	-
0.8252	18950	0.0006	-
0.8274	19000	0.0002	-
0.8296	19050	0.0004	-
0.8318	19100	0.0018	-
0.8340	19150	0.0007	-
0.8361	19200	0.0005	-
0.8383	19250	0.0206	-
0.8405	19300	0.0005	-
0.8427	19350	0.1918	-
0.8448	19400	0.0093	-
0.8470	19450	0.0032	-
0.8492	19500	0.0004	-
0.8514	19550	0.1727	-
0.8535	19600	0.2034	-
0.8557	19650	0.0007	-
0.8579	19700	0.0004	-
0.8601	19750	0.0001	-
0.8623	19800	0.0024	-
0.8644	19850	0.0122	-
0.8666	19900	0.0003	-
0.8688	19950	0.0093	-
0.8710	20000	0.0003	-
0.8731	20050	0.0007	-
0.8753	20100	0.0044	-
0.8775	20150	0.0006	-
0.8797	20200	0.0002	-
0.8819	20250	0.0003	-
0.8840	20300	0.0024	-
0.8862	20350	0.0051	-
0.8884	20400	0.0767	-
0.8906	20450	0.0004	-
0.8927	20500	0.0002	-
0.8949	20550	0.0007	-
0.8971	20600	0.0012	-
0.8993	20650	0.0004	-
0.9015	20700	0.0003	-
0.9036	20750	0.0002	-
0.9058	20800	0.0005	-
0.9080	20850	0.0007	-
0.9102	20900	0.0006	-
0.9123	20950	0.2469	-
0.9145	21000	0.0002	-
0.9167	21050	0.0009	-
0.9189	21100	0.002	-
0.9210	21150	0.0027	-
0.9232	21200	0.0007	-
0.9254	21250	0.0008	-
0.9276	21300	0.0265	-
0.9298	21350	0.0019	-
0.9319	21400	0.0003	-
0.9341	21450	0.0064	-
0.9363	21500	0.0003	-
0.9385	21550	0.0015	-
0.9406	21600	0.0002	-
0.9428	21650	0.0015	-
0.9450	21700	0.1497	-
0.9472	21750	0.1422	-
0.9494	21800	0.0001	-
0.9515	21850	0.0007	-
0.9537	21900	0.0053	-
0.9559	21950	0.0002	-
0.9581	22000	0.0003	-
0.9602	22050	0.1234	-
0.9624	22100	0.2087	-
0.9646	22150	0.0005	-
0.9668	22200	0.0001	-
0.9690	22250	0.0003	-
0.9711	22300	0.0004	-
0.9733	22350	0.0014	-
0.9755	22400	0.0021	-
0.9777	22450	0.0105	-
0.9798	22500	0.0009	-
0.9820	22550	0.0003	-
0.9842	22600	0.0006	-
0.9864	22650	0.0007	-
0.9885	22700	0.0021	-
0.9907	22750	0.003	-
0.9929	22800	0.0099	-
0.9951	22850	0.001	-
0.9973	22900	0.0521	-
0.9994	22950	0.0003	-

Framework Versions

• Python: 3.10.13
• SetFit: 1.0.1
• Sentence Transformers: 2.2.2
• Transformers: 4.36.2
• PyTorch: 2.0.1
• Datasets: 2.16.1
• Tokenizers: 0.15.0

Citation

BibTeX

@article{https://doi.org/10.48550/arxiv.2209.11055,
    doi = {10.48550/ARXIV.2209.11055},
    url = {https://arxiv.org/abs/2209.11055},
    author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
    keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
    title = {Efficient Few-Shot Learning Without Prompts},
    publisher = {arXiv},
    year = {2022},
    copyright = {Creative Commons Attribution 4.0 International}
}