Jalajkx's picture
Add SetFit model
a289654
metadata
library_name: setfit
tags:
  - setfit
  - sentence-transformers
  - text-classification
  - generated_from_setfit_trainer
metrics:
  - accuracy
widget:
  - text: >-
      so the representative presentative that i talked to a nine o'clock this
      morning but it said that they were gonna call the customer service my
      service or whatever that they were gonna call to to see if they dispute it
      and i didn't get a call back bags i'm a mother of three kids i worked were
      two job i can't have a phone that that's not on and i don't have the money
      the money to pay a hundred and fifty six eighty six dollars you guys want
      me to pay right now it's restore my service
  - text: >-
      i understand kelly yes let me send you a little bit about be a moment okay
      is is that the pin number that you have the four days four digits that you
      have with us is
  - text: >-
      yeah 'cause that that's that's really that's ridiculous you know that's
      ridiculous for her to do that i like i have you know all the time in the
      world okay all right okay okay no i got my card no cathy she asked me for
      my last time and i did not have it i'm
  - text: >-
      ma'am uh thanks for holding for holding by the way everything upon
      checking i'm checking here a record ma'am aah for your for your current a
      hot spot you said you said you still have twenty gigabytes left
  - text: >-
      and then when i asked i didn't even get to speak to the supervisor
      provider i just got hung up on
pipeline_tag: text-classification
inference: true
base_model: sentence-transformers/all-mpnet-base-v2
model-index:
  - name: SetFit with sentence-transformers/all-mpnet-base-v2
    results:
      - task:
          type: text-classification
          name: Text Classification
        dataset:
          name: Unknown
          type: unknown
          split: test
        metrics:
          - type: accuracy
            value: 0.5463414634146342
            name: Accuracy

SetFit with sentence-transformers/all-mpnet-base-v2

This is a SetFit model that can be used for Text Classification. This SetFit model uses sentence-transformers/all-mpnet-base-v2 as the Sentence Transformer embedding model. A LogisticRegression instance is used for classification.

The model has been trained using an efficient few-shot learning technique that involves:

  1. Fine-tuning a Sentence Transformer with contrastive learning.
  2. Training a classification head with features from the fine-tuned Sentence Transformer.

Model Details

Model Description

Model Sources

Model Labels

Label Examples
0
  • "yeah and in case you you forget it's actually future date your data so that the one aah you know you know when the bill cycle comes you would just need to pay the the amount of the new of the new plan and you should be good to go"
  • "you are eligible for is four one for one upright discount if you want to have once you have a cell phone for free you can uh bring it bring a number from in our account our company explode in verizon i'm i'm sorry it's closed exploding an a t and t"
  • "okay so i'm gonna look into look into this of an s that i'll just have have to check in our system if the phone is right one is already eligible for the unlock code okay i'll just have to place you on hold for a minute or two to i'll gonna get right back to you just don't hang up all right all right so"
20
  • 'hmm hmm alright alright just a moment alright great like rechecking further as of you will be checking your e b b b alright so for your your e bebe this will be applied to your to your account on the twenty third third of august yet in the amount of fifty dollars dollars so currently aah for your because your cycle has has started so your autopay has they have taken an amount of seventy one twenty one dollars for your bill now when when that fifty dollar will come in that will be will be charged to the next billing so on so on your next billing so your your aah billed you would only be twenty one ninety one dollars'
  • 'will be charged'
  • "thank you right right so while i'm pulling up your account here like the like to tell you about aah autopay so for so for this one here autopay is actually an auto an auto payment in which aah they they uh we take the aah payment on and on your card a day before your due date due date so where this one here upon checking here checking use your next two days is on the sixth of september number which means that your card will be will be charged on the fifth of the number and and on the fourth you will actually be texted and i'll be reminded that our system system we'll take the payment on the card a baby a day before the due date okay"
11
  • 'shit sorry can you sorry can you say that one more time'
  • 'oh bitch pay'
  • 'moron'
16
  • 'i was not trying to rush you into a decision'
  • 'understand your concern'
  • 'your concern is valid'
35
  • "aah uh okay if ever though aah aah you decide to aah get a new a new phone you're eligible for this time that aah the phones from our cricket store and from our website website aah just get a quick a cricket phone to make sure that we can really get we guarantee that are hot spot will work on it you can aah get discounted cricket phone the phones okay"
  • "able to have it replaced for these um usage of a year here so since you do have your a device we simply been activated that you're actually currently um eligible for the warranty"
  • 'aah okay i okay aah yeah sure um yes um peggy take your account is eligible for um which bridge pay'
21
  • 'thank you would you mind if i can add not going to ask to put you on hold for a manager okay'
  • 'thank you the four digit pin under your account'
  • 'thank you what is the what is the four digit pin on the trip that account'
46
  • "just wanna make sure that sure the seat like to get you an answer to see if it's maybe just something just something in the maintenance because if"
  • 'yes sir thank you so much for making your bill your payment that we already have receive what happened you did you did you receive the message on for me sign in your end and just to make sure'
  • "okay so you're so you're trying to process on the i v r on the automated system which system"
47
  • 'network is not stable'
  • "can't connect"
  • 'drop my call'
6
  • "i'm sorry is that and emelia"
  • 'i d i do understand you let me go ahead and check your information here on your phone okay'
  • "i see i see right now oh i got something here thing here already i noticed it by the way let me assist you with since you with this i'm sorry that happened but we'll see what's going on going on i get an account and get the name of calvin birth been burns west"
51
  • "hmm hmm hmm hmm i can barely hear you sir i'm sorry"
  • "i can't hear you"
  • 'no i say that again'
27
  • 'oh i understand and yes i can definitely assist you with be doing that assist me so can i can i please have your phone number'
  • "if you're having having a hard time to do it on your phone uh to call with me with me then you can just go ahead and aah visit a visit at the store and they can actually assist you with and even they can go ahead and uh you know uh click on it with uh forget pass got password they're using your device and that's and that's the best option for you um to call if you're having have the option to do"
  • "thanks for calling to try to me destination my name is that where it's how can i help you"
19
  • 'buy cable protector'
  • 'get screen protection'
  • 'need cable protector'
62
  • 'arsehole'
  • 'fool'
  • 'bastard'
12
  • "i just want i just want the number it's this not not a transfer anything for a new phone it's phone it's the same phone"
  • 'when i got i got the other new phones on'
  • 'aah yeah do you need to you need to put my new aah i m e i number in from in for my new phone'
13
  • 'web site was confusing'
  • 'placeholder'
  • 'could not find app'
56
  • "yes yesterday yesterday i called to add her mobile hot spot to my phone and then phone and it isn't working"
  • "remember to sent the customer for their business hi frank uh this is aah meredith there it is i was calling aah to see to see what we can do about my cell phone i got it hmm uh maybe a week or two ago i mean i and it's coming up restricted or private five it when i called people it's not even showing my number my number and i know it's nothing in my phone in my phone or if it is i haven't learned how to fix it"
  • "uh huh oh shit i'm by the little boy almost does it is there no knowing some come up come up please stay on the line yes that's what i need my gas for for people that so have no z four for people in the philippines they don't they don't know what they don't know what do you then hit no other information phone number nothing to do all that yeah with the mail when i called what other m b a"
31
  • "yes of course aah she can just you know really visa i mean visit our website cause it round while dot com and you know see a c a check for this phone and you can just and you can just you know um select the option that and that can customer and i'm upgrading my phone phone and just add to the card and you know you know it will continuously have have it place you'll just need to put your bill you know billing address that you're info so that you could have you can have it successfully"
  • 'yeah yeah you can go to the store uh by twenty the twenty first'
  • "gigabytes okay okay she's aah just still work still working on it by the way if you have any have any increase you can also visit our website and you can and you can make a payment online are our cricket up for you to avoid for four dollars of assistance fee"
49
  • "let me double check hold check hold on um we actually actually have as well the samsung galaxy i'll see a twelve for or aah one hundred nine dollars and ninety nine cents nine cents"
  • 'thank you very much let me go ahead and process the payment the payment for just allow me one moment'
  • 'okay so let me see okay mister and what you say you were trying to ask to activate a new device right'
15
  • "all that's all okay thank you so much how much glad i was able to help out online lucky your device your device once again the supervisor from cricket do you have a great day and stay safe bye now"
  • 'no no no when i was um um the last person that i talked to the one i hung up hung up on me was supposed to be the supervisor okay'
  • "and then when i asked i didn't even get to speak to the supervisor provider i just got hung up on"
60
  • 'okay okay do you have this this number this number next to you right now this device'
  • 'uh i mean do you want to speak with a spam with a spanish the sedative'
  • 'to go and content the number her aah let me know if you get the i d the i m e i or if the call will went through through and then um once you have do you have it just put me on hold and i will be waiting for the for the i m e i d okay'
7
  • "i i can't fight it but it's frustrating you know"
  • "and and sometimes it's like the weather i hear i hear a horrible well"
  • "i just need to work working phone and and it's it's been like oh like a ridiculous you two months about this office and then when i called and they told me they told me that i have the proof of this whole time but it doesn't make sense because i just was never never told that"
33
  • 'i hate the new system'
  • 'do what ever you want'
  • 'i do not have time for your stories'
4
  • 'hello welcome to correct to cricket this is my nonna can i get your name please please'
  • 'welcome to cricket click admission my name is john can i have your name please name please'
  • "thank you for calling verizon wireless my name yes my name is better which one will i be having a pleasure let's you're speaking with"
3
  • 'thank you so very much for waiting waiting and i was able to verify all this information in the house and the hot spot has been successfully add it just to make sure to make sure the services are working aah uh i can give you a call back but what you will need to do be do be to restart your phone turn it off and then turn it back turn it back on and then i can give you a call back in call back in two to three minutes'
  • "okay okay you know you're almost there it's until september september the twenty sixth that this phone is due is due to be unlocked"
  • 'okay can you try to go to go and not just like to internet google google good up or something like that there'
61
  • 'very good thank you so much'
  • 'so much higher i appreciate that'
  • "okay well thank you so i'm not sure"
22
  • 'i was put on hold'
  • 'i v r is terrible'
  • 'i v r has too many options'
30
  • 'service has been a bit unpredictable'
  • 'outage will continue'
  • 'network outages'
48
  • "was able to resolve it it's of your concern today but simply performing it troubleshooting shipping for your service uh miss is everything"
  • "you're welcome and before i let you go to i just want to just want to let you know i'm happy i was able to resolve your concern your concern"
  • "hmm but the question is how come i wasn't able to able to when i go there and now i'm not able to connect when i so um"
39
  • 'send the document'
  • 'email the document'
  • 'email the details'
10
  • 'all right well thank you so much for that one for that one month um can you please tell me how can i assist you today'
  • "you're welcome other back thank you so much for your patience patience um i already restore the line"
  • "okay okay all righty aah aah we'll do that today thank you so much"
57
  • 'to add line'
  • 'add a new one'
  • 'like to add a line'
50
  • "all right okay that's fine so on the records answer the and before we can to cancel the line of what i can see it here you do you have three lines lines active for fifty five dollar plan a plan so on the monthly basis you're paying one one hundred one dollars because there is like an insurance sure it's on the line and then once it would be me remove the insurance also be removed it as well this line okay and once it will be you will be removed there's also changes on the bill so if the line will be canceled it will be out of the automated that it was aah the effective today though okay that will be cancelling the line and then the line the line going to be ported out anymore and also so then you service as of the line will not be refund refunded nor credited and that's what i can see here here on the eighteenth would be your do right"
  • "or the kitchen so before before we can do to where it's supposed to be used let me pull me once you cancel the line if you change your change your mind you will need to pay fifteen dollars it's for the reactivation"
  • "okay so before we cancel the line is there some there's something else on your account that i can help you with or with or only will be the cancellation"
8
  • 'okay just stay on the line while i work on your on your account can i put you on a brief hold a logging into logging'
  • 'okay let me let me put you on put you on a brief hold for a moment okay'
  • 'please christopher open aah confirm it here material quick i place you on hold for a minute one moment'
36
  • "yeah sure thing sure thank you so much for your patience waiting on the line and and and i'm so sorry for the long hold while i while i really do appreciate the again i understand how important port and this is for you and appreciate also that time time that you really drop by on the tickets to worry about this about this concern but as i check for back further here um as i can it's confirmed it it's really not in the sim card but okay but instead on the device that you're using right using right now aah the i m e i i of the device ending in zero nine zero nine zero five this phone is no longer no longer compatible here with a service it it said cricket and that's the reason right now now that the service will not work call because of the phone so we can we can confirm right here that on the like lines that things that you have right here on the account this is the only one one that is currently an active so i even way like it like either to inquire on the crickets for it's for because we can see right here if maybe you are you are qualified for a device upgrade or maybe if you have if you have a spare phone now we can check if this is the this is still compatible with the service at cricket because we can update the i m e i of i of this phone"
  • "hmm okay so if you're if you were to have it activated right right now you the the phone will be eligible for an locked bye by upto per ten"
  • "if you upgrade as per as per checking here you're eligible for a device that hi discount so that means if you plan you plan on upgrading your device you can definitely and i only have a discount as long as you're logged log in your account over cricket wireless dot com com you can choose your device will recover device device if you should be able to receive a discount discount"
54
  • 'thank you got this one not this one here and this is for me to send to get your get your account can i have the four digit pin please'
  • 'the forgot user name'
  • 'oh four alrighty all righty thank you and how about the four digit pin digit pin on the account to verify'
63
  • 'um are there any way i can call back back in a few minutes'
  • "the aah assurance taken off of the other line other line that's on my account but aah okay you got already a letter to the end of it told me that because my account was account was credited eight dollars from the check in the insurance off i thought i only two dollars so when i call back uh to so the card information to you to pay it it tells me that aah or whoever whoever told me that there is no no um i haven't shown in the system but there was any changes made"
  • "i will give you all a call back when i'm ready i'm ready"
43
  • 'i know who i am seeing'
  • "add add in that case i'm glad i was able to provide the details this is my callaghan from cricket stay safe always and bye for now"
  • 'welcome to cricket the coordination this is josie may i have your name please please'
55
  • 'and one day at one on my account not the not and they brought a blocked or lot layest balance and she said it said it would phone was sound to call back all that and they did take the block fully at all all'
  • "thank you for free you were picking up the phone call but anyway if there's anything else feel free feel free to call us back where aah always open aah before also nine"
  • "in this case then um mister mister walker where we'll need to do is i will need you to wanting you to turn off your device for uh um five minutes and then turn it back on and i and i'll be calling them back in around ten minutes okay for you not you not to call back customer care new for you not to wait and to wait anymore okay"
5
  • "yes sir in this case uh from meanwhile it we're doing this jamie name is uh you can also get enroll or roll on the autopay you have aah you have a single line uh recommend you to ready to do that so you can have the five dollar discount setup in"
  • "okay okay and you may add on a debit or credit card with them them and aah that will provide you five dollar discount a discount on your next month's bill right"
  • "okay and usually usually um regarding here on the account do you have autopay autopay on the account and that's why i'm just aah we're just paying for fifty eight dollars a month instead of start of sixty three so here it's aah um too early for us to like give the credit credit on the account because we're crediting over give were giving the five dollar discount or credit aah aah five days before the due date to tech so technically that will be on the twentieth twenty second of august the starting that day what day you can see that the new amount is just it's just fifty eight instead of sixty three okay"
14
  • 'hold on hold on twenty alright allen so i'
  • 'okay yeah then well hold on hold on a shit to that should i would like to me maybe somebody know lane okay aah are you ready'
  • "so hold on hold on we're on the side okay i sent a text message search that you receive uh any text message text message coming from cricket"
2
  • "wasn't aware of the fee"
  • 'a lot of hidden cost'
  • 'high price'
58
  • "i'm gonna go ahead and you transfer"
  • "i'm happy to transfer you"
  • 'uh yes i can transfer transfer you to record to the insurance aah i can aah i can give you the number there'
37
  • 'okay tell me apart from that anything else that you might want you might want to apply to your account'
  • 'this do you have any other concerns'
  • 'no problem and yeah and yes now that we have successfully aah process aah process the payment andrea do you have any other question the questions or concerns'
23
  • "okay just timing can i be lohman here okay perfect just a moment one moment here it may i please you in a brief hold ma'am"
  • 'okay just stay on the line while i work on your on your account can i put you on a brief hold a logging into logging'
  • "okay thank you so much for that information shannon for your help as well now let me go ahead go ahead and just work on my system i cage if you don't mind don't mind going to put you just on a brief hold once i have the i have"
52
  • "thank you you're welcome"
  • "all i'm really i'm really sorry that your son is having issues with this so the services no worries let me pull up your account account so i could help you check it may i have your i have your"
  • "no worries no worries no worries thank you very much for verifying the confirmation make sure that i hear me okay yeah no worries take your time when you're ready tony okay tony okay"
28
  • "i do not i do not have the wifi on um and i only have my daughter on like i been i've been i've been dealing with us from going on three three days and i'm like on so so frustrated cricket stores i tried calling calling them right please are closed today cause labor day okay"
  • "yeah well aah i i think you need to have your manager go back and listen to the into the call that's recorded because clearly he told me on help me on the phone that i could say uh my bank is thank you should probably have your manager go back and listen to the to the phone call so she can hear what he said"
  • 'aah if you will enroll that counterfeits which way you can get seven extension mention aah for example you an android that kind of which the bitch paid today your aah your your um your page pay your extension this time start on the twenty second upon but yeah one two nine two three four five six saffron up until the twenty eight twenty eight of august'
59
  • 'instructions not clear'
  • 'waiting for installation'
  • 'slow installation process'
53
  • "thank you so much and i'm glad i was and i was able to resolve your concern by uh now so that you can now enjoy the retail services once once again nicole this is berna and thank you purchasing cricket and have a great day bye"
  • 'thank you sir thank you so much so right now sage i would just like the car to clarify are you trying to pay your bill on your bill on your online cricket account however you forgot your forgot your password or you forgot'
  • "okay perfect so thank you so much for being part we type precondition my name is marlin and i hope you have a wonderful day ma'am"
45
  • 'brian high ryan how are you doing how are you doing today'
  • "i'm great sir um um how about you"
  • 'agent how are you today'
41
  • 'all right just can i can i have the card number to process the payment one more time'
  • 'okay hmm um we will also going to uh verify that one to for you okay for you okay the way alright so let me check check here and it seems like that that the um card that decline here can you please give me please give me one more time the card number just to make sure i have'
  • 'you know that person that you really really you know who will actually receive this phone they might be able to at least activate the one with one with cricket number that way they can actually surely continue the six months aah can you repeat it written requirements so they can use it with different carrier carrier'
17
  • 'welcome to recap my name is sheila hello how can i help you today'
  • 'just a great week quick recap um corban you calling because one because you wanted'
  • 'i woke up to recap my name is sheila uh how can i help you today'
34
  • 'i am definitely interested'
  • 'what is the extended warranty'
  • 'what are the accessories'
25
  • "my pleasure sir and and uh and uh remember also that all of your lines right now in this case this account i already active okay i don't know uh there's uh there's anything else i can do for you today mister word"
  • "i don't know if it's in there"
  • "hmm okay okay remember that some well oh i old i don't know if you have well well do you have a p s four o a place agent or an excellent"
24
  • 'choosing cricket just my name is danielle how may i have the pleasure to speak to thank you'
  • 'welcome to pick condition my name and my name is judy may i have your name please'
  • "me the opportunity to assist you in it see i explained to you about your services again my name is arlene enjoy the rest of the day ma'am stay safe and happy weekend"
9
  • 'how many times to call'
  • 'kept calling'
  • 'did not get an answer before'
1
  • "okay i understand and i know it's kind of kind of frustrating to get uh try to just you just a services and that isn't working working but no worries is going to be my pleasure today sure today to check up your account and see what's going what's going on so can you please provide me your phone number number"
  • "hi victoria toria um thanks for patiently waiting all right so i check your account further further and i also check um the payment that you made paid and um the payment the payment was already posted um i believe leave um you made the payment today and it was so do as of um is it and it's um sixty dollars dollars right but um your account is already cancelled that's why the that's why the system will require the system will require required to pay aah are we activation fee of five days five dollars okay so looking into the account right now right now there is a balance here or here on five dollars okay so this check just charge is valid this is for for the for the activation fee okay but don't worry okay um let me go ahead go ahead and ask permission from my support my supervisor if we can do something about the five the five dollars amount onto your account okay"
  • "joe your account to reach pay we will extend extend your services for seven days with a process processing the full payment on the account on the on the seven days which is the twenty second second you need to process the the whole amount or you need the price to process the second payment since you're rate plan is sixty five or your bill is sixty sixty five then the only paying payment that you going to process next time is the is the amount of fifty five dollars ten ten dollars go to your services five dollars there's to your account then as well as well as you have credit as well so i'll just set up you set up the bitch pay okay"
29
  • 'when will the enrollment be done'
  • 'when will the offer be activated'
  • 'how long will it take to be delivered'
32
  • 'always data issues'
  • "don't use this"
  • 'data plan not suffice'
18
  • 'not interested'
  • 'i dont want it'
  • 'not for me'
44
  • 'customer service sucks here'
  • 'service agent scheduled didnt come'
  • 'i have been waiting on the automated system forever'
26
  • 'yes lets go ahead'
  • 'sure i like the deal'
  • 'please proceed with the offer'
42
  • 'includes more data'
  • "they don't charge for"
  • 'plan was good'
40
  • 'upgrading to the plan will resolve this issue'
  • 'upgrade plan to resolve issue'
38
  • 'not a great equipment'
  • 'battery runs out'
  • 'problems with your equipment'

Evaluation

Metrics

Label Accuracy
all 0.5463

Uses

Direct Use for Inference

First install the SetFit library:

pip install setfit

Then you can load this model and run inference.

from setfit import SetFitModel

# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("Jalajkx/all_mpnetcric-setfit-model")
# Run inference
preds = model("and then when i asked i didn't even get to speak to the supervisor provider i just got hung up on")

Training Details

Training Set Metrics

Training set Min Median Max
Word count 1 32.4224 283
Label Training Sample Count
0 36
1 36
2 36
3 36
4 36
5 36
6 36
7 36
8 36
9 6
10 36
11 36
12 36
13 9
14 36
15 36
16 17
17 36
18 4
19 29
20 30
21 36
22 25
23 36
24 36
25 36
26 4
27 36
28 36
29 4
30 8
31 36
32 4
33 36
34 11
35 36
36 36
37 36
38 10
39 13
40 2
41 36
42 9
43 36
44 10
45 36
46 36
47 14
48 36
49 36
50 36
51 36
52 36
53 36
54 36
55 36
56 36
57 36
58 36
59 8
60 36
61 36
62 36
63 36

Training Hyperparameters

  • batch_size: (4, 4)
  • num_epochs: (1, 1)
  • max_steps: -1
  • sampling_strategy: oversampling
  • num_iterations: 25
  • body_learning_rate: (2e-05, 2e-05)
  • head_learning_rate: 2e-05
  • loss: CosineSimilarityLoss
  • distance_metric: cosine_distance
  • margin: 0.25
  • end_to_end: False
  • use_amp: False
  • warmup_proportion: 0.1
  • seed: 42
  • eval_max_steps: -1
  • load_best_model_at_end: False

Training Results

Epoch Step Training Loss Validation Loss
0.0000 1 0.2196 -
0.0022 50 0.2183 -
0.0044 100 0.3574 -
0.0065 150 0.1756 -
0.0087 200 0.1396 -
0.0109 250 0.2875 -
0.0131 300 0.1307 -
0.0152 350 0.1465 -
0.0174 400 0.1503 -
0.0196 450 0.1579 -
0.0218 500 0.3216 -
0.0240 550 0.2399 -
0.0261 600 0.2824 -
0.0283 650 0.1217 -
0.0305 700 0.0647 -
0.0327 750 0.2651 -
0.0348 800 0.1792 -
0.0370 850 0.1461 -
0.0392 900 0.0256 -
0.0414 950 0.1175 -
0.0435 1000 0.2394 -
0.0457 1050 0.1582 -
0.0479 1100 0.2785 -
0.0501 1150 0.0611 -
0.0523 1200 0.1937 -
0.0544 1250 0.0804 -
0.0566 1300 0.0811 -
0.0588 1350 0.0663 -
0.0610 1400 0.2148 -
0.0631 1450 0.0428 -
0.0653 1500 0.0083 -
0.0675 1550 0.0884 -
0.0697 1600 0.1341 -
0.0719 1650 0.0949 -
0.0740 1700 0.1839 -
0.0762 1750 0.2244 -
0.0784 1800 0.0309 -
0.0806 1850 0.0277 -
0.0827 1900 0.2016 -
0.0849 1950 0.1174 -
0.0871 2000 0.0942 -
0.0893 2050 0.0483 -
0.0915 2100 0.2057 -
0.0936 2150 0.0151 -
0.0958 2200 0.023 -
0.0980 2250 0.0514 -
0.1002 2300 0.1541 -
0.1023 2350 0.1426 -
0.1045 2400 0.0187 -
0.1067 2450 0.0386 -
0.1089 2500 0.274 -
0.1110 2550 0.0723 -
0.1132 2600 0.0115 -
0.1154 2650 0.053 -
0.1176 2700 0.2371 -
0.1198 2750 0.2472 -
0.1219 2800 0.0386 -
0.1241 2850 0.0159 -
0.1263 2900 0.0276 -
0.1285 2950 0.1229 -
0.1306 3000 0.0037 -
0.1328 3050 0.0029 -
0.1350 3100 0.0037 -
0.1372 3150 0.022 -
0.1394 3200 0.0389 -
0.1415 3250 0.0146 -
0.1437 3300 0.0034 -
0.1459 3350 0.0721 -
0.1481 3400 0.0462 -
0.1502 3450 0.0039 -
0.1524 3500 0.1225 -
0.1546 3550 0.0009 -
0.1568 3600 0.1005 -
0.1590 3650 0.008 -
0.1611 3700 0.121 -
0.1633 3750 0.2982 -
0.1655 3800 0.008 -
0.1677 3850 0.001 -
0.1698 3900 0.216 -
0.1720 3950 0.0458 -
0.1742 4000 0.0155 -
0.1764 4050 0.1235 -
0.1785 4100 0.0059 -
0.1807 4150 0.2421 -
0.1829 4200 0.2232 -
0.1851 4250 0.0396 -
0.1873 4300 0.2164 -
0.1894 4350 0.0839 -
0.1916 4400 0.0116 -
0.1938 4450 0.2666 -
0.1960 4500 0.0648 -
0.1981 4550 0.074 -
0.2003 4600 0.077 -
0.2025 4650 0.0739 -
0.2047 4700 0.0029 -
0.2069 4750 0.0679 -
0.2090 4800 0.0049 -
0.2112 4850 0.0281 -
0.2134 4900 0.049 -
0.2156 4950 0.0052 -
0.2177 5000 0.1657 -
0.2199 5050 0.0005 -
0.2221 5100 0.0041 -
0.2243 5150 0.0008 -
0.2265 5200 0.0587 -
0.2286 5250 0.0753 -
0.2308 5300 0.1744 -
0.2330 5350 0.0055 -
0.2352 5400 0.0023 -
0.2373 5450 0.0002 -
0.2395 5500 0.0472 -
0.2417 5550 0.0042 -
0.2439 5600 0.0137 -
0.2460 5650 0.1646 -
0.2482 5700 0.0509 -
0.2504 5750 0.0062 -
0.2526 5800 0.0019 -
0.2548 5850 0.0048 -
0.2569 5900 0.0031 -
0.2591 5950 0.0011 -
0.2613 6000 0.004 -
0.2635 6050 0.0498 -
0.2656 6100 0.0042 -
0.2678 6150 0.0018 -
0.2700 6200 0.0061 -
0.2722 6250 0.1355 -
0.2744 6300 0.0039 -
0.2765 6350 0.0044 -
0.2787 6400 0.001 -
0.2809 6450 0.0011 -
0.2831 6500 0.0302 -
0.2852 6550 0.1502 -
0.2874 6600 0.0029 -
0.2896 6650 0.0016 -
0.2918 6700 0.0232 -
0.2940 6750 0.176 -
0.2961 6800 0.0323 -
0.2983 6850 0.0818 -
0.3005 6900 0.0427 -
0.3027 6950 0.1716 -
0.3048 7000 0.0137 -
0.3070 7050 0.0032 -
0.3092 7100 0.0095 -
0.3114 7150 0.177 -
0.3135 7200 0.0005 -
0.3157 7250 0.0157 -
0.3179 7300 0.0012 -
0.3201 7350 0.0027 -
0.3223 7400 0.1351 -
0.3244 7450 0.0019 -
0.3266 7500 0.0009 -
0.3288 7550 0.2017 -
0.3310 7600 0.0059 -
0.3331 7650 0.0013 -
0.3353 7700 0.0377 -
0.3375 7750 0.0056 -
0.3397 7800 0.0055 -
0.3419 7850 0.0745 -
0.3440 7900 0.0046 -
0.3462 7950 0.002 -
0.3484 8000 0.0355 -
0.3506 8050 0.0004 -
0.3527 8100 0.0004 -
0.3549 8150 0.0072 -
0.3571 8200 0.0013 -
0.3593 8250 0.0032 -
0.3615 8300 0.0006 -
0.3636 8350 0.0095 -
0.3658 8400 0.0006 -
0.3680 8450 0.0005 -
0.3702 8500 0.0004 -
0.3723 8550 0.0019 -
0.3745 8600 0.0002 -
0.3767 8650 0.0015 -
0.3789 8700 0.0117 -
0.3810 8750 0.002 -
0.3832 8800 0.0005 -
0.3854 8850 0.0009 -
0.3876 8900 0.0041 -
0.3898 8950 0.0484 -
0.3919 9000 0.0058 -
0.3941 9050 0.0027 -
0.3963 9100 0.0002 -
0.3985 9150 0.2323 -
0.4006 9200 0.0163 -
0.4028 9250 0.0333 -
0.4050 9300 0.0033 -
0.4072 9350 0.0023 -
0.4094 9400 0.0044 -
0.4115 9450 0.0142 -
0.4137 9500 0.0261 -
0.4159 9550 0.004 -
0.4181 9600 0.027 -
0.4202 9650 0.0104 -
0.4224 9700 0.0005 -
0.4246 9750 0.2452 -
0.4268 9800 0.0069 -
0.4290 9850 0.0245 -
0.4311 9900 0.0005 -
0.4333 9950 0.0041 -
0.4355 10000 0.1058 -
0.4377 10050 0.0009 -
0.4398 10100 0.0067 -
0.4420 10150 0.0832 -
0.4442 10200 0.0016 -
0.4464 10250 0.039 -
0.4485 10300 0.0078 -
0.4507 10350 0.0013 -
0.4529 10400 0.0003 -
0.4551 10450 0.0259 -
0.4573 10500 0.008 -
0.4594 10550 0.2137 -
0.4616 10600 0.0083 -
0.4638 10650 0.0206 -
0.4660 10700 0.0039 -
0.4681 10750 0.2205 -
0.4703 10800 0.0072 -
0.4725 10850 0.0436 -
0.4747 10900 0.071 -
0.4769 10950 0.0004 -
0.4790 11000 0.0147 -
0.4812 11050 0.0095 -
0.4834 11100 0.0069 -
0.4856 11150 0.0027 -
0.4877 11200 0.0151 -
0.4899 11250 0.0076 -
0.4921 11300 0.0016 -
0.4943 11350 0.1457 -
0.4965 11400 0.1454 -
0.4986 11450 0.0013 -
0.5008 11500 0.0027 -
0.5030 11550 0.0583 -
0.5052 11600 0.0029 -
0.5073 11650 0.0139 -
0.5095 11700 0.0004 -
0.5117 11750 0.0098 -
0.5139 11800 0.0009 -
0.5160 11850 0.0003 -
0.5182 11900 0.0009 -
0.5204 11950 0.0088 -
0.5226 12000 0.0006 -
0.5248 12050 0.0014 -
0.5269 12100 0.0008 -
0.5291 12150 0.0008 -
0.5313 12200 0.0008 -
0.5335 12250 0.0005 -
0.5356 12300 0.0028 -
0.5378 12350 0.0011 -
0.5400 12400 0.0136 -
0.5422 12450 0.0318 -
0.5444 12500 0.0037 -
0.5465 12550 0.0029 -
0.5487 12600 0.0073 -
0.5509 12650 0.0099 -
0.5531 12700 0.015 -
0.5552 12750 0.0047 -
0.5574 12800 0.0891 -
0.5596 12850 0.0007 -
0.5618 12900 0.0784 -
0.5640 12950 0.0636 -
0.5661 13000 0.0029 -
0.5683 13050 0.0048 -
0.5705 13100 0.0698 -
0.5727 13150 0.0002 -
0.5748 13200 0.0734 -
0.5770 13250 0.0004 -
0.5792 13300 0.0135 -
0.5814 13350 0.0034 -
0.5835 13400 0.0018 -
0.5857 13450 0.0175 -
0.5879 13500 0.0003 -
0.5901 13550 0.0002 -
0.5923 13600 0.0032 -
0.5944 13650 0.0007 -
0.5966 13700 0.0021 -
0.5988 13750 0.0019 -
0.6010 13800 0.0006 -
0.6031 13850 0.0014 -
0.6053 13900 0.0011 -
0.6075 13950 0.2383 -
0.6097 14000 0.0009 -
0.6119 14050 0.0863 -
0.6140 14100 0.0005 -
0.6162 14150 0.0017 -
0.6184 14200 0.0003 -
0.6206 14250 0.0025 -
0.6227 14300 0.0008 -
0.6249 14350 0.0005 -
0.6271 14400 0.0006 -
0.6293 14450 0.0517 -
0.6315 14500 0.0005 -
0.6336 14550 0.0075 -
0.6358 14600 0.0004 -
0.6380 14650 0.0003 -
0.6402 14700 0.0003 -
0.6423 14750 0.0045 -
0.6445 14800 0.0005 -
0.6467 14850 0.0002 -
0.6489 14900 0.0125 -
0.6510 14950 0.0015 -
0.6532 15000 0.0017 -
0.6554 15050 0.0011 -
0.6576 15100 0.0207 -
0.6598 15150 0.0002 -
0.6619 15200 0.0252 -
0.6641 15250 0.0006 -
0.6663 15300 0.0015 -
0.6685 15350 0.0018 -
0.6706 15400 0.0386 -
0.6728 15450 0.0011 -
0.6750 15500 0.0003 -
0.6772 15550 0.0007 -
0.6794 15600 0.0028 -
0.6815 15650 0.0056 -
0.6837 15700 0.0005 -
0.6859 15750 0.0002 -
0.6881 15800 0.0305 -
0.6902 15850 0.0005 -
0.6924 15900 0.0018 -
0.6946 15950 0.0011 -
0.6968 16000 0.0006 -
0.6990 16050 0.0072 -
0.7011 16100 0.0224 -
0.7033 16150 0.0011 -
0.7055 16200 0.0005 -
0.7077 16250 0.0007 -
0.7098 16300 0.0005 -
0.7120 16350 0.0028 -
0.7142 16400 0.0017 -
0.7164 16450 0.2294 -
0.7185 16500 0.0253 -
0.7207 16550 0.0122 -
0.7229 16600 0.0001 -
0.7251 16650 0.0327 -
0.7273 16700 0.0042 -
0.7294 16750 0.0008 -
0.7316 16800 0.0004 -
0.7338 16850 0.0003 -
0.7360 16900 0.0005 -
0.7381 16950 0.0003 -
0.7403 17000 0.0021 -
0.7425 17050 0.2041 -
0.7447 17100 0.0002 -
0.7469 17150 0.0006 -
0.7490 17200 0.0002 -
0.7512 17250 0.0008 -
0.7534 17300 0.068 -
0.7556 17350 0.0016 -
0.7577 17400 0.0006 -
0.7599 17450 0.0005 -
0.7621 17500 0.0011 -
0.7643 17550 0.2192 -
0.7665 17600 0.0006 -
0.7686 17650 0.0003 -
0.7708 17700 0.0017 -
0.7730 17750 0.0033 -
0.7752 17800 0.0001 -
0.7773 17850 0.0011 -
0.7795 17900 0.0302 -
0.7817 17950 0.0004 -
0.7839 18000 0.2921 -
0.7860 18050 0.0001 -
0.7882 18100 0.006 -
0.7904 18150 0.0164 -
0.7926 18200 0.0003 -
0.7948 18250 0.0021 -
0.7969 18300 0.0094 -
0.7991 18350 0.002 -
0.8013 18400 0.0405 -
0.8035 18450 0.001 -
0.8056 18500 0.2594 -
0.8078 18550 0.0075 -
0.8100 18600 0.0003 -
0.8122 18650 0.0009 -
0.8144 18700 0.0018 -
0.8165 18750 0.0007 -
0.8187 18800 0.0006 -
0.8209 18850 0.0009 -
0.8231 18900 0.0003 -
0.8252 18950 0.0006 -
0.8274 19000 0.0002 -
0.8296 19050 0.0004 -
0.8318 19100 0.0018 -
0.8340 19150 0.0007 -
0.8361 19200 0.0005 -
0.8383 19250 0.0206 -
0.8405 19300 0.0005 -
0.8427 19350 0.1918 -
0.8448 19400 0.0093 -
0.8470 19450 0.0032 -
0.8492 19500 0.0004 -
0.8514 19550 0.1727 -
0.8535 19600 0.2034 -
0.8557 19650 0.0007 -
0.8579 19700 0.0004 -
0.8601 19750 0.0001 -
0.8623 19800 0.0024 -
0.8644 19850 0.0122 -
0.8666 19900 0.0003 -
0.8688 19950 0.0093 -
0.8710 20000 0.0003 -
0.8731 20050 0.0007 -
0.8753 20100 0.0044 -
0.8775 20150 0.0006 -
0.8797 20200 0.0002 -
0.8819 20250 0.0003 -
0.8840 20300 0.0024 -
0.8862 20350 0.0051 -
0.8884 20400 0.0767 -
0.8906 20450 0.0004 -
0.8927 20500 0.0002 -
0.8949 20550 0.0007 -
0.8971 20600 0.0012 -
0.8993 20650 0.0004 -
0.9015 20700 0.0003 -
0.9036 20750 0.0002 -
0.9058 20800 0.0005 -
0.9080 20850 0.0007 -
0.9102 20900 0.0006 -
0.9123 20950 0.2469 -
0.9145 21000 0.0002 -
0.9167 21050 0.0009 -
0.9189 21100 0.002 -
0.9210 21150 0.0027 -
0.9232 21200 0.0007 -
0.9254 21250 0.0008 -
0.9276 21300 0.0265 -
0.9298 21350 0.0019 -
0.9319 21400 0.0003 -
0.9341 21450 0.0064 -
0.9363 21500 0.0003 -
0.9385 21550 0.0015 -
0.9406 21600 0.0002 -
0.9428 21650 0.0015 -
0.9450 21700 0.1497 -
0.9472 21750 0.1422 -
0.9494 21800 0.0001 -
0.9515 21850 0.0007 -
0.9537 21900 0.0053 -
0.9559 21950 0.0002 -
0.9581 22000 0.0003 -
0.9602 22050 0.1234 -
0.9624 22100 0.2087 -
0.9646 22150 0.0005 -
0.9668 22200 0.0001 -
0.9690 22250 0.0003 -
0.9711 22300 0.0004 -
0.9733 22350 0.0014 -
0.9755 22400 0.0021 -
0.9777 22450 0.0105 -
0.9798 22500 0.0009 -
0.9820 22550 0.0003 -
0.9842 22600 0.0006 -
0.9864 22650 0.0007 -
0.9885 22700 0.0021 -
0.9907 22750 0.003 -
0.9929 22800 0.0099 -
0.9951 22850 0.001 -
0.9973 22900 0.0521 -
0.9994 22950 0.0003 -

Framework Versions

  • Python: 3.10.13
  • SetFit: 1.0.1
  • Sentence Transformers: 2.2.2
  • Transformers: 4.36.2
  • PyTorch: 2.0.1
  • Datasets: 2.16.1
  • Tokenizers: 0.15.0

Citation

BibTeX

@article{https://doi.org/10.48550/arxiv.2209.11055,
    doi = {10.48550/ARXIV.2209.11055},
    url = {https://arxiv.org/abs/2209.11055},
    author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
    keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
    title = {Efficient Few-Shot Learning Without Prompts},
    publisher = {arXiv},
    year = {2022},
    copyright = {Creative Commons Attribution 4.0 International}
}