edwsiew/phantom-dispatch-01

SetFit with sentence-transformers/paraphrase-mpnet-base-v2

This is a SetFit model that can be used for Text Classification. This SetFit model uses sentence-transformers/paraphrase-mpnet-base-v2 as the Sentence Transformer embedding model. A LogisticRegression instance is used for classification.

The model has been trained using an efficient few-shot learning technique that involves:

1. Fine-tuning a Sentence Transformer with contrastive learning.
2. Training a classification head with features from the fine-tuned Sentence Transformer.

Model Details

Model Description

• Model Type: SetFit
• Sentence Transformer body: sentence-transformers/paraphrase-mpnet-base-v2
• Classification head: a LogisticRegression instance
• Maximum Sequence Length: 512 tokens
• Number of Classes: 2 classes

Model Sources

• Repository: SetFit on GitHub
• Paper: Efficient Few-Shot Learning Without Prompts
• Blogpost: SetFit: Efficient Few-Shot Learning Without Prompts

Model Labels

Label	Examples
1	'please dispatch to troubleshoot generator failure the generator failed during exercise requestor cadenhead jason requestor email jason cadenhead verizonwireless com requestor phone 903 399 6027' 'troubleshooting triage category generator shut down oss netcool alarms ccl04246 rbs generator shut down fieldreplaceableunit=sau alarmport=5 rbs generator shut down 2024 07 04 16 31 52 smart alarm ccl04246 rbs generator shut down fieldreplaceableunit=sau alarmport=5 2024 07 04 16 31 36 mdat oremis verification generac baldor magnum repeats open related tckt active eim intrusionknowledge judgement sending to vendor to investigate and resolve gen shut down condition dispatch strategy vendor test results triage category generator shut down oss netcool alarms ccl04246 rbs generator shut down fieldreplaceableunit=sau alarmport=5 rbs generator shut down 2024 07 04 16 31 52 smart alarm ccl04246 rbs generator shut down fieldreplaceableunit=sau alarmport=5 2024 07 04 16 31 36 mdat oremis verification generac baldor magnum repeats open related tckt active eim intrusionknowledge judgement sending to vendor to investigate and resolve gen shut down condition dispatch strategy vendor trouble description triage category generator shut down oss netcool alarms ccl04246 rbs generator shut down fieldreplaceableunit=sau alarmport=5 rbs generator shut down 2024 07 04 16 31 52 smart alarm ccl04246 rbs generator shut down fieldreplaceableunit=sau alarmport=5 2024 07 04 16 31 36 mdat oremis verification generac baldor magnum repeats open related tckt active eim intrusionknowledge judgement sending to vendor to investigate and resolve gen shut down condition dispatch strategy vendor history of trouble na vendor acas problem description triage category generator shut down oss netcool alarms ccl04246 rbs generator shut down fieldreplaceableunit=sau alarmport=5 rbs generator shut down 2024 07 04 16 31 52 smart alarm ccl04246 rbs generator shut down fieldreplaceableunit=sau alarmport=5 2024 07 04 16 31 36 mdat oremis verification generac baldor magnum repeats open related tckt active eim intrusionknowledge judgement sending to vendor to investigate and resolve gen shut down condition dispatch strategy vendor special access na' 'troubleshooting triage category gen fail oss netcool alarms dxl02173 rbs generator fail fieldreplaceableunit=sau alarmport=13 rbs generator fail tx buffalo cell site dt buffalo 2024 08 11 04 59 30 2024 08 11 04 59 30 07 20 36 7200 56110 1091 1 30508 dxl02173 southwest central texas 0 external alarm ericsson_oss_rc dxl02173 ericsson_oss external alarm rbs generator fail d_357_prx1 mobility pl1_259ag 61089964 0 0 2024 08 11 2 3 critical 5 dxl02173 rbs generator fail fieldreplaceableunit=sau alarmport=13 rbs generator fail tx buffalo cell site dt buffalo 2024 08 11 05 01 11 2024 08 11 05 01 11 07 18 55 7200 tt000080568668 56110 1091 1 30508 dxl02173 southwest central texas 1723385658 correlated external alarm correlated ericsson_oss_rc dxl02173 ericsson_oss external alarm rbs generator fail smart alarm dxl02173 dxl02173 rbs generator fail fieldreplaceableunit=sau alarmport=13 2024 08 11 06 59 23 mdat verification generac baldor magnum history no repeats tab no open related tickets in aots knowledge judgement sending to vendor to check gen fail weekly scheduled exercise tu 1pm for 30 mins active rbs generator fail alarm pls send vendor to check the generator dispatch strategy vendor test results triage category gen fail oss netcool alarms dxl02173 rbs generator fail fieldreplaceableunit=sau alarmport=13 rbs generator fail tx buffalo cell site dt buffalo 2024 08 11 04 59 30 2024 08 11 04 59 30 07 20 36 7200 56110 1091 1 30508 dxl02173 southwest central texas 0 external alarm ericsson_oss_rc dxl02173 ericsson_oss external alarm rbs generator fail d_357_prx1 mobility pl1_259ag 61089964 0 0 2024 08 11 2 3 critical 5 dxl02173 rbs generator fail fieldreplaceableunit=sau alarmport=13 rbs generator fail tx buffalo cell site dt buffalo 2024 08 11 05 01 11 2024 08 11 05 01 11 07 18 55 7200 tt000080568668 56110 1091 1 30508 dxl02173 southwest central texas 1723385658 correlated external alarm correlated ericsson_oss_rc dxl02173 ericsson_oss external alarm rbs generator fail smart alarm dxl02173 dxl02173 rbs generator fail fieldreplaceableunit=sau alarmport=13 2024 08 11 06 59 23 mdat verification generac baldor magnum history no repeats tab no open related tickets in aots knowledge judgement sending to vendor to check gen fail weekly scheduled exercise tu 1pm for 30 mins active rbs generator fail alarm pls send vendor to check the generator dispatch strategy vendor trouble description triage category gen fail oss netcool alarms dxl02173 rbs generator fail fieldreplaceableunit=sau alarmport=13 rbs generator fail tx buffalo cell site dt buffalo 2024 08 11 04 59 30 2024 08 11 04 59 30 07 20 36 7200 56110 1091 1 30508 dxl02173 southwest central texas 0 external alarm ericsson_oss_rc dxl02173 ericsson_oss external alarm rbs generator fail d_357_prx1 mobility pl1_259ag 61089964 0 0 2024 08 11 2 3 critical 5 dxl02173 rbs generator fail fieldreplaceableunit=sau alarmport=13 rbs generator fail tx buffalo cell site dt buffalo 2024 08 11 05 01 11 2024 08 11 05 01 11 07 18 55 7200 tt000080568668 56110 1091 1 30508 dxl02173 southwest central texas 1723385658 correlated external alarm correlated ericsson_oss_rc dxl02173 ericsson_oss external alarm rbs generator fail smart alarm dxl02173 dxl02173 rbs generator fail fieldreplaceableunit=sau alarmport=13 2024 08 11 06 59 23 mdat verification generac baldor magnum history no repeats tab no open related tickets in aots knowledge judgement sending to vendor to check gen fail weekly scheduled exercise tu 1pm for 30 mins active rbs generator fail alarm pls send vendor to check the generator dispatch strategy vendor history of trouble na vendor acas problem description triage category gen fail oss netcool alarms dxl02173 rbs generator fail fieldreplaceableunit=sau alarmport=13 rbs generator fail tx buffalo cell site dt buffalo 2024 08 11 04 59 30 2024 08 11 04 59 30 07 20 36 7200 56110 1091 1 30508 dxl02173 southwest central texas 0 external alarm ericsson_oss_rc dxl02173 ericsson_oss external alarm rbs generator fail d_357_prx1 mobility pl1_259ag 61089964 0 0 2024 08 11 2 3 critical 5 dxl02173 rbs generator fail fieldreplaceableunit=sau alarmport special access 24x7 access indoor site fixed generator on site portable generator can be deployed to site single phase cam loc on site will need standard length power cords crown castle 800 788 7011 txu oncor 888 313 4747 meter# 113 091 407 acct# 114949 compound combo 7011 locks 3588 lockbox 0696 lockbox is inside generator left hand side'
0	'troubleshooting triage category gen fail cli alarms rbs generator fail fieldreplaceableunit=sau alarmport=24 2024 08 06 06 34 13 mdat verification y generator generac baldor magnum sg35 3002404264 fixed history knowledge judgement sending to vendor to check generator dispatch strategy vendor test results triage category gen fail cli alarms rbs generator fail fieldreplaceableunit=sau alarmport=24 2024 08 06 06 34 13 mdat verification y generator generac baldor magnum sg35 3002404264 fixed history knowledge judgement sending to vendor to check generator dispatch strategy vendor trouble description triage category gen fail cli alarms rbs generator fail fieldreplaceableunit=sau alarmport=24 2024 08 06 06 34 13 mdat verification y generator generac baldor magnum sg35 3002404264 fixed history knowledge judgement sending to vendor to check generator dispatch strategy vendor history of trouble n a vendor acas problem description triage category gen fail cli alarms rbs generator fail fieldreplaceableunit=sau alarmport=24 2024 08 06 06 34 13 mdat verification y generator generac baldor magnum sg35 3002404264 fixed history knowledge judgement sending to vendor to check generator dispatch strategy vendor special access n a' 'troubleshooting triage category gen mj oss netcool alarms cvl06141 rbs generator mj fieldreplaceableunit=sau 1 alarmport=11 rbs generator mj ca kingsburg cell site south traver rev 2024 08 19 11 39 15 2024 08 19 11 39 15 01 39 50 3600 tt000080604725 56110 1091 1 9585 cvl06141 west sacramento 0 external alarm ericsson_oss_rc cvl06141 ericsson_oss external alarm rbs generator mj smart alarm cvl06141 cvl06141 rbs generator mj fieldreplaceableunit=sau 1 alarmport=11 2024 08 19 11 39 07 mdat verification generac baldor magnum history no repeats tab no open related tickets in aots knowledge judgement sending to vendor to check gen mj weekly scheduled exercise tu 06 30 active rbs generator mj alarm pls send vendor to check the generator dispatch strategy vendor test results triage category gen mj oss netcool alarms cvl06141 rbs generator mj fieldreplaceableunit=sau 1 alarmport=11 rbs generator mj ca kingsburg cell site south traver rev 2024 08 19 11 39 15 2024 08 19 11 39 15 01 39 50 3600 tt000080604725 56110 1091 1 9585 cvl06141 west sacramento 0 external alarm ericsson_oss_rc cvl06141 ericsson_oss external alarm rbs generator mj smart alarm cvl06141 cvl06141 rbs generator mj fieldreplaceableunit=sau 1 alarmport=11 2024 08 19 11 39 07 mdat verification generac baldor magnum history no repeats tab no open related tickets in aots knowledge judgement sending to vendor to check gen mj weekly scheduled exercise tu 06 30 active rbs generator mj alarm pls send vendor to check the generator dispatch strategy vendor trouble description triage category gen mj oss netcool alarms cvl06141 rbs generator mj fieldreplaceableunit=sau 1 alarmport=11 rbs generator mj ca kingsburg cell site south traver rev 2024 08 19 11 39 15 2024 08 19 11 39 15 01 39 50 3600 tt000080604725 56110 1091 1 9585 cvl06141 west sacramento 0 external alarm ericsson_oss_rc cvl06141 ericsson_oss external alarm rbs generator mj smart alarm cvl06141 cvl06141 rbs generator mj fieldreplaceableunit=sau 1 alarmport=11 2024 08 19 11 39 07 mdat verification generac baldor magnum history no repeats tab no open related tickets in aots knowledge judgement sending to vendor to check gen mj weekly scheduled exercise tu 06 30 active rbs generator mj alarm pls send vendor to check the generator dispatch strategy vendor history of trouble na vendor acas problem description triage category gen mj oss netcool alarms cvl06141 rbs generator mj fieldreplaceableunit=sau 1 alarmport=11 rbs generator mj ca kingsburg cell site south traver rev 2024 08 19 11 39 15 2024 08 19 11 39 15 01 39 50 3600 tt000080604725 56110 1091 1 9585 cvl06141 west sacramento 0 external alarm ericsson_oss_rc cvl06141 ericsson_oss external alarm rbs generator mj smart alarm cvl06141 cvl06141 rbs generator mj fieldreplaceableunit=sau 1 alarmport=11 2024 08 19 11 39 07 mdat verificatio special access fixed gen on site portable can be deployed 24 7 access no notice required crown managed bu 815954 gate combo 7011 door arrow key generator 7011' 'troubleshooting while on site for generator controller survey we found 2 active alarms alarmport=28 rbs generator mj and alarmport=26 rbs generator fuel leak test results active alarms will be active until vendor changes the 2 alarms from open to close trouble description while on site for generator controller survey we found 2 active alarms alarmport=28 rbs generator mj and alarmport=26 rbs generator fuel leak we need vendor to redefine the alarms on the generator from normally open to normally closed history of trouble n a vendor acas problem description while on site for generator controller survey we found 2 active alarms alarmport=28 rbs generator mj and alarmport=26 rbs generator fuel leak special access n a'

Evaluation

Metrics

Label	Accuracy
all	0.6667

Uses

Direct Use for Inference

First install the SetFit library:

pip install setfit

Then you can load this model and run inference.

from setfit import SetFitModel

# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("edwsiew/phantom-dispatch-01")
# Run inference
preds = model("1 gen with oil pressure shutdown alarm 2 genfail alarm is not showing up in site boss requestor banaag rommel requestor email rommel banaag verizonwireless com requestor phone 951 8342458")

Training Details

Training Set Metrics

Training set	Min	Median	Max
Word count	3	182.3273	915

Label	Training Sample Count
0	14
1	41

Training Hyperparameters

• batch_size: (8, 8)
• num_epochs: (1, 1)
• max_steps: -1
• sampling_strategy: oversampling
• num_iterations: 3
• body_learning_rate: (2e-05, 2e-05)
• head_learning_rate: 2e-05
• loss: CosineSimilarityLoss
• distance_metric: cosine_distance
• margin: 0.25
• end_to_end: False
• use_amp: False
• warmup_proportion: 0.1
• seed: 42
• eval_max_steps: -1
• load_best_model_at_end: False

Training Results

Epoch	Step	Training Loss	Validation Loss
0.0238	1	0.2379	-

Framework Versions

• Python: 3.12.0
• SetFit: 1.0.3
• Sentence Transformers: 3.0.1
• Transformers: 4.39.0
• PyTorch: 2.4.0+cu121
• Datasets: 2.21.0
• Tokenizers: 0.15.2

Citation

BibTeX

@article{https://doi.org/10.48550/arxiv.2209.11055,
    doi = {10.48550/ARXIV.2209.11055},
    url = {https://arxiv.org/abs/2209.11055},
    author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
    keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
    title = {Efficient Few-Shot Learning Without Prompts},
    publisher = {arXiv},
    year = {2022},
    copyright = {Creative Commons Attribution 4.0 International}
}