File size: 29,555 Bytes
d1d8dcf
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
---
base_model: sentence-transformers/paraphrase-mpnet-base-v2
library_name: setfit
metrics:
- accuracy
pipeline_tag: text-classification
tags:
- setfit
- sentence-transformers
- text-classification
- generated_from_setfit_trainer
widget:
- text: category generator refuel fixed diesel special access no vendor acas problem
    description rbs generator fuel low
- text: troubleshooting generator has been running non stop need emergency refuel
    alarms are as follows rbs commercial power fail rbs generator fuel low rbs generator
    running rbs generator shut down rbs gen transfer sw operated test results site
    will go off the air without urgent refuel trouble description per ticket tt000080377504
    sfp_as cvl06424 5 external alarm fieldreplaceableunit=sau 1 alarmport=2 rbs commercial
    power fail history of trouble none vendor acas problem description fixed gen special
    access none
- text: troubleshooting triage category generator shut down oss netcool alarms dxl05963
    rbs generator shut down fieldreplaceableunit=sau alarmport=22 2024 08 21 02 11
    15 smart alarm rbs generator shut down mdat verification y no repeats no open
    related tckt no active eim no intrusion knowledge judgement sending to vendor
    to investigate and resolve gen shut down condition dispatch strategy vendor test
    results triage category generator shut down oss netcool alarms dxl05963 rbs generator
    shut down fieldreplaceableunit=sau alarmport=22 2024 08 21 02 11 15 smart alarm
    rbs generator shut down mdat verification y no repeats no open related tckt no
    active eim no intrusion knowledge judgement sending to vendor to investigate and
    resolve gen shut down condition dispatch strategy vendor trouble description triage
    category generator shut down oss netcool alarms dxl05963 rbs generator shut down
    fieldreplaceableunit=sau alarmport=22 2024 08 21 02 11 15 smart alarm rbs generator
    shut down mdat verification y no repeats no open related tckt no active eim no
    intrusion knowledge judgement sending to vendor to investigate and resolve gen
    shut down condition dispatch strategy vendor history of trouble triage category
    generator shut down oss netcool alarms dxl05963 rbs generator shut down fieldreplaceableunit=sau
    alarmport=22 2024 08 21 02 11 15 smart alarm rbs generator shut down mdat verification
    y no repeats no open related tckt no active eim no intrusion knowledge judgement
    sending to vendor to investigate and resolve gen shut down condition dispatch
    strategy vendor vendor acas problem description triage category generator shut
    down oss netcool alarms dxl05963 rbs generator shut down fieldreplaceableunit=sau
    alarmport=22 2024 08 21 02 11 15 smart alarm rbs generator shut down mdat verification
    y no repeats no open related tckt no active eim no intrusion knowledge judgement
    sending to vendor to investigate and resolve gen shut down condition dispatch
    strategy vendor special access triage category generator shut down oss netcool
    alarms dxl05963 rbs generator shut down fieldreplaceableunit=sau alarmport=22
    2024 08 21 02 11 15 smart alarm rbs generator shut down mdat verification y no
    repeats no open related tckt no active eim no intrusion knowledge judgement sending
    to vendor to investigate and resolve gen shut down condition dispatch strategy
    vendor
- text: troubleshooting triage category gen fail oss netcool alarms rbs generator
    fail fieldreplaceableunit=sau alarmport=22 rbs generator fail ca placerville cell
    site lotus carlsen 2024 08 20 06 27 41 smart alarm rbs generator fail fieldreplaceableunit=sau
    alarmport=22 2024 08 20 06 27 36 mdat verification fixed gen history no repeats
    tab no open related tickets in aots knowledge judgement sending to vendor to check
    gen fail dispatch strategy vendor test results triage category gen fail oss netcool
    alarms rbs generator fail fieldreplaceableunit=sau alarmport=22 rbs generator
    fail ca placerville cell site lotus carlsen 2024 08 20 06 27 41 smart alarm rbs
    generator fail fieldreplaceableunit=sau alarmport=22 2024 08 20 06 27 36 mdat
    verification fixed gen history no repeats tab no open related tickets in aots
    knowledge judgement sending to vendor to check gen fail dispatch strategy vendor
    trouble description triage category gen fail oss netcool alarms rbs generator
    fail fieldreplaceableunit=sau alarmport=22 rbs generator fail ca placerville cell
    site lotus carlsen 2024 08 20 06 27 41 smart alarm rbs generator fail fieldreplaceableunit=sau
    alarmport=22 2024 08 20 06 27 36 mdat verification fixed gen history no repeats
    tab no open related tickets in aots knowledge judgement sending to vendor to check
    gen fail dispatch strategy vendor history of trouble na vendor acas problem description
    triage category gen fail oss netcool alarms rbs generator fail fieldreplaceableunit=sau
    alarmport=22 rbs generator fail ca placerville cell site lotus carlsen 2024 08
    20 06 27 41 smart alarm rbs generator fail fieldreplaceableunit=sau alarmport=22
    2024 08 20 06 27 36 mdat verification fixed gen history no repeats tab no open
    related tickets in aots knowledge judgement sending to vendor to check gen fail
    dispatch strategy vendor special access na
- text: investigate gen fail requestor olivarez zachary requestor email zachary olivarez
    verizonwireless com requestor phone 760 927 0406
inference: true
model-index:
- name: SetFit with sentence-transformers/paraphrase-mpnet-base-v2
  results:
  - task:
      type: text-classification
      name: Text Classification
    dataset:
      name: Unknown
      type: unknown
      split: test
    metrics:
    - type: accuracy
      value: 0.625
      name: Accuracy
---

# SetFit with sentence-transformers/paraphrase-mpnet-base-v2

This is a [SetFit](https://github.com/huggingface/setfit) model that can be used for Text Classification. This SetFit model uses [sentence-transformers/paraphrase-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-mpnet-base-v2) as the Sentence Transformer embedding model. A [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance is used for classification.

The model has been trained using an efficient few-shot learning technique that involves:

1. Fine-tuning a [Sentence Transformer](https://www.sbert.net) with contrastive learning.
2. Training a classification head with features from the fine-tuned Sentence Transformer.

## Model Details

### Model Description
- **Model Type:** SetFit
- **Sentence Transformer body:** [sentence-transformers/paraphrase-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-mpnet-base-v2)
- **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance
- **Maximum Sequence Length:** 512 tokens
- **Number of Classes:** 2 classes
<!-- - **Training Dataset:** [Unknown](https://huggingface.co/datasets/unknown) -->
<!-- - **Language:** Unknown -->
<!-- - **License:** Unknown -->

### Model Sources

- **Repository:** [SetFit on GitHub](https://github.com/huggingface/setfit)
- **Paper:** [Efficient Few-Shot Learning Without Prompts](https://arxiv.org/abs/2209.11055)
- **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)

### Model Labels
| Label | Examples                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    |
|:------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| 1     | <ul><li>'troubleshooting triage category generator shut down oss netcool alarms ccl04246 rbs generator shut down fieldreplaceableunit=sau alarmport=5 rbs generator shut down 2024 07 04 16 31 52 smart alarm ccl04246 rbs generator shut down fieldreplaceableunit=sau alarmport=5 2024 07 04 16 31 36 mdat oremis verification generac baldor magnum repeats open related tckt active eim intrusionknowledge judgement sending to vendor to investigate and resolve gen shut down condition dispatch strategy vendor test results triage category generator shut down oss netcool alarms ccl04246 rbs generator shut down fieldreplaceableunit=sau alarmport=5 rbs generator shut down 2024 07 04 16 31 52 smart alarm ccl04246 rbs generator shut down fieldreplaceableunit=sau alarmport=5 2024 07 04 16 31 36 mdat oremis verification generac baldor magnum repeats open related tckt active eim intrusionknowledge judgement sending to vendor to investigate and resolve gen shut down condition dispatch strategy vendor trouble description triage category generator shut down oss netcool alarms ccl04246 rbs generator shut down fieldreplaceableunit=sau alarmport=5 rbs generator shut down 2024 07 04 16 31 52 smart alarm ccl04246 rbs generator shut down fieldreplaceableunit=sau alarmport=5 2024 07 04 16 31 36 mdat oremis verification generac baldor magnum repeats open related tckt active eim intrusionknowledge judgement sending to vendor to investigate and resolve gen shut down condition dispatch strategy vendor history of trouble na vendor acas problem description triage category generator shut down oss netcool alarms ccl04246 rbs generator shut down fieldreplaceableunit=sau alarmport=5 rbs generator shut down 2024 07 04 16 31 52 smart alarm ccl04246 rbs generator shut down fieldreplaceableunit=sau alarmport=5 2024 07 04 16 31 36 mdat oremis verification generac baldor magnum repeats open related tckt active eim intrusionknowledge judgement sending to vendor to investigate and resolve gen shut down condition dispatch strategy vendor special access na'</li><li>'troubleshooting triage category rbs generator fuel leak alarm cvl08526 cvl08526 rbs generator fuel leak fieldreplaceableunit=sau 1 alarmport=23 2024 07 10 13 07 38 cvl08526 cvl08526 rbs rbs generator fuel leak fieldreplaceableunit=sau 1 alarmport=20 2024 07 10 13 05 04 mdat oremis verification generator generac baldor magnum sd30 manufacturer generac baldor magnum model sd30 status in use serial 3008406953 kw 30 prime power source no still on site yes engine perkins engine co ltd 404d 22ta manufacturer perkins engine co ltd model 404d 22ta serial gr84695u9967000g max engine kw 36 manufacturered date 2021 02 01 engine type diesel max brake hp 49 in service date 2022 07 13 fuel type ultra low sulfur diesel ulsd owner cell no repeats open related tckt active eim intrusion knowledge judgement sending to vendor to investigate and resolve gen rbs generator fuel leak condition dispatch strategy vendor test results triage category generator rbs generator fuel leak alarm cvl08526 cvl08526 rbs generator fuel leak fieldreplaceableunit=sau 1 alarmport=23 2024 07 10 13 07 38 cvl08526 cvl08526 rbs generator rbs generator fuel leak fieldreplaceableunit=sau 1 alarmport=20 2024 07 10 13 05 04 mdat oremis verification generator generac baldor magnum sd30 manufacturer generac baldor magnum model sd30 status in use serial 3008406953 kw 30 prime power source no still on site yes engine perkins engine co ltd 404d 22ta manufacturer perkins engine co ltd model 404d 22ta serial gr84695u9967000g max engine kw 36 manufacturered date 2021 02 01 engine type diesel max brake hp 49 in service date 2022 07 13 fuel type ultra low sulfur diesel ulsd owner cell no repeats open related tckt active eim intrusion knowledge judgement sending to vendor to investigate and resolve gen rbs generator fuel leak condition dispatch strategy vendor trouble description smart rbs generator fuel leak history of trouble na vendor acas problem description smart rbs generator fuel leak special access na'</li><li>'troubleshooting performed blackout test test results transfer switch display goes dark when commercial power is shut off generator does not start trouble description please create a work order for generator contractor to troubleshoot fixed generator transfer switch transfer switch failed blackout test and needs battery replaced will result in full site outage if commercial power is lost history of trouble unknown vendor acas problem description transfer switch display goes dark when commercial power is shut off generator does not start special access none'</li></ul> |
| 0     | <ul><li>'generaro will not start also please check the timer for tuesdays starting 9am alarm on the display oil pressure shutdown try to reset an start it but no luick poc davila rosalio requestor email rosalio davila verizonwireless com requestor phone 602 689 5506'</li><li>'troubleshooting triage category gen fail cli alarms rbs generator shut down fieldreplaceableunit=sau 1 alarmport=9 2024 08 28 19 24 42 mdat verification y generator generac baldor magnum sd30 3008240427 fixed knowledge judgement sending to vendor to check generator dispatch strategy vendor test results triage category gen fail cli alarms rbs generator shut down fieldreplaceableunit=sau 1 alarmport=9 2024 08 28 19 24 42 mdat verification y generator generac baldor magnum sd30 3008240427 fixed knowledge judgement sending to vendor to check generator dispatch strategy vendor trouble description triage category gen fail cli alarms rbs generator shut down fieldreplaceableunit=sau 1 alarmport=9 2024 08 28 19 24 42 mdat verification y generator generac baldor magnum sd30 3008240427 fixed knowledge judgement sending to vendor to check generator dispatch strategy vendor history of trouble n a special access n a vendor acas problem description triage category gen fail cli alarms rbs generator shut down fieldreplaceableunit=sau 1 alarmport=9 2024 08 28 19 24 42 mdat verification y generator generac baldor magnum sd30 3008240427 fixed knowledge judgement sending to vendor to check generator dispatch strategy vendor wo po 2024ai0643'</li><li>'category generator refuel fixed diesel special access n a vendor acas problem description dxl02686 rbs generator fuel low fieldreplaceableunit=sau alarmport=13 rbs generator fuel low tx hawkins cell site us 80 hawkins 2024 08 08 01 55 32 2024 08 08 01 58 24 04 32 33'</li></ul>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |

## Evaluation

### Metrics
| Label   | Accuracy |
|:--------|:---------|
| **all** | 0.625    |

## Uses

### Direct Use for Inference

First install the SetFit library:

```bash
pip install setfit
```

Then you can load this model and run inference.

```python
from setfit import SetFitModel

# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("edwsiew/phantom-dispatch-02")
# Run inference
preds = model("category generator refuel fixed diesel special access no vendor acas problem description rbs generator fuel low")
```

<!--
### Downstream Use

*List how someone could finetune this model on their own dataset.*
-->

<!--
### Out-of-Scope Use

*List how the model may foreseeably be misused and address what users ought not to do with the model.*
-->

<!--
## Bias, Risks and Limitations

*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
-->

<!--
### Recommendations

*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
-->

## Training Details

### Training Set Metrics
| Training set | Min | Median   | Max |
|:-------------|:----|:---------|:----|
| Word count   | 16  | 168.2540 | 915 |

| Label | Training Sample Count |
|:------|:----------------------|
| 0     | 14                    |
| 1     | 49                    |

### Training Hyperparameters
- batch_size: (8, 8)
- num_epochs: (1, 1)
- max_steps: -1
- sampling_strategy: oversampling
- num_iterations: 20
- body_learning_rate: (2e-05, 2e-05)
- head_learning_rate: 2e-05
- loss: CosineSimilarityLoss
- distance_metric: cosine_distance
- margin: 0.25
- end_to_end: False
- use_amp: False
- warmup_proportion: 0.1
- seed: 42
- eval_max_steps: -1
- load_best_model_at_end: False

### Training Results
| Epoch  | Step | Training Loss | Validation Loss |
|:------:|:----:|:-------------:|:---------------:|
| 0.0032 | 1    | 0.31          | -               |
| 0.1587 | 50   | 0.0308        | -               |
| 0.3175 | 100  | 0.0131        | -               |
| 0.4762 | 150  | 0.0023        | -               |
| 0.6349 | 200  | 0.0056        | -               |
| 0.7937 | 250  | 0.0009        | -               |
| 0.9524 | 300  | 0.0003        | -               |

### Framework Versions
- Python: 3.12.0
- SetFit: 1.0.3
- Sentence Transformers: 3.0.1
- Transformers: 4.39.0
- PyTorch: 2.4.0+cu121
- Datasets: 2.21.0
- Tokenizers: 0.15.2

## Citation

### BibTeX
```bibtex
@article{https://doi.org/10.48550/arxiv.2209.11055,
    doi = {10.48550/ARXIV.2209.11055},
    url = {https://arxiv.org/abs/2209.11055},
    author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
    keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
    title = {Efficient Few-Shot Learning Without Prompts},
    publisher = {arXiv},
    year = {2022},
    copyright = {Creative Commons Attribution 4.0 International}
}
```

<!--
## Glossary

*Clearly define terms in order to be accessible across audiences.*
-->

<!--
## Model Card Authors

*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
-->

<!--
## Model Card Contact

*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
-->