Hugging Face's logo

kteoh37
/
setfit_sectionxi_changes_100_examples

Text Classification
setfit
Safetensors
sentence-transformers
mpnet
generated_from_setfit_trainer
Eval Results
Model card Files Community
kteoh37 commited on
Commit
8c22287
•
1 Parent(s): 4d42c5b

Push model using huggingface_hub.

Browse files
Files changed (13) hide show
  1. 1_Pooling/config.json +10 -0
  2. README.md +636 -0
  3. config.json +24 -0
  4. config_sentence_transformers.json +10 -0
  5. config_setfit.json +8 -0
  6. model.safetensors +3 -0
  7. model_head.pkl +3 -0
  8. modules.json +14 -0
  9. sentence_bert_config.json +4 -0
  10. special_tokens_map.json +51 -0
  11. tokenizer.json +0 -0
  12. tokenizer_config.json +66 -0
  13. vocab.txt +0 -0
1_Pooling/config.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "word_embedding_dimension": 768,
3
+ "pooling_mode_cls_token": false,
4
+ "pooling_mode_mean_tokens": true,
5
+ "pooling_mode_max_tokens": false,
6
+ "pooling_mode_mean_sqrt_len_tokens": false,
7
+ "pooling_mode_weightedmean_tokens": false,
8
+ "pooling_mode_lasttoken": false,
9
+ "include_prompt": true
10
+ }
README.md ADDED
@@ -0,0 +1,636 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: sentence-transformers/paraphrase-mpnet-base-v2
3
+ library_name: setfit
4
+ metrics:
5
+ - accuracy
6
+ pipeline_tag: text-classification
7
+ tags:
8
+ - setfit
9
+ - sentence-transformers
10
+ - text-classification
11
+ - generated_from_setfit_trainer
12
+ widget:
13
+ - text: Constitutional changes prohibit selling agricultural land to foreigners.
14
+ - text: Administrative procedures for outward direct investments were simplified.
15
+ Direct investment projects no longer have to be referred to the CBC for verification
16
+ of genuineness prior to the transfer of funds through authorized dealers, unless
17
+ the required amount exceeds £C 5 million a year.
18
+ - text: In addition, nonbank corporation which borrow abroad must fulfill certain
19
+ credit rating criteria.
20
+ - text: The threshold above which there are no controls on direct investments by companies
21
+ not listed publicly was reduced to 50% of capital from two-thirds. In the case
22
+ of companies whose shares are listed on the stock exchange, the threshold was
23
+ increased to 50% of capital from 20%.
24
+ - text: The limits on purchases of foreign securities by insurance companies were
25
+ increased to 30% from 25% of technical provisions and risk capital reserves.
26
+ inference: true
27
+ model-index:
28
+ - name: SetFit with sentence-transformers/paraphrase-mpnet-base-v2
29
+ results:
30
+ - task:
31
+ type: text-classification
32
+ name: Text Classification
33
+ dataset:
34
+ name: Unknown
35
+ type: unknown
36
+ split: test
37
+ metrics:
38
+ - type: accuracy
39
+ value: 0.828125
40
+ name: Accuracy
41
+ ---
42
+
43
+ # SetFit with sentence-transformers/paraphrase-mpnet-base-v2
44
+
45
+ This is a [SetFit](https://github.com/huggingface/setfit) model that can be used for Text Classification. This SetFit model uses [sentence-transformers/paraphrase-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-mpnet-base-v2) as the Sentence Transformer embedding model. A [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance is used for classification.
46
+
47
+ The model has been trained using an efficient few-shot learning technique that involves:
48
+
49
+ 1. Fine-tuning a [Sentence Transformer](https://www.sbert.net) with contrastive learning.
50
+ 2. Training a classification head with features from the fine-tuned Sentence Transformer.
51
+
52
+ ## Model Details
53
+
54
+ ### Model Description
55
+ - **Model Type:** SetFit
56
+ - **Sentence Transformer body:** [sentence-transformers/paraphrase-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-mpnet-base-v2)
57
+ - **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance
58
+ - **Maximum Sequence Length:** 512 tokens
59
+ - **Number of Classes:** 3 classes
60
+ <!-- - **Training Dataset:** [Unknown](https://huggingface.co/datasets/unknown) -->
61
+ <!-- - **Language:** Unknown -->
62
+ <!-- - **License:** Unknown -->
63
+
64
+ ### Model Sources
65
+
66
+ - **Repository:** [SetFit on GitHub](https://github.com/huggingface/setfit)
67
+ - **Paper:** [Efficient Few-Shot Learning Without Prompts](https://arxiv.org/abs/2209.11055)
68
+ - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
69
+
70
+ ### Model Labels
71
+ | Label | Examples |
72
+ |:--------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
73
+ | neutral | <ul><li>'Administrative Resolution APS/DJ/DI/No. 221/2021 establishes that for fiscal year 2021 the maximum limit for investments by insurance companies set by the Central Bank of Bolivia includes investments in debt securities issued abroad by the National General Treasury (Bolivian Sovereign Bonds).'</li><li>'Decree No. 04 of the head of the Insurance State Supervision Service replaced Decree No. 51/01 of the president of the National Bank of Georgia as the regulation governing insurance companies and pension funds.'</li><li>'The Law on the Securities Market was promulgated, setting out the legal framework governing capital market operations.'</li></ul> |
74
+ | loosen | <ul><li>'Limits on transfers abroad were increased. Depositors may transfer within their normal business activity and on presentation of supporting documents up to €20,000 a day an account without approval and €20,001 to €300,000 a transaction with approval by the committee established by the MOF and the Central Bank of Cyprus based on the liquidity buffer situation of the bank. Amounts exceeding €300,000 a transaction require individual approval of the committee.'</li><li>'According to the Consolidated Law of Finance (Legislative Decree No. 58 of February 24, 1998) as amended by Legislative Decree No. 44/2014, if mutual funds are covered under EU directives (UCITS and European Directive on Alternative Investment Fund Managers), the CONSOB must be notified before the offering. Under the same amendment, offering securities issued by mutual funds that are not covered under EU directives is not allowed. Previously, offerings of securities issued by mutual funds not covered under EU directives were subject to authorization.'</li><li>'The capital outflow tax was reduced to 4.25% from 4.50%.'</li></ul> |
75
+ | tighten | <ul><li>'Bank Indonesia Regulation No. 14/25/PBI/2012 of December 27, 2012, concerning Receipt of Export Proceeds and Withdrawal of Foreign Currency on External Debt refines Bank Indonesia Regulations Nos. 13/20/PBI/2011 and 14/11/PBI/2012. The new regulation aims to ensure that receipt of foreign exchange proceeds from debt issuance abroad takes place through a domestic foreign exchange bank in the Indonesian banking system. These funds do not have to be kept in a domestic bank and they may be freely transferred abroad. The foreign exchange does not have to be converted to domestic currency. This requirement did not apply to agreements signed before January 2, 2012, during a transition period that ended December 31, 2012.'</li><li>'Investment Proclamation No. 1180/2020 introduced a new framework to register and administer foreign direct investment. It included provisions for a minimum capital amount per project a foreign investor must invest ranging from US$50,000 to US$200,000 depending on the type of investment being undertaken.'</li><li>'External debt of publicly owned enterprises must be approved by the Superior Strategic Council of Publicly Owned Enterprises (Consejo Superior Estratégico de la Empresa Pública—COSEEP) pursuant to Law No. 466 of December 27, 2013.'</li></ul> |
76
+
77
+ ## Evaluation
78
+
79
+ ### Metrics
80
+ | Label | Accuracy |
81
+ |:--------|:---------|
82
+ | **all** | 0.8281 |
83
+
84
+ ## Uses
85
+
86
+ ### Direct Use for Inference
87
+
88
+ First install the SetFit library:
89
+
90
+ ```bash
91
+ pip install setfit
92
+ ```
93
+
94
+ Then you can load this model and run inference.
95
+
96
+ ```python
97
+ from setfit import SetFitModel
98
+
99
+ # Download from the 🤗 Hub
100
+ model = SetFitModel.from_pretrained("kteoh37/setfit_sectionxi_changes_100_examples")
101
+ # Run inference
102
+ preds = model("Constitutional changes prohibit selling agricultural land to foreigners.")
103
+ ```
104
+
105
+ <!--
106
+ ### Downstream Use
107
+
108
+ *List how someone could finetune this model on their own dataset.*
109
+ -->
110
+
111
+ <!--
112
+ ### Out-of-Scope Use
113
+
114
+ *List how the model may foreseeably be misused and address what users ought not to do with the model.*
115
+ -->
116
+
117
+ <!--
118
+ ## Bias, Risks and Limitations
119
+
120
+ *What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
121
+ -->
122
+
123
+ <!--
124
+ ### Recommendations
125
+
126
+ *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
127
+ -->
128
+
129
+ ## Training Details
130
+
131
+ ### Training Set Metrics
132
+ | Training set | Min | Median | Max |
133
+ |:-------------|:----|:--------|:----|
134
+ | Word count | 6 | 38.4936 | 225 |
135
+
136
+ | Label | Training Sample Count |
137
+ |:--------|:----------------------|
138
+ | loosen | 100 |
139
+ | tighten | 100 |
140
+ | neutral | 35 |
141
+
142
+ ### Training Hyperparameters
143
+ - batch_size: (16, 16)
144
+ - num_epochs: (10, 10)
145
+ - max_steps: -1
146
+ - sampling_strategy: oversampling
147
+ - body_learning_rate: (2e-05, 1e-05)
148
+ - head_learning_rate: 0.01
149
+ - loss: CosineSimilarityLoss
150
+ - distance_metric: cosine_distance
151
+ - margin: 0.25
152
+ - end_to_end: False
153
+ - use_amp: False
154
+ - warmup_proportion: 0.1
155
+ - seed: 42
156
+ - eval_max_steps: -1
157
+ - load_best_model_at_end: True
158
+
159
+ ### Training Results
160
+ | Epoch | Step | Training Loss | Validation Loss |
161
+ |:-------:|:--------:|:-------------:|:---------------:|
162
+ | 0.0005 | 1 | 0.2629 | - |
163
+ | 0.0235 | 50 | 0.2148 | - |
164
+ | 0.0471 | 100 | 0.2342 | - |
165
+ | 0.0706 | 150 | 0.2326 | - |
166
+ | 0.0941 | 200 | 0.2391 | - |
167
+ | 0.1176 | 250 | 0.2351 | - |
168
+ | 0.1412 | 300 | 0.1484 | - |
169
+ | 0.1647 | 350 | 0.1034 | - |
170
+ | 0.1882 | 400 | 0.123 | - |
171
+ | 0.2118 | 450 | 0.064 | - |
172
+ | 0.2353 | 500 | 0.0697 | - |
173
+ | 0.2588 | 550 | 0.0367 | - |
174
+ | 0.2824 | 600 | 0.0695 | - |
175
+ | 0.3059 | 650 | 0.0044 | - |
176
+ | 0.3294 | 700 | 0.009 | - |
177
+ | 0.3529 | 750 | 0.0027 | - |
178
+ | 0.3765 | 800 | 0.0012 | - |
179
+ | 0.4 | 850 | 0.0609 | - |
180
+ | 0.4235 | 900 | 0.0019 | - |
181
+ | 0.4471 | 950 | 0.0013 | - |
182
+ | 0.4706 | 1000 | 0.0031 | - |
183
+ | 0.4941 | 1050 | 0.0004 | - |
184
+ | 0.5176 | 1100 | 0.0029 | - |
185
+ | 0.5412 | 1150 | 0.001 | - |
186
+ | 0.5647 | 1200 | 0.0018 | - |
187
+ | 0.5882 | 1250 | 0.0023 | - |
188
+ | 0.6118 | 1300 | 0.0003 | - |
189
+ | 0.6353 | 1350 | 0.0007 | - |
190
+ | 0.6588 | 1400 | 0.0204 | - |
191
+ | 0.6824 | 1450 | 0.0486 | - |
192
+ | 0.7059 | 1500 | 0.0056 | - |
193
+ | 0.7294 | 1550 | 0.0003 | - |
194
+ | 0.7529 | 1600 | 0.0052 | - |
195
+ | 0.7765 | 1650 | 0.0033 | - |
196
+ | 0.8 | 1700 | 0.0021 | - |
197
+ | 0.8235 | 1750 | 0.0003 | - |
198
+ | 0.8471 | 1800 | 0.0111 | - |
199
+ | 0.8706 | 1850 | 0.0003 | - |
200
+ | 0.8941 | 1900 | 0.0531 | - |
201
+ | 0.9176 | 1950 | 0.0075 | - |
202
+ | 0.9412 | 2000 | 0.0003 | - |
203
+ | 0.9647 | 2050 | 0.0022 | - |
204
+ | 0.9882 | 2100 | 0.0006 | - |
205
+ | **1.0** | **2125** | **-** | **0.1384** |
206
+ | 1.0118 | 2150 | 0.0001 | - |
207
+ | 1.0353 | 2200 | 0.0001 | - |
208
+ | 1.0588 | 2250 | 0.0011 | - |
209
+ | 1.0824 | 2300 | 0.0001 | - |
210
+ | 1.1059 | 2350 | 0.0002 | - |
211
+ | 1.1294 | 2400 | 0.0 | - |
212
+ | 1.1529 | 2450 | 0.0002 | - |
213
+ | 1.1765 | 2500 | 0.0003 | - |
214
+ | 1.2 | 2550 | 0.0116 | - |
215
+ | 1.2235 | 2600 | 0.0002 | - |
216
+ | 1.2471 | 2650 | 0.0002 | - |
217
+ | 1.2706 | 2700 | 0.0001 | - |
218
+ | 1.2941 | 2750 | 0.0002 | - |
219
+ | 1.3176 | 2800 | 0.0 | - |
220
+ | 1.3412 | 2850 | 0.0132 | - |
221
+ | 1.3647 | 2900 | 0.0265 | - |
222
+ | 1.3882 | 2950 | 0.0035 | - |
223
+ | 1.4118 | 3000 | 0.0003 | - |
224
+ | 1.4353 | 3050 | 0.0022 | - |
225
+ | 1.4588 | 3100 | 0.0013 | - |
226
+ | 1.4824 | 3150 | 0.0006 | - |
227
+ | 1.5059 | 3200 | 0.0003 | - |
228
+ | 1.5294 | 3250 | 0.0 | - |
229
+ | 1.5529 | 3300 | 0.0198 | - |
230
+ | 1.5765 | 3350 | 0.0001 | - |
231
+ | 1.6 | 3400 | 0.0 | - |
232
+ | 1.6235 | 3450 | 0.0001 | - |
233
+ | 1.6471 | 3500 | 0.0 | - |
234
+ | 1.6706 | 3550 | 0.0 | - |
235
+ | 1.6941 | 3600 | 0.0002 | - |
236
+ | 1.7176 | 3650 | 0.0 | - |
237
+ | 1.7412 | 3700 | 0.0 | - |
238
+ | 1.7647 | 3750 | 0.0023 | - |
239
+ | 1.7882 | 3800 | 0.0 | - |
240
+ | 1.8118 | 3850 | 0.0074 | - |
241
+ | 1.8353 | 3900 | 0.0004 | - |
242
+ | 1.8588 | 3950 | 0.0001 | - |
243
+ | 1.8824 | 4000 | 0.0228 | - |
244
+ | 1.9059 | 4050 | 0.0256 | - |
245
+ | 1.9294 | 4100 | 0.0316 | - |
246
+ | 1.9529 | 4150 | 0.0001 | - |
247
+ | 1.9765 | 4200 | 0.0 | - |
248
+ | 2.0 | 4250 | 0.0 | 0.1386 |
249
+ | 2.0235 | 4300 | 0.0006 | - |
250
+ | 2.0471 | 4350 | 0.0001 | - |
251
+ | 2.0706 | 4400 | 0.0072 | - |
252
+ | 2.0941 | 4450 | 0.0433 | - |
253
+ | 2.1176 | 4500 | 0.0001 | - |
254
+ | 2.1412 | 4550 | 0.0004 | - |
255
+ | 2.1647 | 4600 | 0.0 | - |
256
+ | 2.1882 | 4650 | 0.0024 | - |
257
+ | 2.2118 | 4700 | 0.0 | - |
258
+ | 2.2353 | 4750 | 0.0001 | - |
259
+ | 2.2588 | 4800 | 0.0 | - |
260
+ | 2.2824 | 4850 | 0.0002 | - |
261
+ | 2.3059 | 4900 | 0.0001 | - |
262
+ | 2.3294 | 4950 | 0.0 | - |
263
+ | 2.3529 | 5000 | 0.002 | - |
264
+ | 2.3765 | 5050 | 0.0303 | - |
265
+ | 2.4 | 5100 | 0.0799 | - |
266
+ | 2.4235 | 5150 | 0.0001 | - |
267
+ | 2.4471 | 5200 | 0.0 | - |
268
+ | 2.4706 | 5250 | 0.0024 | - |
269
+ | 2.4941 | 5300 | 0.0001 | - |
270
+ | 2.5176 | 5350 | 0.0138 | - |
271
+ | 2.5412 | 5400 | 0.0 | - |
272
+ | 2.5647 | 5450 | 0.0001 | - |
273
+ | 2.5882 | 5500 | 0.0 | - |
274
+ | 2.6118 | 5550 | 0.0 | - |
275
+ | 2.6353 | 5600 | 0.0 | - |
276
+ | 2.6588 | 5650 | 0.0 | - |
277
+ | 2.6824 | 5700 | 0.0396 | - |
278
+ | 2.7059 | 5750 | 0.0001 | - |
279
+ | 2.7294 | 5800 | 0.0 | - |
280
+ | 2.7529 | 5850 | 0.0002 | - |
281
+ | 2.7765 | 5900 | 0.0001 | - |
282
+ | 2.8 | 5950 | 0.0037 | - |
283
+ | 2.8235 | 6000 | 0.0 | - |
284
+ | 2.8471 | 6050 | 0.0186 | - |
285
+ | 2.8706 | 6100 | 0.0043 | - |
286
+ | 2.8941 | 6150 | 0.0315 | - |
287
+ | 2.9176 | 6200 | 0.0144 | - |
288
+ | 2.9412 | 6250 | 0.0 | - |
289
+ | 2.9647 | 6300 | 0.0052 | - |
290
+ | 2.9882 | 6350 | 0.0003 | - |
291
+ | 3.0 | 6375 | - | 0.1526 |
292
+ | 3.0118 | 6400 | 0.0 | - |
293
+ | 3.0353 | 6450 | 0.0002 | - |
294
+ | 3.0588 | 6500 | 0.0011 | - |
295
+ | 3.0824 | 6550 | 0.0 | - |
296
+ | 3.1059 | 6600 | 0.0 | - |
297
+ | 3.1294 | 6650 | 0.0002 | - |
298
+ | 3.1529 | 6700 | 0.0001 | - |
299
+ | 3.1765 | 6750 | 0.0002 | - |
300
+ | 3.2 | 6800 | 0.0191 | - |
301
+ | 3.2235 | 6850 | 0.0001 | - |
302
+ | 3.2471 | 6900 | 0.0 | - |
303
+ | 3.2706 | 6950 | 0.0036 | - |
304
+ | 3.2941 | 7000 | 0.0001 | - |
305
+ | 3.3176 | 7050 | 0.0197 | - |
306
+ | 3.3412 | 7100 | 0.0101 | - |
307
+ | 3.3647 | 7150 | 0.0 | - |
308
+ | 3.3882 | 7200 | 0.0 | - |
309
+ | 3.4118 | 7250 | 0.0003 | - |
310
+ | 3.4353 | 7300 | 0.0001 | - |
311
+ | 3.4588 | 7350 | 0.0 | - |
312
+ | 3.4824 | 7400 | 0.0001 | - |
313
+ | 3.5059 | 7450 | 0.0174 | - |
314
+ | 3.5294 | 7500 | 0.0 | - |
315
+ | 3.5529 | 7550 | 0.0 | - |
316
+ | 3.5765 | 7600 | 0.0 | - |
317
+ | 3.6 | 7650 | 0.0 | - |
318
+ | 3.6235 | 7700 | 0.0012 | - |
319
+ | 3.6471 | 7750 | 0.0 | - |
320
+ | 3.6706 | 7800 | 0.0 | - |
321
+ | 3.6941 | 7850 | 0.0 | - |
322
+ | 3.7176 | 7900 | 0.0 | - |
323
+ | 3.7412 | 7950 | 0.0 | - |
324
+ | 3.7647 | 8000 | 0.0 | - |
325
+ | 3.7882 | 8050 | 0.0 | - |
326
+ | 3.8118 | 8100 | 0.0 | - |
327
+ | 3.8353 | 8150 | 0.0004 | - |
328
+ | 3.8588 | 8200 | 0.0 | - |
329
+ | 3.8824 | 8250 | 0.0154 | - |
330
+ | 3.9059 | 8300 | 0.0201 | - |
331
+ | 3.9294 | 8350 | 0.0332 | - |
332
+ | 3.9529 | 8400 | 0.0 | - |
333
+ | 3.9765 | 8450 | 0.0002 | - |
334
+ | 4.0 | 8500 | 0.0028 | 0.1434 |
335
+ | 4.0235 | 8550 | 0.0001 | - |
336
+ | 4.0471 | 8600 | 0.0 | - |
337
+ | 4.0706 | 8650 | 0.0077 | - |
338
+ | 4.0941 | 8700 | 0.0435 | - |
339
+ | 4.1176 | 8750 | 0.0 | - |
340
+ | 4.1412 | 8800 | 0.0001 | - |
341
+ | 4.1647 | 8850 | 0.0 | - |
342
+ | 4.1882 | 8900 | 0.0024 | - |
343
+ | 4.2118 | 8950 | 0.0 | - |
344
+ | 4.2353 | 9000 | 0.0 | - |
345
+ | 4.2588 | 9050 | 0.0 | - |
346
+ | 4.2824 | 9100 | 0.0002 | - |
347
+ | 4.3059 | 9150 | 0.0 | - |
348
+ | 4.3294 | 9200 | 0.0263 | - |
349
+ | 4.3529 | 9250 | 0.0 | - |
350
+ | 4.3765 | 9300 | 0.0 | - |
351
+ | 4.4 | 9350 | 0.0416 | - |
352
+ | 4.4235 | 9400 | 0.0 | - |
353
+ | 4.4471 | 9450 | 0.0061 | - |
354
+ | 4.4706 | 9500 | 0.0121 | - |
355
+ | 4.4941 | 9550 | 0.0001 | - |
356
+ | 4.5176 | 9600 | 0.0187 | - |
357
+ | 4.5412 | 9650 | 0.0 | - |
358
+ | 4.5647 | 9700 | 0.0 | - |
359
+ | 4.5882 | 9750 | 0.0 | - |
360
+ | 4.6118 | 9800 | 0.0 | - |
361
+ | 4.6353 | 9850 | 0.0 | - |
362
+ | 4.6588 | 9900 | 0.0117 | - |
363
+ | 4.6824 | 9950 | 0.0367 | - |
364
+ | 4.7059 | 10000 | 0.006 | - |
365
+ | 4.7294 | 10050 | 0.0 | - |
366
+ | 4.7529 | 10100 | 0.0002 | - |
367
+ | 4.7765 | 10150 | 0.0003 | - |
368
+ | 4.8 | 10200 | 0.0 | - |
369
+ | 4.8235 | 10250 | 0.0 | - |
370
+ | 4.8471 | 10300 | 0.0085 | - |
371
+ | 4.8706 | 10350 | 0.0 | - |
372
+ | 4.8941 | 10400 | 0.0369 | - |
373
+ | 4.9176 | 10450 | 0.0091 | - |
374
+ | 4.9412 | 10500 | 0.0 | - |
375
+ | 4.9647 | 10550 | 0.0 | - |
376
+ | 4.9882 | 10600 | 0.0 | - |
377
+ | 5.0 | 10625 | - | 0.1711 |
378
+ | 5.0118 | 10650 | 0.0 | - |
379
+ | 5.0353 | 10700 | 0.0 | - |
380
+ | 5.0588 | 10750 | 0.0 | - |
381
+ | 5.0824 | 10800 | 0.0238 | - |
382
+ | 5.1059 | 10850 | 0.0 | - |
383
+ | 5.1294 | 10900 | 0.0075 | - |
384
+ | 5.1529 | 10950 | 0.0 | - |
385
+ | 5.1765 | 11000 | 0.0 | - |
386
+ | 5.2 | 11050 | 0.0179 | - |
387
+ | 5.2235 | 11100 | 0.0 | - |
388
+ | 5.2471 | 11150 | 0.0 | - |
389
+ | 5.2706 | 11200 | 0.0171 | - |
390
+ | 5.2941 | 11250 | 0.0002 | - |
391
+ | 5.3176 | 11300 | 0.0 | - |
392
+ | 5.3412 | 11350 | 0.0128 | - |
393
+ | 5.3647 | 11400 | 0.0 | - |
394
+ | 5.3882 | 11450 | 0.0029 | - |
395
+ | 5.4118 | 11500 | 0.0 | - |
396
+ | 5.4353 | 11550 | 0.0 | - |
397
+ | 5.4588 | 11600 | 0.0 | - |
398
+ | 5.4824 | 11650 | 0.0 | - |
399
+ | 5.5059 | 11700 | 0.0 | - |
400
+ | 5.5294 | 11750 | 0.0 | - |
401
+ | 5.5529 | 11800 | 0.0 | - |
402
+ | 5.5765 | 11850 | 0.0001 | - |
403
+ | 5.6 | 11900 | 0.0001 | - |
404
+ | 5.6235 | 11950 | 0.0001 | - |
405
+ | 5.6471 | 12000 | 0.0 | - |
406
+ | 5.6706 | 12050 | 0.0001 | - |
407
+ | 5.6941 | 12100 | 0.0 | - |
408
+ | 5.7176 | 12150 | 0.0 | - |
409
+ | 5.7412 | 12200 | 0.0 | - |
410
+ | 5.7647 | 12250 | 0.0 | - |
411
+ | 5.7882 | 12300 | 0.006 | - |
412
+ | 5.8118 | 12350 | 0.0001 | - |
413
+ | 5.8353 | 12400 | 0.0042 | - |
414
+ | 5.8588 | 12450 | 0.0001 | - |
415
+ | 5.8824 | 12500 | 0.0 | - |
416
+ | 5.9059 | 12550 | 0.017 | - |
417
+ | 5.9294 | 12600 | 0.0282 | - |
418
+ | 5.9529 | 12650 | 0.0 | - |
419
+ | 5.9765 | 12700 | 0.0046 | - |
420
+ | 6.0 | 12750 | 0.0 | 0.1451 |
421
+ | 6.0235 | 12800 | 0.0001 | - |
422
+ | 6.0471 | 12850 | 0.0002 | - |
423
+ | 6.0706 | 12900 | 0.0625 | - |
424
+ | 6.0941 | 12950 | 0.0633 | - |
425
+ | 6.1176 | 13000 | 0.0598 | - |
426
+ | 6.1412 | 13050 | 0.0001 | - |
427
+ | 6.1647 | 13100 | 0.0012 | - |
428
+ | 6.1882 | 13150 | 0.0004 | - |
429
+ | 6.2118 | 13200 | 0.0 | - |
430
+ | 6.2353 | 13250 | 0.0002 | - |
431
+ | 6.2588 | 13300 | 0.0 | - |
432
+ | 6.2824 | 13350 | 0.0608 | - |
433
+ | 6.3059 | 13400 | 0.0006 | - |
434
+ | 6.3294 | 13450 | 0.0 | - |
435
+ | 6.3529 | 13500 | 0.0587 | - |
436
+ | 6.3765 | 13550 | 0.0003 | - |
437
+ | 6.4 | 13600 | 0.0429 | - |
438
+ | 6.4235 | 13650 | 0.0 | - |
439
+ | 6.4471 | 13700 | 0.0 | - |
440
+ | 6.4706 | 13750 | 0.0001 | - |
441
+ | 6.4941 | 13800 | 0.0 | - |
442
+ | 6.5176 | 13850 | 0.0135 | - |
443
+ | 6.5412 | 13900 | 0.019 | - |
444
+ | 6.5647 | 13950 | 0.0028 | - |
445
+ | 6.5882 | 14000 | 0.0 | - |
446
+ | 6.6118 | 14050 | 0.0 | - |
447
+ | 6.6353 | 14100 | 0.0169 | - |
448
+ | 6.6588 | 14150 | 0.0167 | - |
449
+ | 6.6824 | 14200 | 0.0375 | - |
450
+ | 6.7059 | 14250 | 0.0 | - |
451
+ | 6.7294 | 14300 | 0.0044 | - |
452
+ | 6.7529 | 14350 | 0.0 | - |
453
+ | 6.7765 | 14400 | 0.0 | - |
454
+ | 6.8 | 14450 | 0.0025 | - |
455
+ | 6.8235 | 14500 | 0.0033 | - |
456
+ | 6.8471 | 14550 | 0.0145 | - |
457
+ | 6.8706 | 14600 | 0.0 | - |
458
+ | 6.8941 | 14650 | 0.0346 | - |
459
+ | 6.9176 | 14700 | 0.0117 | - |
460
+ | 6.9412 | 14750 | 0.0001 | - |
461
+ | 6.9647 | 14800 | 0.0 | - |
462
+ | 6.9882 | 14850 | 0.0 | - |
463
+ | 7.0 | 14875 | - | 0.1828 |
464
+ | 7.0118 | 14900 | 0.0 | - |
465
+ | 7.0353 | 14950 | 0.0 | - |
466
+ | 7.0588 | 15000 | 0.0031 | - |
467
+ | 7.0824 | 15050 | 0.0001 | - |
468
+ | 7.1059 | 15100 | 0.0055 | - |
469
+ | 7.1294 | 15150 | 0.0208 | - |
470
+ | 7.1529 | 15200 | 0.0 | - |
471
+ | 7.1765 | 15250 | 0.0 | - |
472
+ | 7.2 | 15300 | 0.0134 | - |
473
+ | 7.2235 | 15350 | 0.0 | - |
474
+ | 7.2471 | 15400 | 0.0222 | - |
475
+ | 7.2706 | 15450 | 0.0 | - |
476
+ | 7.2941 | 15500 | 0.0001 | - |
477
+ | 7.3176 | 15550 | 0.0 | - |
478
+ | 7.3412 | 15600 | 0.0111 | - |
479
+ | 7.3647 | 15650 | 0.0 | - |
480
+ | 7.3882 | 15700 | 0.0025 | - |
481
+ | 7.4118 | 15750 | 0.0 | - |
482
+ | 7.4353 | 15800 | 0.0 | - |
483
+ | 7.4588 | 15850 | 0.0 | - |
484
+ | 7.4824 | 15900 | 0.0 | - |
485
+ | 7.5059 | 15950 | 0.0 | - |
486
+ | 7.5294 | 16000 | 0.0 | - |
487
+ | 7.5529 | 16050 | 0.0 | - |
488
+ | 7.5765 | 16100 | 0.0 | - |
489
+ | 7.6 | 16150 | 0.0 | - |
490
+ | 7.6235 | 16200 | 0.0001 | - |
491
+ | 7.6471 | 16250 | 0.0203 | - |
492
+ | 7.6706 | 16300 | 0.0 | - |
493
+ | 7.6941 | 16350 | 0.0 | - |
494
+ | 7.7176 | 16400 | 0.0 | - |
495
+ | 7.7412 | 16450 | 0.0186 | - |
496
+ | 7.7647 | 16500 | 0.0 | - |
497
+ | 7.7882 | 16550 | 0.0 | - |
498
+ | 7.8118 | 16600 | 0.0049 | - |
499
+ | 7.8353 | 16650 | 0.0 | - |
500
+ | 7.8588 | 16700 | 0.0044 | - |
501
+ | 7.8824 | 16750 | 0.0266 | - |
502
+ | 7.9059 | 16800 | 0.015 | - |
503
+ | 7.9294 | 16850 | 0.0331 | - |
504
+ | 7.9529 | 16900 | 0.0 | - |
505
+ | 7.9765 | 16950 | 0.0 | - |
506
+ | 8.0 | 17000 | 0.0 | 0.1778 |
507
+ | 8.0235 | 17050 | 0.0 | - |
508
+ | 8.0471 | 17100 | 0.0 | - |
509
+ | 8.0706 | 17150 | 0.0082 | - |
510
+ | 8.0941 | 17200 | 0.0414 | - |
511
+ | 8.1176 | 17250 | 0.0 | - |
512
+ | 8.1412 | 17300 | 0.0 | - |
513
+ | 8.1647 | 17350 | 0.0025 | - |
514
+ | 8.1882 | 17400 | 0.0 | - |
515
+ | 8.2118 | 17450 | 0.0 | - |
516
+ | 8.2353 | 17500 | 0.0 | - |
517
+ | 8.2588 | 17550 | 0.0 | - |
518
+ | 8.2824 | 17600 | 0.0 | - |
519
+ | 8.3059 | 17650 | 0.0 | - |
520
+ | 8.3294 | 17700 | 0.0033 | - |
521
+ | 8.3529 | 17750 | 0.0 | - |
522
+ | 8.3765 | 17800 | 0.0033 | - |
523
+ | 8.4 | 17850 | 0.0371 | - |
524
+ | 8.4235 | 17900 | 0.0217 | - |
525
+ | 8.4471 | 17950 | 0.004 | - |
526
+ | 8.4706 | 18000 | 0.0 | - |
527
+ | 8.4941 | 18050 | 0.0 | - |
528
+ | 8.5176 | 18100 | 0.0179 | - |
529
+ | 8.5412 | 18150 | 0.0 | - |
530
+ | 8.5647 | 18200 | 0.0 | - |
531
+ | 8.5882 | 18250 | 0.0032 | - |
532
+ | 8.6118 | 18300 | 0.0 | - |
533
+ | 8.6353 | 18350 | 0.0026 | - |
534
+ | 8.6588 | 18400 | 0.0 | - |
535
+ | 8.6824 | 18450 | 0.0387 | - |
536
+ | 8.7059 | 18500 | 0.0 | - |
537
+ | 8.7294 | 18550 | 0.0 | - |
538
+ | 8.7529 | 18600 | 0.0204 | - |
539
+ | 8.7765 | 18650 | 0.0212 | - |
540
+ | 8.8 | 18700 | 0.0 | - |
541
+ | 8.8235 | 18750 | 0.0065 | - |
542
+ | 8.8471 | 18800 | 0.0114 | - |
543
+ | 8.8706 | 18850 | 0.0 | - |
544
+ | 8.8941 | 18900 | 0.0335 | - |
545
+ | 8.9176 | 18950 | 0.0147 | - |
546
+ | 8.9412 | 19000 | 0.0 | - |
547
+ | 8.9647 | 19050 | 0.0053 | - |
548
+ | 8.9882 | 19100 | 0.0 | - |
549
+ | 9.0 | 19125 | - | 0.1773 |
550
+ | 9.0118 | 19150 | 0.0181 | - |
551
+ | 9.0353 | 19200 | 0.0 | - |
552
+ | 9.0588 | 19250 | 0.0 | - |
553
+ | 9.0824 | 19300 | 0.0 | - |
554
+ | 9.1059 | 19350 | 0.0226 | - |
555
+ | 9.1294 | 19400 | 0.0 | - |
556
+ | 9.1529 | 19450 | 0.0 | - |
557
+ | 9.1765 | 19500 | 0.0 | - |
558
+ | 9.2 | 19550 | 0.013 | - |
559
+ | 9.2235 | 19600 | 0.0036 | - |
560
+ | 9.2471 | 19650 | 0.0 | - |
561
+ | 9.2706 | 19700 | 0.0 | - |
562
+ | 9.2941 | 19750 | 0.0 | - |
563
+ | 9.3176 | 19800 | 0.0 | - |
564
+ | 9.3412 | 19850 | 0.0537 | - |
565
+ | 9.3647 | 19900 | 0.0 | - |
566
+ | 9.3882 | 19950 | 0.0031 | - |
567
+ | 9.4118 | 20000 | 0.0 | - |
568
+ | 9.4353 | 20050 | 0.0 | - |
569
+ | 9.4588 | 20100 | 0.0 | - |
570
+ | 9.4824 | 20150 | 0.0 | - |
571
+ | 9.5059 | 20200 | 0.0 | - |
572
+ | 9.5294 | 20250 | 0.0 | - |
573
+ | 9.5529 | 20300 | 0.0033 | - |
574
+ | 9.5765 | 20350 | 0.0 | - |
575
+ | 9.6 | 20400 | 0.0 | - |
576
+ | 9.6235 | 20450 | 0.0 | - |
577
+ | 9.6471 | 20500 | 0.0 | - |
578
+ | 9.6706 | 20550 | 0.0035 | - |
579
+ | 9.6941 | 20600 | 0.0 | - |
580
+ | 9.7176 | 20650 | 0.0036 | - |
581
+ | 9.7412 | 20700 | 0.0035 | - |
582
+ | 9.7647 | 20750 | 0.0 | - |
583
+ | 9.7882 | 20800 | 0.0 | - |
584
+ | 9.8118 | 20850 | 0.0 | - |
585
+ | 9.8353 | 20900 | 0.0 | - |
586
+ | 9.8588 | 20950 | 0.0 | - |
587
+ | 9.8824 | 21000 | 0.0036 | - |
588
+ | 9.9059 | 21050 | 0.0127 | - |
589
+ | 9.9294 | 21100 | 0.0364 | - |
590
+ | 9.9529 | 21150 | 0.0 | - |
591
+ | 9.9765 | 21200 | 0.0 | - |
592
+ | 10.0 | 21250 | 0.0 | 0.1803 |
593
+
594
+ * The bold row denotes the saved checkpoint.
595
+ ### Framework Versions
596
+ - Python: 3.10.12
597
+ - SetFit: 1.0.3
598
+ - Sentence Transformers: 3.1.0
599
+ - Transformers: 4.39.0
600
+ - PyTorch: 2.4.0+cu121
601
+ - Datasets: 3.0.0
602
+ - Tokenizers: 0.15.2
603
+
604
+ ## Citation
605
+
606
+ ### BibTeX
607
+ ```bibtex
608
+ @article{https://doi.org/10.48550/arxiv.2209.11055,
609
+ doi = {10.48550/ARXIV.2209.11055},
610
+ url = {https://arxiv.org/abs/2209.11055},
611
+ author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
612
+ keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
613
+ title = {Efficient Few-Shot Learning Without Prompts},
614
+ publisher = {arXiv},
615
+ year = {2022},
616
+ copyright = {Creative Commons Attribution 4.0 International}
617
+ }
618
+ ```
619
+
620
+ <!--
621
+ ## Glossary
622
+
623
+ *Clearly define terms in order to be accessible across audiences.*
624
+ -->
625
+
626
+ <!--
627
+ ## Model Card Authors
628
+
629
+ *Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
630
+ -->
631
+
632
+ <!--
633
+ ## Model Card Contact
634
+
635
+ *Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
636
+ -->
config.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "checkpoints/step_2125",
3
+ "architectures": [
4
+ "MPNetModel"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.1,
7
+ "bos_token_id": 0,
8
+ "eos_token_id": 2,
9
+ "hidden_act": "gelu",
10
+ "hidden_dropout_prob": 0.1,
11
+ "hidden_size": 768,
12
+ "initializer_range": 0.02,
13
+ "intermediate_size": 3072,
14
+ "layer_norm_eps": 1e-05,
15
+ "max_position_embeddings": 514,
16
+ "model_type": "mpnet",
17
+ "num_attention_heads": 12,
18
+ "num_hidden_layers": 12,
19
+ "pad_token_id": 1,
20
+ "relative_attention_num_buckets": 32,
21
+ "torch_dtype": "float32",
22
+ "transformers_version": "4.39.0",
23
+ "vocab_size": 30527
24
+ }
config_sentence_transformers.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "__version__": {
3
+ "sentence_transformers": "3.1.0",
4
+ "transformers": "4.39.0",
5
+ "pytorch": "2.4.0+cu121"
6
+ },
7
+ "prompts": {},
8
+ "default_prompt_name": null,
9
+ "similarity_fn_name": null
10
+ }
config_setfit.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "labels": [
3
+ "loosen",
4
+ "tighten",
5
+ "neutral"
6
+ ],
7
+ "normalize_embeddings": false
8
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31e8a1e839f20ac5343bc0f52405eb18f6efa1db628a7f3f9adf6206fa8e105d
3
+ size 437967672
model_head.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e604e99a81c517ddcc35370d15265ab3ec445d491769ed5014ce70b53ee39aab
3
+ size 19359
modules.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {
3
+ "idx": 0,
4
+ "name": "0",
5
+ "path": "",
6
+ "type": "sentence_transformers.models.Transformer"
7
+ },
8
+ {
9
+ "idx": 1,
10
+ "name": "1",
11
+ "path": "1_Pooling",
12
+ "type": "sentence_transformers.models.Pooling"
13
+ }
14
+ ]
sentence_bert_config.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "max_seq_length": 512,
3
+ "do_lower_case": false
4
+ }
special_tokens_map.json ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<s>",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "cls_token": {
10
+ "content": "<s>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "eos_token": {
17
+ "content": "</s>",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "mask_token": {
24
+ "content": "<mask>",
25
+ "lstrip": true,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "pad_token": {
31
+ "content": "<pad>",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ },
37
+ "sep_token": {
38
+ "content": "</s>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false
43
+ },
44
+ "unk_token": {
45
+ "content": "[UNK]",
46
+ "lstrip": false,
47
+ "normalized": false,
48
+ "rstrip": false,
49
+ "single_word": false
50
+ }
51
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,66 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "<s>",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "1": {
12
+ "content": "<pad>",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "2": {
20
+ "content": "</s>",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "104": {
28
+ "content": "[UNK]",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "30526": {
36
+ "content": "<mask>",
37
+ "lstrip": true,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "bos_token": "<s>",
45
+ "clean_up_tokenization_spaces": true,
46
+ "cls_token": "<s>",
47
+ "do_basic_tokenize": true,
48
+ "do_lower_case": true,
49
+ "eos_token": "</s>",
50
+ "mask_token": "<mask>",
51
+ "max_length": 512,
52
+ "model_max_length": 512,
53
+ "never_split": null,
54
+ "pad_to_multiple_of": null,
55
+ "pad_token": "<pad>",
56
+ "pad_token_type_id": 0,
57
+ "padding_side": "right",
58
+ "sep_token": "</s>",
59
+ "stride": 0,
60
+ "strip_accents": null,
61
+ "tokenize_chinese_chars": true,
62
+ "tokenizer_class": "MPNetTokenizer",
63
+ "truncation_side": "right",
64
+ "truncation_strategy": "longest_first",
65
+ "unk_token": "[UNK]"
66
+ }
vocab.txt ADDED
The diff for this file is too large to render. See raw diff