Hugging Face's logo

dendimaki
/
few-shots-apeiron-model-v2

Text Classification
setfit
Safetensors
sentence-transformers
mpnet
generated_from_setfit_trainer
Model card Files Community
dendimaki commited on
Commit
aa6cd77
•
1 Parent(s): 167d38c

Push model using huggingface_hub.

Browse files
Files changed (4) hide show
  1. README.md +4 -149
  2. config.json +1 -1
  3. config_setfit.json +31 -1
  4. tokenizer_config.json +7 -0
README.md CHANGED
@@ -6,38 +6,16 @@ tags:
6
  - text-classification
7
  - generated_from_setfit_trainer
8
  base_model: sentence-transformers/paraphrase-mpnet-base-v2
9
- datasets:
10
- - dendimaki/v1
11
  metrics:
12
  - accuracy
13
- widget:
14
- - text: so you know you said that layer three maybe sounded interesting
15
- - text: just this like sense of energy thats aliveness and aliveness tingly aliveness
16
- - text: id say is pretty or really the dominant state unless i really focus on location
17
- one and even then
18
- - text: pervading presence
19
- - text: nonduality for you
20
  pipeline_tag: text-classification
21
  inference: true
22
- model-index:
23
- - name: SetFit with sentence-transformers/paraphrase-mpnet-base-v2
24
- results:
25
- - task:
26
- type: text-classification
27
- name: Text Classification
28
- dataset:
29
- name: dendimaki/v1
30
- type: dendimaki/v1
31
- split: test
32
- metrics:
33
- - type: accuracy
34
- value: 0.23529411764705882
35
- name: Accuracy
36
  ---
37
 
38
  # SetFit with sentence-transformers/paraphrase-mpnet-base-v2
39
 
40
- This is a [SetFit](https://github.com/huggingface/setfit) model trained on the [dendimaki/v1](https://huggingface.co/datasets/dendimaki/v1) dataset that can be used for Text Classification. This SetFit model uses [sentence-transformers/paraphrase-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-mpnet-base-v2) as the Sentence Transformer embedding model. A [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance is used for classification.
41
 
42
  The model has been trained using an efficient few-shot learning technique that involves:
43
 
@@ -52,7 +30,7 @@ The model has been trained using an efficient few-shot learning technique that i
52
  - **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance
53
  - **Maximum Sequence Length:** 512 tokens
54
  - **Number of Classes:** 29 classes
55
- - **Training Dataset:** [dendimaki/v1](https://huggingface.co/datasets/dendimaki/v1)
56
  <!-- - **Language:** Unknown -->
57
  <!-- - **License:** Unknown -->
58
 
@@ -62,46 +40,6 @@ The model has been trained using an efficient few-shot learning technique that i
62
  - **Paper:** [Efficient Few-Shot Learning Without Prompts](https://arxiv.org/abs/2209.11055)
63
  - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
64
 
65
- ### Model Labels
66
- | Label | Examples |
67
- |:------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
68
- | 0 | <ul><li>'yeah i would think probably not too it can really feel like a return to layer one if youve become more established'</li><li>'that which is aware of the space and the presence and the stuckness like kind of all of them'</li><li>'most of the time curious and open rather than fearful'</li></ul> |
69
- | 1 | <ul><li>'and its very its not what i am you know like theres no continuity between me and that spaciousness you know i can feel some spaciousness maybe but man theres you know no continuity between me and that and that would be fine that would be a location one layer two type experience certainly fine'</li><li>'the dominant quality of layer 2 is the sense of allcontaining spaciousness emptiness expansiveness space nothingness openness and so on'</li><li>'location one of layer two'</li></ul> |
70
- | 2 | <ul><li>'and help us sort of get a general context of where youre at and so you know i think in some cases youre probably getting glimpses of layer three in location one'</li><li>'layer 3 feels like a profound fullness rather than feeling as though it contains everything like layer 2 this feels as though it pervades and infuses everything'</li><li>'at the early end of layer 3 it feels like an essence or presence infusing but different from experience this is typically initially perceived as beginning to infuse the spaciousness of layer 2'</li></ul> |
71
- | 3 | <ul><li>'expanded sense of self where my attention is most of the time feels more real than anything previous'</li><li>'in location 1 layer 4 every drop of rain is a melody a harmonious blend of natures song and the rhythms of existence'</li><li>'in location 1 layer 4 the setting sun doesnt signify an end but a gentle closure a pause for reflection and gratitude'</li></ul> |
72
- | 4 | <ul><li>'when subjective experience is centered in layer 1 the activity of the mind will predominate momenttomoment experience'</li><li>'finders often assume this is something to go beyond but it is just the nature of layer 1 and if subjective experience is centered there this quality of a more individualized or personal self naturally arises'</li><li>'ive still probably because of you know heavy conditioning with that ive prioritized you know as of the past couple of years so i have conditioned in addition to this you know a lot of fear based layer early layer one'</li></ul> |
73
- | 5 | <ul><li>'my goal is to to get to to be fluent between layer two or location two'</li><li>'location 2 somewhat paradoxically the quality of self in layer 2 and later is impersonal'</li><li>'shifting into layer two'</li></ul> |
74
- | 6 | <ul><li>'and a sense of separation possibly creeps in you know in the middle of the city its hard to say its not as intense i still do feel connected but not to the intensity as when im with the trees'</li><li>'location two layer three'</li><li>'rather than just having a really deep experience of layer three in location two where theres still nondual experience for divine'</li></ul> |
75
- | 7 | <ul><li>'when it is accessed it is usually mixed with other layers typically the deepest portion of layer 3 because one is generally unable to fully deepen into it in earlier locations it tends to be experienced as a mystery or unknowable'</li><li>'that you had mentioned that location two layer four is like not that likely to happen um and this this sense of like just what is or just you know everything is just the way it is or whatever um that doesnt seem to go in and out um but you know theres theres no perceptual difference to it its just you know its just like not an understanding but its just like it feels like once thats there why would you think otherwise you know'</li><li>'deeper forms of layer 4 are typically only experienced temporarily in location 2 and often do not allow someone to be functional while they last when it is only touched upon temporarily it does not necessarily feel as though it is not a state because the sense of individual self remains partially intact in earlier locations'</li></ul> |
76
- | 8 | <ul><li>' it will often be experienced from perception being centered in deeper layers'</li><li>'layer one in lay one is existential focusing on meaning and purpose with thought streams and highs and lows in energetic variation'</li><li>'layer 1 is not the default layer that people transition to or experience in location 3 however it can remainquite accessible'</li></ul> |
77
- | 9 | <ul><li>'the quality of spaciousness emptiness expansiveness openness and so on feels as though it pervades everything as the presence of divinity or as the panpsychist presence depending on how location 3 is showing up for that person'</li><li>'sympathy'</li><li>'so if it were like for instance location three layer two you know it would be a spacious emptiness mixed with the divine or the panpsychist presence or whatever which is kind of a distance from god you know kind of a separation in a way'</li></ul> |
78
- | 10 | <ul><li>'the main thing was a sense of a kind of strong gravitational pull'</li><li>'you can just play with it for a bit and see like add it as something you can use for deconditioning and then spend the next session really deepening into the location three type direction of layer three and see if you can make that switch'</li><li>'the fieldlike presence of layer 3 feels powerful and penetrating and being deep in layer 3 can seem to have a noticeable influence on other people'</li></ul> |
79
- | 11 | <ul><li>'this is partly because one is unable to deepen into it and stabilize in it and partly because it cannot be known objectivelyor even subjectively in the usual sense'</li><li>'when it is accessed it is usually mixed with other layers most typically the deepest portions of layer 3 because one is generally unable to fully deepen into it it tends to be experienced as a mystery or unknowable'</li><li>'like initially you cant see anything its just an unknowable'</li></ul> |
80
- | 12 | <ul><li>'someone is just watching the process unfold without feeling as though they are doing any of it'</li><li>'the extensive compassion and ethical training in some spiritual systems may be designed less for seekers and more to condition finders systems to express these more positive qualities once they are subjectively no longer able to act volitionally'</li><li>'gravity of silence tends to preclude thinking'</li></ul> |
81
- | 13 | <ul><li>'no mans land'</li><li>'layer 2 is not readily accessible in later locations which tend to gravitate strongly to layer 4'</li><li>'dont feel it'</li></ul> |
82
- | 14 | <ul><li>'people suppress their peace a little'</li><li>'highly functioning'</li><li>'layer 3 can remain accessible in location 4 though usually only the deepest centerless aspects of it'</li></ul> |
83
- | 15 | <ul><li>'this diminishes the dimensionality of perception which becomes progressively flat in later locations although someone is not likely to notice unless they come back to an earlier location'</li><li>'there is an ever greater depth of stillnesssilence and an incomparable quality of freedom and peace which is the classical freedom from suffering pursued by spiritual traditions for millennia'</li><li>'nothing appears to have independent or essential existence and there is only undifferentiated realityv'</li></ul> |
84
- | 16 | <ul><li>'sensory glitches'</li><li>'remained unconscious or who had serious difficulties with the function of their bodies for periods of days weeks and even longer after moving into one of these locations'</li><li>'you know theyre still luminous objects'</li></ul> |
85
- | 17 | <ul><li>'seer'</li><li>'one of the things most finders notice first is a reduction in their interest in nearly all stories'</li><li>'location one is sort of ideal you know for your life right now'</li></ul> |
86
- | 18 | <ul><li>'i think its definitely more no emotion than any specific type of emotion but sometimes emotions arise like anger anxiety and sometimes affection'</li><li>'it doesnt sound like you have a very clear memory of that experience of union or dissolving into the divine so it might still have been location two'</li><li>'and so now we would say about location two is and we probably would have been more nuanced even back then'</li></ul> |
87
- | 19 | <ul><li>'and so in location three there is and youre going between the two most subtle possible places you know potentially location wise'</li><li>'panpsychist sense'</li><li>'usually but not totally'</li></ul> |
88
- | 20 | <ul><li>'no sense of a personal self'</li><li>'and then you reference location four for like days off like walks in the forest parks'</li><li>'disassembled'</li></ul> |
89
- | 21 | <ul><li>'psychedelics'</li><li>'myersbriggs cognitive functions'</li><li>'glitch'</li></ul> |
90
- | 22 | <ul><li>'fundamental well being feels like resisting'</li><li>'how long have you been in fundamental wellbeing'</li><li>'many different potential trajectories within fundamental wellbeing'</li></ul> |
91
- | 23 | <ul><li>'seekers'</li><li>'deep and profound presentmoment experience'</li><li>'but really turning your attention to whatever deeper qualities of fundamental wellbeing are accessible to you and sinking into those as deeply as you can'</li></ul> |
92
- | 24 | <ul><li>'was able to settle back into fundamental wellbeing after it got shaken up'</li><li>'so even in fundamental well being its so funny'</li><li>'you know obviously if youve been in fundamental wellbeing since i think youre you might have said 2017 or somewhere around there'</li></ul> |
93
- | 25 | <ul><li>'when something is very beautiful there is still this sense of im noticing its very beautiful'</li><li>'so you said that you werent sure whether at times your you were viewing layer one'</li><li>'layer one is going to be very present and subjective experience and you know the quality'</li></ul> |
94
- | 26 | <ul><li>'emptiness of vastness'</li><li>'i was very spacious'</li><li>'in one spot i am spaciousness'</li></ul> |
95
- | 27 | <ul><li>'so did it have a sense of senselessness'</li><li>'theres a significant amount of richness in the human experience'</li><li>'im more on the layer three since the feeling is really really sunny right now'</li></ul> |
96
- | 28 | <ul><li>'dimensional flatness'</li><li>'the disappearance of the presence and all of that'</li><li>'i think its further and i also think there are way more layers than four'</li></ul> |
97
-
98
- ## Evaluation
99
-
100
- ### Metrics
101
- | Label | Accuracy |
102
- |:--------|:---------|
103
- | **all** | 0.2353 |
104
-
105
  ## Uses
106
 
107
  ### Direct Use for Inference
@@ -120,7 +58,7 @@ from setfit import SetFitModel
120
  # Download from the 🤗 Hub
121
  model = SetFitModel.from_pretrained("dendimaki/few-shots-apeiron-model-v2")
122
  # Run inference
123
- preds = model("pervading presence")
124
  ```
125
 
126
  <!--
@@ -149,89 +87,6 @@ preds = model("pervading presence")
149
 
150
  ## Training Details
151
 
152
- ### Training Set Metrics
153
- | Training set | Min | Median | Max |
154
- |:-------------|:----|:--------|:----|
155
- | Word count | 1 | 21.1422 | 146 |
156
-
157
- | Label | Training Sample Count |
158
- |:------|:----------------------|
159
- | 0 | 8 |
160
- | 1 | 8 |
161
- | 2 | 8 |
162
- | 3 | 8 |
163
- | 4 | 8 |
164
- | 5 | 8 |
165
- | 6 | 8 |
166
- | 7 | 8 |
167
- | 8 | 8 |
168
- | 9 | 8 |
169
- | 10 | 8 |
170
- | 11 | 8 |
171
- | 12 | 8 |
172
- | 13 | 8 |
173
- | 14 | 8 |
174
- | 15 | 8 |
175
- | 16 | 8 |
176
- | 17 | 8 |
177
- | 18 | 8 |
178
- | 19 | 8 |
179
- | 20 | 8 |
180
- | 21 | 8 |
181
- | 22 | 8 |
182
- | 23 | 8 |
183
- | 24 | 8 |
184
- | 25 | 8 |
185
- | 26 | 8 |
186
- | 27 | 8 |
187
- | 28 | 8 |
188
-
189
- ### Training Hyperparameters
190
- - batch_size: (16, 16)
191
- - num_epochs: (2, 2)
192
- - max_steps: -1
193
- - sampling_strategy: oversampling
194
- - num_iterations: 20
195
- - body_learning_rate: (2e-05, 2e-05)
196
- - head_learning_rate: 2e-05
197
- - loss: CosineSimilarityLoss
198
- - distance_metric: cosine_distance
199
- - margin: 0.25
200
- - end_to_end: False
201
- - use_amp: False
202
- - warmup_proportion: 0.1
203
- - seed: 42
204
- - eval_max_steps: -1
205
- - load_best_model_at_end: False
206
-
207
- ### Training Results
208
- | Epoch | Step | Training Loss | Validation Loss |
209
- |:------:|:----:|:-------------:|:---------------:|
210
- | 0.0017 | 1 | 0.2303 | - |
211
- | 0.0862 | 50 | 0.2167 | - |
212
- | 0.1724 | 100 | 0.1755 | - |
213
- | 0.2586 | 150 | 0.1366 | - |
214
- | 0.3448 | 200 | 0.2175 | - |
215
- | 0.4310 | 250 | 0.0876 | - |
216
- | 0.5172 | 300 | 0.1048 | - |
217
- | 0.6034 | 350 | 0.101 | - |
218
- | 0.6897 | 400 | 0.0339 | - |
219
- | 0.7759 | 450 | 0.0466 | - |
220
- | 0.8621 | 500 | 0.0966 | - |
221
- | 0.9483 | 550 | 0.0525 | - |
222
- | 1.0345 | 600 | 0.0266 | - |
223
- | 1.1207 | 650 | 0.0136 | - |
224
- | 1.2069 | 700 | 0.0132 | - |
225
- | 1.2931 | 750 | 0.0625 | - |
226
- | 1.3793 | 800 | 0.0084 | - |
227
- | 1.4655 | 850 | 0.0069 | - |
228
- | 1.5517 | 900 | 0.0163 | - |
229
- | 1.6379 | 950 | 0.0314 | - |
230
- | 1.7241 | 1000 | 0.0208 | - |
231
- | 1.8103 | 1050 | 0.0076 | - |
232
- | 1.8966 | 1100 | 0.0231 | - |
233
- | 1.9828 | 1150 | 0.0791 | - |
234
-
235
  ### Framework Versions
236
  - Python: 3.10.12
237
  - SetFit: 1.0.3
 
6
  - text-classification
7
  - generated_from_setfit_trainer
8
  base_model: sentence-transformers/paraphrase-mpnet-base-v2
 
 
9
  metrics:
10
  - accuracy
11
+ widget: []
 
 
 
 
 
 
12
  pipeline_tag: text-classification
13
  inference: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
  ---
15
 
16
  # SetFit with sentence-transformers/paraphrase-mpnet-base-v2
17
 
18
+ This is a [SetFit](https://github.com/huggingface/setfit) model that can be used for Text Classification. This SetFit model uses [sentence-transformers/paraphrase-mpnet-base-v2](https://huggingface.co/sentence-transformers/paraphrase-mpnet-base-v2) as the Sentence Transformer embedding model. A [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance is used for classification.
19
 
20
  The model has been trained using an efficient few-shot learning technique that involves:
21
 
 
30
  - **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance
31
  - **Maximum Sequence Length:** 512 tokens
32
  - **Number of Classes:** 29 classes
33
+ <!-- - **Training Dataset:** [Unknown](https://huggingface.co/datasets/unknown) -->
34
  <!-- - **Language:** Unknown -->
35
  <!-- - **License:** Unknown -->
36
 
 
40
  - **Paper:** [Efficient Few-Shot Learning Without Prompts](https://arxiv.org/abs/2209.11055)
41
  - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
42
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
43
  ## Uses
44
 
45
  ### Direct Use for Inference
 
58
  # Download from the 🤗 Hub
59
  model = SetFitModel.from_pretrained("dendimaki/few-shots-apeiron-model-v2")
60
  # Run inference
61
+ preds = model("I loved the spiderman movie!")
62
  ```
63
 
64
  <!--
 
87
 
88
  ## Training Details
89
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
90
  ### Framework Versions
91
  - Python: 3.10.12
92
  - SetFit: 1.0.3
config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "_name_or_path": "sentence-transformers/paraphrase-mpnet-base-v2",
3
  "architectures": [
4
  "MPNetModel"
5
  ],
 
1
  {
2
+ "_name_or_path": "dendimaki/few-shots-apeiron-model-v2",
3
  "architectures": [
4
  "MPNetModel"
5
  ],
config_setfit.json CHANGED
@@ -1,4 +1,34 @@
1
  {
2
  "normalize_embeddings": false,
3
- "labels": null
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
  }
 
1
  {
2
  "normalize_embeddings": false,
3
+ "labels": [
4
+ "loc1lay1",
5
+ "loc1lay2",
6
+ "loc1lay3",
7
+ "loc1lay4",
8
+ "loc2lay1",
9
+ "loc2lay2",
10
+ "loc2lay3",
11
+ "loc2lay4",
12
+ "loc3lay1",
13
+ "loc3lay2",
14
+ "loc3lay3",
15
+ "loc3lay4",
16
+ "loc4lay1",
17
+ "loc4lay2",
18
+ "loc4lay3",
19
+ "loc4lay4",
20
+ "loc5+",
21
+ "loc1",
22
+ "loc2",
23
+ "loc3",
24
+ "loc4",
25
+ "nfw",
26
+ "tfw",
27
+ "tfwc",
28
+ "tfwp",
29
+ "lay1",
30
+ "lay2",
31
+ "lay3",
32
+ "lay4"
33
+ ]
34
  }
tokenizer_config.json CHANGED
@@ -48,12 +48,19 @@
48
  "do_lower_case": true,
49
  "eos_token": "</s>",
50
  "mask_token": "<mask>",
 
51
  "model_max_length": 512,
52
  "never_split": null,
 
53
  "pad_token": "<pad>",
 
 
54
  "sep_token": "</s>",
 
55
  "strip_accents": null,
56
  "tokenize_chinese_chars": true,
57
  "tokenizer_class": "MPNetTokenizer",
 
 
58
  "unk_token": "[UNK]"
59
  }
 
48
  "do_lower_case": true,
49
  "eos_token": "</s>",
50
  "mask_token": "<mask>",
51
+ "max_length": 512,
52
  "model_max_length": 512,
53
  "never_split": null,
54
+ "pad_to_multiple_of": null,
55
  "pad_token": "<pad>",
56
+ "pad_token_type_id": 0,
57
+ "padding_side": "right",
58
  "sep_token": "</s>",
59
+ "stride": 0,
60
  "strip_accents": null,
61
  "tokenize_chinese_chars": true,
62
  "tokenizer_class": "MPNetTokenizer",
63
+ "truncation_side": "right",
64
+ "truncation_strategy": "longest_first",
65
  "unk_token": "[UNK]"
66
  }