Update README.md
Browse files
README.md
CHANGED
@@ -25,6 +25,7 @@ model-index:
|
|
25 |
# Text Classification GoEmotions
|
26 |
|
27 |
This model is a fined-tuned version of [nreimers/MiniLMv2-L6-H384-distilled-from-RoBERTa-Large](https://huggingface.co/nreimers/MiniLMv2-L6-H384-distilled-from-RoBERTa-Large) on the on the [go_emotions](https://huggingface.co/datasets/go_emotions) dataset using [tasinho/text-classification-goemotions](https://huggingface.co/tasinhoque/text-classification-goemotions) as teacher model.
|
|
|
28 |
|
29 |
# Load the Model
|
30 |
|
@@ -44,7 +45,6 @@ The following hyperparameters were used during training:
|
|
44 |
- seed: 42
|
45 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
46 |
- lr_scheduler_type: linear
|
47 |
-
- num_epochs: 40
|
48 |
|
49 |
|
50 |
# Metrics (comparison with teacher model)
|
@@ -54,7 +54,7 @@ The following hyperparameters were used during training:
|
|
54 |
| tasinhoque/text-classification-goemotions (355M) | MiniLMv2-L6-H384-goemotions-v2 | Validation | 0.514252 |0.484898 |
|
55 |
| tasinhoque/text-classification-goemotions (33M) | MiniLMv2-L6-H384-goemotions-v2 | Test | 0.501937 | 0.486890 |
|
56 |
|
57 |
-
#
|
58 |
|
59 |
-
Check
|
60 |
|
|
|
25 |
# Text Classification GoEmotions
|
26 |
|
27 |
This model is a fined-tuned version of [nreimers/MiniLMv2-L6-H384-distilled-from-RoBERTa-Large](https://huggingface.co/nreimers/MiniLMv2-L6-H384-distilled-from-RoBERTa-Large) on the on the [go_emotions](https://huggingface.co/datasets/go_emotions) dataset using [tasinho/text-classification-goemotions](https://huggingface.co/tasinhoque/text-classification-goemotions) as teacher model.
|
28 |
+
The quantized version in ONNX format can be found [here](https://huggingface.co/minuva/MiniLMv2-goemotions-v2-onnx)
|
29 |
|
30 |
# Load the Model
|
31 |
|
|
|
45 |
- seed: 42
|
46 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
47 |
- lr_scheduler_type: linear
|
|
|
48 |
|
49 |
|
50 |
# Metrics (comparison with teacher model)
|
|
|
54 |
| tasinhoque/text-classification-goemotions (355M) | MiniLMv2-L6-H384-goemotions-v2 | Validation | 0.514252 |0.484898 |
|
55 |
| tasinhoque/text-classification-goemotions (33M) | MiniLMv2-L6-H384-goemotions-v2 | Test | 0.501937 | 0.486890 |
|
56 |
|
57 |
+
# Deployment
|
58 |
|
59 |
+
Check [our repository](https://github.com/minuva/emotion-prediction-serverless) to see how to easily deploy this (quantized) model in a serverless environment with fast CPU inference and light resource utilization.
|
60 |
|