hughlan1214
commited on
Commit
•
63cc20d
1
Parent(s):
41321e3
Update README.md
Browse files
README.md
CHANGED
@@ -1,6 +1,6 @@
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
-
base_model: hughlan1214/SER_wav2vec2-large-xlsr-
|
4 |
tags:
|
5 |
- generated_from_trainer
|
6 |
metrics:
|
@@ -18,7 +18,10 @@ should probably proofread and complete it, then remove this comment. -->
|
|
18 |
|
19 |
# SER_wav2vec2-large-xlsr-53_240304_fin-tuned
|
20 |
|
21 |
-
This model is a fine-tuned version of [hughlan1214/SER_wav2vec2-large-xlsr-
|
|
|
|
|
|
|
22 |
It achieves the following results on the evaluation set:
|
23 |
- Loss: 1.1815
|
24 |
- Accuracy: 0.5776
|
@@ -26,9 +29,18 @@ It achieves the following results on the evaluation set:
|
|
26 |
- Recall: 0.5921
|
27 |
- F1: 0.5806
|
28 |
|
|
|
|
|
29 |
## Model description
|
30 |
|
31 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
32 |
|
33 |
## Intended uses & limitations
|
34 |
|
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
+
base_model: hughlan1214/SER_wav2vec2-large-xlsr-53_fine-tuned_1.0
|
4 |
tags:
|
5 |
- generated_from_trainer
|
6 |
metrics:
|
|
|
18 |
|
19 |
# SER_wav2vec2-large-xlsr-53_240304_fin-tuned
|
20 |
|
21 |
+
This model is a fine-tuned version of [hughlan1214/SER_wav2vec2-large-xlsr-53_fine-tuned_1.0](https://huggingface.co/hughlan1214/SER_wav2vec2-large-xlsr-53_fine-tuned_1.0) on a [Speech Emotion Recognition (en)](https://www.kaggle.com/datasets/dmitrybabko/speech-emotion-recognition-en) dataset.
|
22 |
+
|
23 |
+
This dataset includes the 4 most popular datasets in English: Crema, Ravdess, Savee, and Tess, containing a total of over 12,000 .wav audio files. Each of these four datasets includes 6 to 8 different emotional labels.
|
24 |
+
|
25 |
It achieves the following results on the evaluation set:
|
26 |
- Loss: 1.1815
|
27 |
- Accuracy: 0.5776
|
|
|
29 |
- Recall: 0.5921
|
30 |
- F1: 0.5806
|
31 |
|
32 |
+
For a better performance version, please refer to [hughlan1214/Speech_Emotion_Recognition_wav2vec2-large-xlsr-53_240304_SER_fin-tuned2.0](https://huggingface.co/hughlan1214/Speech_Emotion_Recognition_wav2vec2-large-xlsr-53_240304_SER_fin-tuned2.0)
|
33 |
+
|
34 |
## Model description
|
35 |
|
36 |
+
For a better performance version, please refer to [hughlan1214/Speech_Emotion_Recognition_wav2vec2-large-xlsr-53_240304_SER_fin-tuned2.0](https://huggingface.co/hughlan1214/Speech_Emotion_Recognition_wav2vec2-large-xlsr-53_240304_SER_fin-tuned2.0)
|
37 |
+
|
38 |
+
|
39 |
+
The model was obtained through feature extraction using [facebook/wav2vec2-large-xlsr-53](https://huggingface.co/facebook/wav2vec2-large-xlsr-53) and underwent several rounds of fine-tuning. It predicts the 7 types of emotions contained in speech, aiming to lay the foundation for subsequent use of human micro-expressions on the visual level and context semantics under LLMS to infer user emotions in real-time.
|
40 |
+
|
41 |
+
Although the model was trained on purely English datasets, post-release testing showed that it also performs well in predicting emotions in Chinese and French, demonstrating the powerful cross-linguistic capability of the [facebook/wav2vec2-large-xlsr-53](https://huggingface.co/facebook/wav2vec2-large-xlsr-53) pre-trained model.
|
42 |
+
|
43 |
+
emotions = ['angry', 'disgust', 'fear', 'happy', 'neutral', 'sad', 'surprise']
|
44 |
|
45 |
## Intended uses & limitations
|
46 |
|