DewiBrynJones commited on
Commit
edfd598
1 Parent(s): fbe0bcf

Model save

Browse files
Files changed (1) hide show
  1. README.md +21 -35
README.md CHANGED
@@ -1,4 +1,5 @@
1
  ---
 
2
  base_model: facebook/wav2vec2-large-xlsr-53
3
  tags:
4
  - generated_from_trainer
@@ -16,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [facebook/wav2vec2-large-xlsr-53](https://huggingface.co/facebook/wav2vec2-large-xlsr-53) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 1.6889
20
- - Wer: 0.9480
21
 
22
  ## Model description
23
 
@@ -38,48 +39,33 @@ More information needed
38
  The following hyperparameters were used during training:
39
  - learning_rate: 0.0003
40
  - train_batch_size: 16
41
- - eval_batch_size: 128
42
  - seed: 42
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
- - lr_scheduler_warmup_steps: 600
46
- - training_steps: 6000
47
  - mixed_precision_training: Native AMP
48
 
49
  ### Training results
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Wer |
52
  |:-------------:|:------:|:----:|:---------------:|:------:|
53
- | No log | 0.0672 | 200 | 3.0784 | 1.0 |
54
- | No log | 0.1344 | 400 | 2.9962 | 1.0 |
55
- | 4.6966 | 0.2016 | 600 | 3.0380 | 1.0 |
56
- | 4.6966 | 0.2688 | 800 | 2.9616 | 1.0 |
57
- | 3.0067 | 0.3360 | 1000 | 2.9147 | 1.0 |
58
- | 3.0067 | 0.4032 | 1200 | 2.9158 | 1.0 |
59
- | 3.0067 | 0.4704 | 1400 | 2.9126 | 1.0 |
60
- | 2.9095 | 0.5376 | 1600 | 2.8195 | 1.0 |
61
- | 2.9095 | 0.6048 | 1800 | 2.3190 | 0.9804 |
62
- | 2.3631 | 0.6720 | 2000 | 1.5925 | 0.9349 |
63
- | 2.3631 | 0.7392 | 2200 | 1.3529 | 0.8784 |
64
- | 2.3631 | 0.8065 | 2400 | 1.2185 | 0.8690 |
65
- | 1.3164 | 0.8737 | 2600 | 1.1746 | 0.8566 |
66
- | 1.3164 | 0.9409 | 2800 | 1.2047 | 0.8444 |
67
- | 1.2708 | 1.0081 | 3000 | 1.3975 | 0.8781 |
68
- | 1.2708 | 1.0753 | 3200 | 1.5273 | 0.9086 |
69
- | 1.2708 | 1.1425 | 3400 | 1.5937 | 0.9166 |
70
- | 1.5876 | 1.2097 | 3600 | 1.4998 | 0.9331 |
71
- | 1.5876 | 1.2769 | 3800 | 1.6366 | 0.9646 |
72
- | 1.6623 | 1.3441 | 4000 | 1.6667 | 0.9701 |
73
- | 1.6623 | 1.4113 | 4200 | 1.5727 | 0.9483 |
74
- | 1.6623 | 1.4785 | 4400 | 1.6119 | 0.9611 |
75
- | 1.6759 | 1.5457 | 4600 | 1.5941 | 0.9337 |
76
- | 1.6759 | 1.6129 | 4800 | 1.4534 | 0.9059 |
77
- | 1.5779 | 1.6801 | 5000 | 2.0221 | 0.9572 |
78
- | 1.5779 | 1.7473 | 5200 | 1.7697 | 0.9399 |
79
- | 1.5779 | 1.8145 | 5400 | 1.6657 | 0.9377 |
80
- | 1.775 | 1.8817 | 5600 | 1.7365 | 0.9714 |
81
- | 1.775 | 1.9489 | 5800 | 1.6953 | 0.9580 |
82
- | 1.7507 | 2.0161 | 6000 | 1.6889 | 0.9480 |
83
 
84
 
85
  ### Framework versions
 
1
  ---
2
+ license: apache-2.0
3
  base_model: facebook/wav2vec2-large-xlsr-53
4
  tags:
5
  - generated_from_trainer
 
17
 
18
  This model is a fine-tuned version of [facebook/wav2vec2-large-xlsr-53](https://huggingface.co/facebook/wav2vec2-large-xlsr-53) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.4942
21
+ - Wer: 0.3917
22
 
23
  ## Model description
24
 
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 0.0003
41
  - train_batch_size: 16
42
+ - eval_batch_size: 16
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
+ - lr_scheduler_warmup_steps: 300
47
+ - training_steps: 3000
48
  - mixed_precision_training: Native AMP
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Wer |
53
  |:-------------:|:------:|:----:|:---------------:|:------:|
54
+ | No log | 0.0672 | 200 | 2.9830 | 1.0 |
55
+ | No log | 0.1344 | 400 | 1.5613 | 0.9658 |
56
+ | 3.6118 | 0.2016 | 600 | 1.0701 | 0.7649 |
57
+ | 3.6118 | 0.2688 | 800 | 0.8868 | 0.6947 |
58
+ | 0.9333 | 0.3360 | 1000 | 0.7680 | 0.6071 |
59
+ | 0.9333 | 0.4032 | 1200 | 0.7224 | 0.5454 |
60
+ | 0.9333 | 0.4704 | 1400 | 0.6733 | 0.5122 |
61
+ | 0.7446 | 0.5376 | 1600 | 0.6437 | 0.4966 |
62
+ | 0.7446 | 0.6048 | 1800 | 0.6064 | 0.4774 |
63
+ | 0.6579 | 0.6720 | 2000 | 0.5674 | 0.4461 |
64
+ | 0.6579 | 0.7392 | 2200 | 0.5556 | 0.4325 |
65
+ | 0.6579 | 0.8065 | 2400 | 0.5264 | 0.4180 |
66
+ | 0.5823 | 0.8737 | 2600 | 0.5130 | 0.4022 |
67
+ | 0.5823 | 0.9409 | 2800 | 0.4982 | 0.3936 |
68
+ | 0.5426 | 1.0081 | 3000 | 0.4942 | 0.3917 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
69
 
70
 
71
  ### Framework versions