End of training

README.md

@@ -1,20 +1,20 @@
 ---
+library_name: transformers
+license: cc-by-nc-4.0
 base_model: facebook/mms-1b-all
+tags:
+- generated_from_trainer
 datasets:
 - common_voice_17_0
-library_name: transformers
-license: cc-by-nc-4.0
 metrics:
 - wer
 - bleu
-tags:
-- generated_from_trainer
 model-index:
 - name: wav2vec2-mms-1b-CV17.0-training_set_variations
   results:
   - task:
-      type: automatic-speech-recognition
       name: Automatic Speech Recognition
+      type: automatic-speech-recognition
     dataset:
       name: common_voice_17_0
       type: common_voice_17_0
@@ -22,12 +22,12 @@ model-index:
       split: validation
       args: ta
     metrics:
-    - type: wer
-      value: 1.0759957831049183
-      name: Wer
-    - type: bleu
-      value: 0.0
-      name: Bleu
+    - name: Wer
+      type: wer
+      value: 0.41655589677774213
+    - name: Bleu
+      type: bleu
+      value: 0.3602695476100989
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -37,10 +37,10 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [facebook/mms-1b-all](https://huggingface.co/facebook/mms-1b-all) on the common_voice_17_0 dataset.
 It achieves the following results on the evaluation set:
-- Loss: 6.3100
-- Wer: 1.0760
-- Cer: 0.7242
-- Bleu: 0.0
+- Loss: 0.3166
+- Wer: 0.4166
+- Cer: 0.0689
+- Bleu: 0.3603
 
 ## Model description
 
@@ -73,38 +73,21 @@ The following hyperparameters were used during training:
 
 ### Training results
 
-| Training Loss | Epoch  | Step | Validation Loss | Wer    | Cer    | Bleu |
-|:-------------:|:------:|:----:|:---------------:|:------:|:------:|:----:|
-| 13.5071       | 6.25   | 50   | 7.0048          | 1.0001 | 0.9823 | 0.0  |
-| 5.6893        | 12.5   | 100  | 5.2167          | 1.0000 | 0.9089 | 0.0  |
-| 4.3569        | 18.75  | 150  | 4.3516          | 1.0125 | 0.8661 | 0.0  |
-| 3.5211        | 25.0   | 200  | 3.5506          | 1.0269 | 0.8318 | 0.0  |
-| 3.2359        | 31.25  | 250  | 3.4822          | 1.0039 | 0.8458 | 0.0  |
-| 3.1004        | 37.5   | 300  | 3.5209          | 1.0086 | 0.8185 | 0.0  |
-| 2.9953        | 43.75  | 350  | 3.5498          | 1.0121 | 0.8104 | 0.0  |
-| 2.779         | 50.0   | 400  | 3.6218          | 1.0170 | 0.7777 | 0.0  |
-| 2.6019        | 56.25  | 450  | 4.0907          | 1.0134 | 0.7504 | 0.0  |
-| 2.4589        | 62.5   | 500  | 3.8633          | 1.0287 | 0.7476 | 0.0  |
-| 2.2318        | 68.75  | 550  | 3.7976          | 1.0367 | 0.7239 | 0.0  |
-| 2.0073        | 75.0   | 600  | 4.0050          | 1.0234 | 0.7288 | 0.0  |
-| 1.7416        | 81.25  | 650  | 4.2022          | 1.0126 | 0.7231 | 0.0  |
-| 1.5467        | 87.5   | 700  | 4.4087          | 1.0469 | 0.7197 | 0.0  |
-| 1.3716        | 93.75  | 750  | 4.5391          | 1.0471 | 0.7185 | 0.0  |
-| 1.2237        | 100.0  | 800  | 4.8405          | 1.0398 | 0.7152 | 0.0  |
-| 1.1216        | 106.25 | 850  | 5.0209          | 1.0421 | 0.7160 | 0.0  |
-| 1.0274        | 112.5  | 900  | 5.0349          | 1.0669 | 0.7160 | 0.0  |
-| 0.9325        | 118.75 | 950  | 5.2384          | 1.0500 | 0.7198 | 0.0  |
-| 0.8486        | 125.0  | 1000 | 5.3843          | 1.0614 | 0.7131 | 0.0  |
-| 0.7996        | 131.25 | 1050 | 5.4558          | 1.0622 | 0.7181 | 0.0  |
-| 0.7479        | 137.5  | 1100 | 5.6746          | 1.0622 | 0.7205 | 0.0  |
-| 0.6972        | 143.75 | 1150 | 5.7069          | 1.1182 | 0.7218 | 0.0  |
-| 0.6596        | 150.0  | 1200 | 5.7678          | 1.0883 | 0.7221 | 0.0  |
-| 0.6213        | 156.25 | 1250 | 5.9645          | 1.0700 | 0.7191 | 0.0  |
-| 0.5905        | 162.5  | 1300 | 6.0098          | 1.0970 | 0.7210 | 0.0  |
-| 0.5532        | 168.75 | 1350 | 6.0379          | 1.0981 | 0.7235 | 0.0  |
-| 0.5336        | 175.0  | 1400 | 6.2079          | 1.0564 | 0.7210 | 0.0  |
-| 0.4955        | 181.25 | 1450 | 6.1618          | 1.0717 | 0.7225 | 0.0  |
-| 0.4851        | 187.5  | 1500 | 6.3100          | 1.0760 | 0.7242 | 0.0  |
+| Training Loss | Epoch  | Step | Validation Loss | Wer    | Cer    | Bleu   |
+|:-------------:|:------:|:----:|:---------------:|:------:|:------:|:------:|
+| 11.8671       | 3.125  | 50   | 3.8104          | 1.0011 | 0.9249 | 0.0    |
+| 1.5965        | 6.25   | 100  | 0.2796          | 0.4122 | 0.0680 | 0.3517 |
+| 0.2054        | 9.375  | 150  | 0.2320          | 0.3751 | 0.0620 | 0.4040 |
+| 0.1702        | 12.5   | 200  | 0.2367          | 0.3794 | 0.0633 | 0.3939 |
+| 0.1495        | 15.625 | 250  | 0.2527          | 0.4168 | 0.0680 | 0.3457 |
+| 0.1457        | 18.75  | 300  | 0.2536          | 0.3973 | 0.0662 | 0.3723 |
+| 0.1264        | 21.875 | 350  | 0.2765          | 0.4175 | 0.0693 | 0.3546 |
+| 0.1092        | 25.0   | 400  | 0.2711          | 0.4032 | 0.0673 | 0.3701 |
+| 0.0952        | 28.125 | 450  | 0.2828          | 0.4139 | 0.0691 | 0.3605 |
+| 0.0919        | 31.25  | 500  | 0.2972          | 0.4283 | 0.0721 | 0.3355 |
+| 0.0909        | 34.375 | 550  | 0.2971          | 0.4155 | 0.0686 | 0.3567 |
+| 0.0744        | 37.5   | 600  | 0.3086          | 0.4241 | 0.0705 | 0.3461 |
+| 0.069         | 40.625 | 650  | 0.3166          | 0.4166 | 0.0689 | 0.3603 |
 
 
 ### Framework versions

adapter.tam-512.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9fcb806be0ed04a53e9b005ad90824ec5d39c100056249ba24a9500ac6c808ee
+oid sha256:e8b91017a55c52c43ec29ae13307e4c3255413359e2c747b16766df218df71b1
 size 8926640

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a11a2a319dacdff27ea21fbe067130f009f83c75abca726f10a87c04c65eea56
+oid sha256:c3de7047f5cd27e69989f1015c85bf04ed8a9d9178c373289159a510e3d14716
 size 3859019024