hippopotam's picture
update model card README.md
5be9300
|
raw
history blame
17.7 kB
metadata
license: apache-2.0
tags:
  - generated_from_trainer
datasets:
  - common_voice_13_0
metrics:
  - wer
model-index:
  - name: wav2vec2-common_voice13
    results:
      - task:
          name: Automatic Speech Recognition
          type: automatic-speech-recognition
        dataset:
          name: common_voice_13_0
          type: common_voice_13_0
          config: tr
          split: test
          args: tr
        metrics:
          - name: Wer
            type: wer
            value: 0.2934764687562973

wav2vec2-common_voice13

This model is a fine-tuned version of facebook/wav2vec2-large-xlsr-53 on the common_voice_13_0 dataset. It achieves the following results on the evaluation set:

  • Loss: 0.3366
  • Wer: 0.2935

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 0.0003
  • train_batch_size: 32
  • eval_batch_size: 16
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • lr_scheduler_warmup_steps: 500
  • num_epochs: 20.0
  • mixed_precision_training: Native AMP

Training results

Training Loss Epoch Step Validation Loss Wer
4.0301 0.08 100 4.0286 1.0
3.1668 0.15 200 3.2323 1.0
2.3413 0.23 300 2.1300 0.9986
1.4546 0.31 400 0.8731 0.7629
1.4595 0.38 500 0.7366 0.7386
1.1903 0.46 600 0.6131 0.6645
1.1586 0.53 700 0.5491 0.6195
0.8275 0.61 800 0.5159 0.5923
1.0042 0.69 900 0.5153 0.6040
0.9428 0.76 1000 0.4629 0.5602
0.7592 0.84 1100 0.4670 0.5520
0.8284 0.92 1200 0.4455 0.5760
0.7736 0.99 1300 0.4571 0.5480
0.4047 1.07 1400 0.3962 0.4940
0.3543 1.14 1500 0.4018 0.4969
0.3898 1.22 1600 0.3901 0.4862
0.3827 1.3 1700 0.3982 0.4954
0.3316 1.37 1800 0.4139 0.5032
0.3365 1.45 1900 0.3964 0.4878
0.251 1.53 2000 0.4028 0.4899
0.2419 1.6 2100 0.3991 0.5190
0.3094 1.68 2200 0.3700 0.4865
0.3459 1.75 2300 0.3652 0.4850
0.3085 1.83 2400 0.3806 0.4742
0.4463 1.91 2500 0.3804 0.4729
0.2359 1.98 2600 0.3696 0.4635
0.1502 2.06 2700 0.3764 0.4602
0.2819 2.14 2800 0.3740 0.4499
0.22 2.21 2900 0.3811 0.4597
0.287 2.29 3000 0.3562 0.4334
0.2531 2.36 3100 0.3700 0.4442
0.3143 2.44 3200 0.3548 0.4333
0.203 2.52 3300 0.3659 0.4558
0.2609 2.59 3400 0.3557 0.4468
0.191 2.67 3500 0.3476 0.4281
0.1354 2.75 3600 0.3650 0.4354
0.2345 2.82 3700 0.3479 0.4385
0.1951 2.9 3800 0.3508 0.4489
0.2991 2.97 3900 0.3585 0.4356
0.1579 3.05 4000 0.3603 0.4326
0.2319 3.13 4100 0.3442 0.4201
0.1941 3.2 4200 0.3344 0.4116
0.2561 3.28 4300 0.3475 0.4200
0.3208 3.36 4400 0.3505 0.4089
0.2555 3.43 4500 0.3593 0.4271
0.1927 3.51 4600 0.3536 0.4299
0.1994 3.59 4700 0.3672 0.4400
0.1357 3.66 4800 0.3433 0.4223
0.2043 3.74 4900 0.3471 0.4226
0.194 3.81 5000 0.3380 0.4230
0.1779 3.89 5100 0.3400 0.4130
0.1934 3.97 5200 0.3438 0.4104
0.1432 4.04 5300 0.3632 0.4254
0.1642 4.12 5400 0.3425 0.4237
0.2208 4.2 5500 0.3580 0.4132
0.1923 4.27 5600 0.3469 0.4143
0.2084 4.35 5700 0.3619 0.4252
0.2484 4.42 5800 0.3452 0.4210
0.1899 4.5 5900 0.3465 0.4136
0.1253 4.58 6000 0.3625 0.4150
0.1353 4.65 6100 0.3415 0.4182
0.2264 4.73 6200 0.3446 0.4153
0.2016 4.81 6300 0.3343 0.4087
0.1634 4.88 6400 0.3500 0.4253
0.2517 4.96 6500 0.3453 0.4291
0.1826 5.03 6600 0.3442 0.4106
0.174 5.11 6700 0.3478 0.3999
0.271 5.19 6800 0.3423 0.4023
0.1812 5.26 6900 0.3679 0.4200
0.3 5.34 7000 0.3583 0.4191
0.2678 5.42 7100 0.3534 0.4141
0.236 5.49 7200 0.3361 0.4041
0.1558 5.57 7300 0.3495 0.4126
0.2603 5.64 7400 0.3359 0.3969
0.1285 5.72 7500 0.3296 0.3994
0.4608 5.8 7600 0.3453 0.3933
0.1516 5.87 7700 0.3509 0.4028
0.2655 5.95 7800 0.3607 0.4109
0.22 6.03 7900 0.3392 0.3850
0.0787 6.1 8000 0.3395 0.3842
0.1297 6.18 8100 0.3356 0.3822
0.1747 6.25 8200 0.3275 0.3874
0.1647 6.33 8300 0.3554 0.3941
0.1314 6.41 8400 0.3287 0.3826
0.1264 6.48 8500 0.3122 0.3876
0.1229 6.56 8600 0.3525 0.3994
0.108 6.64 8700 0.3387 0.3968
0.185 6.71 8800 0.3333 0.3840
0.0924 6.79 8900 0.3366 0.3827
0.1226 6.86 9000 0.3243 0.3788
0.2005 6.94 9100 0.3324 0.3765
0.133 7.02 9200 0.3294 0.3688
0.0633 7.09 9300 0.3279 0.3738
0.0593 7.17 9400 0.3311 0.3639
0.088 7.25 9500 0.3221 0.3765
0.1489 7.32 9600 0.3421 0.3788
0.1175 7.4 9700 0.3191 0.3786
0.0983 7.48 9800 0.3303 0.3764
0.1493 7.55 9900 0.3371 0.3836
0.1091 7.63 10000 0.3410 0.3739
0.1058 7.7 10100 0.3262 0.3730
0.0849 7.78 10200 0.3379 0.3812
0.1362 7.86 10300 0.3291 0.3781
0.1227 7.93 10400 0.3235 0.3760
0.1647 8.01 10500 0.3285 0.3686
0.1013 8.09 10600 0.3319 0.3729
0.1432 8.16 10700 0.3280 0.3731
0.1345 8.24 10800 0.3237 0.3707
0.0813 8.31 10900 0.3285 0.3748
0.1063 8.39 11000 0.3321 0.3748
0.1342 8.47 11100 0.3171 0.3647
0.1202 8.54 11200 0.3209 0.3636
0.0987 8.62 11300 0.3224 0.3625
0.1357 8.7 11400 0.3245 0.3646
0.1038 8.77 11500 0.3172 0.3702
0.0961 8.85 11600 0.3080 0.3611
0.1836 8.92 11700 0.3112 0.3681
0.0951 9.0 11800 0.3157 0.3649
0.1162 9.08 11900 0.3188 0.3714
0.1157 9.15 12000 0.3383 0.3775
0.1268 9.23 12100 0.3204 0.3752
0.1402 9.31 12200 0.3441 0.3707
0.1094 9.38 12300 0.3415 0.3675
0.1122 9.46 12400 0.3150 0.3596
0.0932 9.53 12500 0.3195 0.3561
0.1176 9.61 12600 0.3250 0.3675
0.1287 9.69 12700 0.3253 0.3615
0.0886 9.76 12800 0.3276 0.3636
0.1016 9.84 12900 0.3185 0.3592
0.0902 9.92 13000 0.3177 0.3643
0.1304 9.99 13100 0.3131 0.3530
0.099 10.07 13200 0.3094 0.3525
0.1142 10.14 13300 0.3298 0.3609
0.1836 10.22 13400 0.3213 0.3526
0.1533 10.3 13500 0.3163 0.3579
0.1436 10.37 13600 0.3352 0.3543
0.1215 10.45 13700 0.3355 0.3458
0.0971 10.53 13800 0.3232 0.3579
0.1215 10.6 13900 0.3168 0.3441
0.0906 10.68 14000 0.3266 0.3498
0.125 10.76 14100 0.3318 0.3414
0.0831 10.83 14200 0.3030 0.3480
0.1588 10.91 14300 0.3155 0.3455
0.1191 10.98 14400 0.3287 0.3487
0.074 11.06 14500 0.3176 0.3431
0.1075 11.14 14600 0.3219 0.3446
0.0679 11.21 14700 0.3158 0.3414
0.0789 11.29 14800 0.3305 0.3491
0.1426 11.37 14900 0.3281 0.3485
0.1154 11.44 15000 0.3368 0.3482
0.1313 11.52 15100 0.3285 0.3415
0.0786 11.59 15200 0.3138 0.3439
0.0595 11.67 15300 0.3135 0.3431
0.0868 11.75 15400 0.3049 0.3396
0.0812 11.82 15500 0.3050 0.3373
0.1199 11.9 15600 0.3238 0.3392
0.1243 11.98 15700 0.3123 0.3368
0.0663 12.05 15800 0.3226 0.3373
0.0285 12.13 15900 0.3260 0.3367
0.0607 12.2 16000 0.3236 0.3406
0.064 12.28 16100 0.3297 0.3357
0.0554 12.36 16200 0.3357 0.3383
0.0561 12.43 16300 0.3211 0.3387
0.0785 12.51 16400 0.3140 0.3386
0.0539 12.59 16500 0.3130 0.3361
0.0873 12.66 16600 0.3244 0.3344
0.0774 12.74 16700 0.3128 0.3274
0.0853 12.81 16800 0.3185 0.3395
0.0701 12.89 16900 0.3244 0.3327
0.0486 12.97 17000 0.3100 0.3317
0.1087 13.04 17100 0.3351 0.3327
0.0716 13.12 17200 0.3474 0.3383
0.0653 13.2 17300 0.3361 0.3364
0.0936 13.27 17400 0.3423 0.3352
0.0761 13.35 17500 0.3261 0.3304
0.0723 13.42 17600 0.3298 0.3333
0.0756 13.5 17700 0.3282 0.3367
0.058 13.58 17800 0.3386 0.3303
0.0619 13.65 17900 0.3354 0.3306
0.081 13.73 18000 0.3413 0.3317
0.0893 13.81 18100 0.3257 0.3278
0.0858 13.88 18200 0.3312 0.3255
0.0756 13.96 18300 0.3279 0.3326
0.0946 14.04 18400 0.3412 0.3272
0.1452 14.11 18500 0.3394 0.3266
0.0772 14.19 18600 0.3271 0.3261
0.0748 14.26 18700 0.3338 0.3272
0.0789 14.34 18800 0.3461 0.3254
0.0967 14.42 18900 0.3163 0.3250
0.0938 14.49 19000 0.3273 0.3261
0.1134 14.57 19100 0.3301 0.3284
0.1051 14.65 19200 0.3187 0.3215
0.0936 14.72 19300 0.3211 0.3197
0.0528 14.8 19400 0.3381 0.3270
0.1497 14.87 19500 0.3291 0.3235
0.1168 14.95 19600 0.3290 0.3238
0.028 15.03 19700 0.3333 0.3209
0.0773 15.1 19800 0.3359 0.3206
0.0972 15.18 19900 0.3262 0.3163
0.0391 15.26 20000 0.3335 0.3180
0.0571 15.33 20100 0.3445 0.3198
0.0365 15.41 20200 0.3318 0.3170
0.0535 15.48 20300 0.3257 0.3147
0.0739 15.56 20400 0.3359 0.3136
0.0753 15.64 20500 0.3216 0.3195
0.1507 15.71 20600 0.3326 0.3154
0.062 15.79 20700 0.3310 0.3164
0.0595 15.87 20800 0.3134 0.3162
0.0456 15.94 20900 0.3146 0.3127
0.0977 16.02 21000 0.3328 0.3117
0.036 16.09 21100 0.3266 0.3134
0.0308 16.17 21200 0.3306 0.3136
0.0612 16.25 21300 0.3207 0.3160
0.0269 16.32 21400 0.3429 0.3143
0.0897 16.4 21500 0.3355 0.3111
0.0458 16.48 21600 0.3238 0.3065
0.0155 16.55 21700 0.3167 0.3042
0.0519 16.63 21800 0.3296 0.3099
0.0807 16.7 21900 0.3250 0.3048
0.0406 16.78 22000 0.3283 0.3087
0.0773 16.86 22100 0.3217 0.3047
0.1027 16.93 22200 0.3279 0.3108
0.0315 17.01 22300 0.3173 0.3058
0.0457 17.09 22400 0.3387 0.3085
0.0516 17.16 22500 0.3309 0.3050
0.0413 17.24 22600 0.3363 0.3067
0.0601 17.32 22700 0.3325 0.3048
0.0435 17.39 22800 0.3298 0.3058
0.0571 17.47 22900 0.3244 0.3033
0.0656 17.54 23000 0.3350 0.3056
0.0485 17.62 23100 0.3406 0.3051
0.0619 17.7 23200 0.3268 0.3033
0.0495 17.77 23300 0.3268 0.3031
0.0416 17.85 23400 0.3268 0.3038
0.0646 17.93 23500 0.3314 0.3009
0.0294 18.0 23600 0.3251 0.3028
0.0372 18.08 23700 0.3364 0.2962
0.04 18.15 23800 0.3358 0.2967
0.0367 18.23 23900 0.3317 0.3031
0.0312 18.31 24000 0.3272 0.2998
0.0419 18.38 24100 0.3358 0.2996
0.0477 18.46 24200 0.3283 0.2996
0.0256 18.54 24300 0.3310 0.2995
0.0269 18.61 24400 0.3325 0.2997
0.0309 18.69 24500 0.3345 0.2974
0.0441 18.76 24600 0.3345 0.3003
0.0496 18.84 24700 0.3396 0.2985
0.0425 18.92 24800 0.3425 0.2965
0.0196 18.99 24900 0.3373 0.2964
0.0348 19.07 25000 0.3361 0.2955
0.0466 19.15 25100 0.3328 0.2959
0.0422 19.22 25200 0.3343 0.2964
0.0271 19.3 25300 0.3369 0.2945
0.053 19.37 25400 0.3330 0.2953
0.0662 19.45 25500 0.3343 0.2958
0.0718 19.53 25600 0.3330 0.2952
0.0212 19.6 25700 0.3352 0.2940
0.0971 19.68 25800 0.3374 0.2935
0.0413 19.76 25900 0.3362 0.2933
0.0477 19.83 26000 0.3356 0.2940
0.1068 19.91 26100 0.3365 0.2937
0.108 19.98 26200 0.3366 0.2935

Framework versions

  • Transformers 4.29.2
  • Pytorch 2.0.1
  • Datasets 2.13.1
  • Tokenizers 0.13.2