Hugging Face's logo

DewiBrynJones
/
wav2vec2-xlsr-53-ft-btb-ccv-cy

Automatic Speech Recognition
Transformers
TensorBoard
Safetensors
wav2vec2
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
wav2vec2-xlsr-53-ft-btb-ccv-cy / README.md
DewiBrynJones's picture
DewiBrynJones
End of training
1caf351 verified
preview code
|
raw
history blame
14.2 kB
metadata
license: apache-2.0
base_model: facebook/wav2vec2-large-xlsr-53
tags:
  - automatic-speech-recognition
  - DewiBrynJones/banc-trawsgrifiadau-bangor-clean-with-ccv
  - generated_from_trainer
metrics:
  - wer
model-index:
  - name: wav2vec2-xlsr-53-ft-btb-ccv-cy
    results: []

wav2vec2-xlsr-53-ft-btb-ccv-cy

This model is a fine-tuned version of facebook/wav2vec2-large-xlsr-53 on the DEWIBRYNJONES/BANC-TRAWSGRIFIADAU-BANGOR-CLEAN-WITH-CCV - DEFAULT dataset. It achieves the following results on the evaluation set:

  • Loss: 0.4064
  • Wer: 0.2984

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 0.0003
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • lr_scheduler_warmup_steps: 500
  • training_steps: 200000
  • mixed_precision_training: Native AMP

Training results

Training Loss Epoch Step Validation Loss Wer
1.092 0.0393 1000 1.1752 0.8087
0.7307 0.0786 2000 0.9363 0.6985
0.6633 0.1179 3000 0.8888 0.6624
0.6273 0.1572 4000 0.8303 0.6404
0.6031 0.1965 5000 0.7928 0.6134
0.6007 0.2358 6000 0.7720 0.5832
0.5739 0.2751 7000 0.7533 0.5686
0.5655 0.3144 8000 0.7523 0.5595
0.5584 0.3536 9000 0.7174 0.5668
0.5454 0.3929 10000 0.7537 0.5799
0.5322 0.4322 11000 0.7155 0.5614
0.5206 0.4715 12000 0.7130 0.5746
0.5304 0.5108 13000 0.6817 0.5390
0.55 0.5501 14000 0.6903 0.5340
0.5115 0.5894 15000 0.6974 0.5437
0.5097 0.6287 16000 0.6786 0.5198
0.504 0.6680 17000 0.6680 0.5067
0.4951 0.7073 18000 0.6600 0.5222
0.4982 0.7466 19000 0.6372 0.5011
0.493 0.7859 20000 0.6563 0.5236
0.4928 0.8252 21000 0.6478 0.5030
0.4964 0.8645 22000 0.6432 0.5103
0.4818 0.9038 23000 0.6236 0.4896
0.4752 0.9431 24000 0.6326 0.5008
0.4736 0.9824 25000 0.6310 0.5081
0.4241 1.0217 26000 0.6127 0.4713
0.4196 1.0609 27000 0.6066 0.4683
0.4177 1.1002 28000 0.5959 0.4774
0.4204 1.1395 29000 0.6071 0.4894
0.4238 1.1788 30000 0.6006 0.4764
0.4253 1.2181 31000 0.5803 0.4623
0.4156 1.2574 32000 0.5940 0.4573
0.4058 1.2967 33000 0.5802 0.4615
0.404 1.3360 34000 0.5882 0.4602
0.3995 1.3753 35000 0.5841 0.4615
0.4049 1.4146 36000 0.5853 0.4636
0.4018 1.4539 37000 0.5737 0.4533
0.3906 1.4932 38000 0.5848 0.4637
0.3932 1.5325 39000 0.5516 0.4400
0.4026 1.5718 40000 0.5642 0.4484
0.396 1.6111 41000 0.5584 0.4512
0.3976 1.6504 42000 0.5538 0.4436
0.3936 1.6897 43000 0.5518 0.4412
0.3879 1.7289 44000 0.5469 0.4297
0.3939 1.7682 45000 0.5502 0.4402
0.386 1.8075 46000 0.5627 0.4409
0.3823 1.8468 47000 0.5603 0.4372
0.3955 1.8861 48000 0.5350 0.4308
0.3808 1.9254 49000 0.5508 0.4448
0.3871 1.9647 50000 0.5387 0.4320
0.3668 2.0040 51000 0.5477 0.4207
0.3324 2.0433 52000 0.5283 0.4228
0.3327 2.0826 53000 0.5218 0.4156
0.3251 2.1219 54000 0.5331 0.4136
0.3466 2.1612 55000 0.5277 0.4141
0.3259 2.2005 56000 0.5228 0.4088
0.3292 2.2398 57000 0.5119 0.4133
0.3323 2.2791 58000 0.5191 0.4074
0.3228 2.3184 59000 0.5073 0.3956
0.3172 2.3577 60000 0.5084 0.4045
0.332 2.3970 61000 0.5130 0.4015
0.3218 2.4362 62000 0.5103 0.3997
0.3317 2.4755 63000 0.5020 0.4050
0.3222 2.5148 64000 0.5072 0.3996
0.3138 2.5541 65000 0.5098 0.4036
0.3074 2.5934 66000 0.5026 0.3981
0.3261 2.6327 67000 0.5030 0.3935
0.3257 2.6720 68000 0.5003 0.3903
0.3179 2.7113 69000 0.5139 0.4004
0.3154 2.7506 70000 0.5041 0.3946
0.3119 2.7899 71000 0.4914 0.3941
0.3128 2.8292 72000 0.4867 0.3831
0.3105 2.8685 73000 0.4871 0.3818
0.309 2.9078 74000 0.4887 0.3989
0.3073 2.9471 75000 0.4839 0.3904
0.3023 2.9864 76000 0.4839 0.3805
0.2715 3.0257 77000 0.4816 0.3877
0.2565 3.0650 78000 0.4994 0.3811
0.2697 3.1042 79000 0.4803 0.3813
0.2717 3.1435 80000 0.4843 0.3799
0.2738 3.1828 81000 0.4905 0.3797
0.2617 3.2221 82000 0.4754 0.3728
0.2634 3.2614 83000 0.4730 0.3668
0.2648 3.3007 84000 0.4768 0.3691
0.2567 3.3400 85000 0.4812 0.3741
0.2687 3.3793 86000 0.4683 0.3716
0.2757 3.4186 87000 0.4690 0.3732
0.2596 3.4579 88000 0.4753 0.3782
0.2589 3.4972 89000 0.4645 0.3691
0.2627 3.5365 90000 0.4690 0.3675
0.2804 3.5758 91000 0.4675 0.3742
0.2587 3.6151 92000 0.4674 0.3594
0.2615 3.6544 93000 0.4657 0.3632
0.2531 3.6937 94000 0.4589 0.3668
0.2466 3.7330 95000 0.4618 0.3691
0.2653 3.7723 96000 0.4614 0.3775
0.2542 3.8115 97000 0.4600 0.3726
0.2616 3.8508 98000 0.4511 0.3660
0.2625 3.8901 99000 0.4607 0.3644
0.2627 3.9294 100000 0.4456 0.3626
0.252 3.9687 101000 0.4579 0.3665
0.2489 4.0080 102000 0.4510 0.3620
0.2218 4.0473 103000 0.4419 0.3535
0.2211 4.0866 104000 0.4499 0.3771
0.2186 4.1259 105000 0.4546 0.3660
0.2199 4.1652 106000 0.4396 0.3542
0.2227 4.2045 107000 0.4469 0.3575
0.2212 4.2438 108000 0.4403 0.3501
0.2182 4.2831 109000 0.4507 0.3599
0.2212 4.3224 110000 0.4435 0.3576
0.2211 4.3617 111000 0.4514 0.3689
0.2116 4.4010 112000 0.4443 0.3508
0.2218 4.4403 113000 0.4410 0.3472
0.2152 4.4795 114000 0.4468 0.3535
0.2174 4.5188 115000 0.4499 0.3470
0.212 4.5581 116000 0.4454 0.3440
0.2039 4.5974 117000 0.4424 0.3489
0.2073 4.6367 118000 0.4437 0.3466
0.2177 4.6760 119000 0.4392 0.3422
0.2121 4.7153 120000 0.4443 0.3437
0.2072 4.7546 121000 0.4268 0.3462
0.2138 4.7939 122000 0.4272 0.3432
0.2145 4.8332 123000 0.4332 0.3454
0.2217 4.8725 124000 0.4210 0.3391
0.2069 4.9118 125000 0.4278 0.3376
0.2068 4.9511 126000 0.4216 0.3387
0.2129 4.9904 127000 0.4210 0.3362
0.1774 5.0297 128000 0.4340 0.3304
0.1705 5.0690 129000 0.4422 0.3299
0.1746 5.1083 130000 0.4306 0.3363
0.1813 5.1476 131000 0.4181 0.3334
0.1729 5.1868 132000 0.4319 0.3369
0.1777 5.2261 133000 0.4190 0.3327
0.18 5.2654 134000 0.4228 0.3338
0.1747 5.3047 135000 0.4268 0.3323
0.1737 5.3440 136000 0.4193 0.3325
0.1709 5.3833 137000 0.4229 0.3279
0.1726 5.4226 138000 0.4179 0.3271
0.1741 5.4619 139000 0.4205 0.3255
0.1723 5.5012 140000 0.4140 0.3294
0.1676 5.5405 141000 0.4256 0.3254
0.1769 5.5798 142000 0.4180 0.3279
0.1718 5.6191 143000 0.4158 0.3204
0.1735 5.6584 144000 0.4174 0.3209
0.1693 5.6977 145000 0.4166 0.3198
0.1745 5.7370 146000 0.4165 0.3245
0.1692 5.7763 147000 0.4148 0.3230
0.1641 5.8156 148000 0.4116 0.3216
0.173 5.8548 149000 0.4041 0.3237
0.1664 5.8941 150000 0.4039 0.3184
0.1648 5.9334 151000 0.4072 0.3166
0.1709 5.9727 152000 0.4022 0.3206
0.151 6.0120 153000 0.4034 0.3188
0.1353 6.0513 154000 0.4128 0.3257
0.1476 6.0906 155000 0.4197 0.3200
0.1465 6.1299 156000 0.4073 0.3167
0.139 6.1692 157000 0.4228 0.3212
0.1404 6.2085 158000 0.4117 0.3245
0.1338 6.2478 159000 0.4180 0.3153
0.1436 6.2871 160000 0.4264 0.3167
0.1317 6.3264 161000 0.4118 0.3152
0.1395 6.3657 162000 0.4269 0.3118
0.1267 6.4050 163000 0.4241 0.3135
0.1334 6.4443 164000 0.4058 0.3169
0.1369 6.4836 165000 0.4050 0.3130
0.1322 6.5228 166000 0.4097 0.3140
0.1358 6.5621 167000 0.4142 0.3129
0.1345 6.6014 168000 0.4009 0.3123
0.1321 6.6407 169000 0.4005 0.3093
0.1299 6.6800 170000 0.3996 0.3054
0.1345 6.7193 171000 0.4041 0.3071
0.1328 6.7586 172000 0.3997 0.3070
0.1245 6.7979 173000 0.3974 0.3045
0.1356 6.8372 174000 0.3999 0.3009
0.1208 6.8765 175000 0.3953 0.3019
0.1316 6.9158 176000 0.3974 0.3056
0.1232 6.9551 177000 0.3921 0.3033
0.1261 6.9944 178000 0.3985 0.3035
0.1184 7.0337 179000 0.4006 0.3061
0.1115 7.0730 180000 0.4096 0.3050
0.1109 7.1123 181000 0.4138 0.3038
0.1113 7.1516 182000 0.4119 0.3052
0.1075 7.1909 183000 0.4170 0.3007
0.1081 7.2301 184000 0.4135 0.3031
0.1108 7.2694 185000 0.4129 0.3003
0.1044 7.3087 186000 0.4130 0.3023
0.1121 7.3480 187000 0.4079 0.2993
0.1052 7.3873 188000 0.4048 0.3019
0.103 7.4266 189000 0.4154 0.3015
0.1105 7.4659 190000 0.4120 0.3019
0.1093 7.5052 191000 0.4105 0.3007
0.1058 7.5445 192000 0.4102 0.3011
0.1043 7.5838 193000 0.4101 0.2994
0.1098 7.6231 194000 0.4085 0.2998
0.1057 7.6624 195000 0.4072 0.2982
0.1021 7.7017 196000 0.4079 0.2974
0.0994 7.7410 197000 0.4089 0.2987
0.1065 7.7803 198000 0.4066 0.2974
0.1111 7.8196 199000 0.4071 0.2982
0.1065 7.8589 200000 0.4064 0.2984

Framework versions

  • Transformers 4.41.2
  • Pytorch 2.3.1+cu121
  • Datasets 2.20.0
  • Tokenizers 0.19.1