| --- |
| license: apache-2.0 |
| tags: |
| - generated_from_trainer |
| base_model: openai/whisper-medium |
| datasets: |
| - generator |
| metrics: |
| - wer |
| model-index: |
| - name: whisper-medium-lug |
| results: |
| - task: |
| type: automatic-speech-recognition |
| name: Automatic Speech Recognition |
| dataset: |
| name: generator |
| type: generator |
| config: default |
| split: train |
| args: default |
| metrics: |
| - type: wer |
| value: 61.62227602905569 |
| name: Wer |
| --- |
| |
| <!-- This model card has been generated automatically according to the information the Trainer had access to. You |
| should probably proofread and complete it, then remove this comment. --> |
|
|
| [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/bakera-sunbird/huggingface/runs/c6s8tlgq) |
| # whisper-medium-lug |
|
|
| This model is a fine-tuned version of [openai/whisper-medium](https://huggingface.co/openai/whisper-medium) on the generator dataset. |
| It achieves the following results on the evaluation set: |
| - Loss: 0.2943 |
| - Wer: 61.6223 |
|
|
| ## Model description |
|
|
| More information needed |
|
|
| ## Intended uses & limitations |
|
|
| More information needed |
|
|
| ## Training and evaluation data |
|
|
| More information needed |
|
|
| ## Training procedure |
|
|
| ### Training hyperparameters |
|
|
| The following hyperparameters were used during training: |
| - learning_rate: 1e-05 |
| - train_batch_size: 16 |
| - eval_batch_size: 8 |
| - seed: 42 |
| - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 |
| - lr_scheduler_type: linear |
| - lr_scheduler_warmup_steps: 500 |
| - training_steps: 8000 |
| - mixed_precision_training: Native AMP |
| |
| ### Training results |
| |
| | Training Loss | Epoch | Step | Validation Loss | Wer | |
| |:-------------:|:-------:|:----:|:---------------:|:--------:| |
| | 0.9437 | 0.025 | 200 | 0.4902 | 427.9661 | |
| | 0.4586 | 1.0108 | 400 | 0.3298 | 150.3027 | |
| | 0.3741 | 1.0357 | 600 | 0.3337 | 143.5835 | |
| | 0.2659 | 2.0215 | 800 | 0.2871 | 109.6852 | |
| | 0.139 | 3.0072 | 1000 | 0.3437 | 131.9613 | |
| | 0.1734 | 3.0322 | 1200 | 0.3028 | 170.8838 | |
| | 0.1072 | 4.018 | 1400 | 0.2943 | 61.6223 | |
| | 0.0726 | 5.0038 | 1600 | 0.3438 | 114.7094 | |
| | 0.0751 | 5.0287 | 1800 | 0.3526 | 73.6683 | |
| | 0.0635 | 6.0145 | 2000 | 0.3629 | 159.7458 | |
| | 0.0554 | 7.0003 | 2200 | 0.3854 | 152.1186 | |
| | 0.0549 | 7.0252 | 2400 | 0.3751 | 98.5472 | |
| | 0.0283 | 8.011 | 2600 | 0.3190 | 89.2857 | |
| | 0.0349 | 8.036 | 2800 | 0.3452 | 155.5085 | |
| | 0.0379 | 9.0218 | 3000 | 0.3780 | 109.7458 | |
| | 0.0316 | 10.0075 | 3200 | 0.3880 | 101.4528 | |
| | 0.0232 | 10.0325 | 3400 | 0.4144 | 67.7966 | |
| | 0.0246 | 11.0183 | 3600 | 0.3820 | 71.0654 | |
| | 0.0192 | 12.004 | 3800 | 0.4022 | 107.6877 | |
| | 0.0195 | 12.029 | 4000 | 0.4276 | 126.9976 | |
| | 0.013 | 13.0147 | 4200 | 0.4128 | 115.3753 | |
| | 0.0154 | 14.0005 | 4400 | 0.4371 | 126.6949 | |
| | 0.0109 | 14.0255 | 4600 | 0.4213 | 142.2518 | |
| | 0.0133 | 15.0113 | 4800 | 0.4075 | 170.1574 | |
| | 0.011 | 15.0363 | 5000 | 0.4454 | 116.1622 | |
| | 0.0104 | 16.022 | 5200 | 0.3950 | 79.5400 | |
| | 0.0079 | 17.0078 | 5400 | 0.4330 | 109.2010 | |
| | 0.0083 | 17.0328 | 5600 | 0.4308 | 137.5303 | |
| | 0.0064 | 18.0185 | 5800 | 0.4178 | 96.2470 | |
| | 0.0057 | 19.0042 | 6000 | 0.4104 | 99.7579 | |
| | 0.0076 | 19.0293 | 6200 | 0.4132 | 117.0702 | |
| | 0.0062 | 20.015 | 6400 | 0.4404 | 146.2470 | |
| | 0.0035 | 21.0008 | 6600 | 0.4488 | 128.4504 | |
| | 0.0045 | 21.0257 | 6800 | 0.4415 | 91.0412 | |
| | 0.0043 | 22.0115 | 7000 | 0.4477 | 89.5884 | |
| | 0.0038 | 22.0365 | 7200 | 0.4550 | 82.5666 | |
| | 0.0028 | 23.0222 | 7400 | 0.4451 | 77.4213 | |
| | 0.003 | 24.008 | 7600 | 0.4424 | 78.5109 | |
| | 0.0033 | 24.033 | 7800 | 0.4448 | 73.4867 | |
| | 0.0041 | 25.0188 | 8000 | 0.4455 | 86.4407 | |
| |
| |
| ### Framework versions |
| |
| - Transformers 4.41.0.dev0 |
| - Pytorch 2.2.0 |
| - Datasets 2.16.1 |
| - Tokenizers 0.19.1 |
| |
