|
|
--- |
|
|
library_name: transformers |
|
|
language: |
|
|
- hr |
|
|
base_model: |
|
|
- openai/whisper-large-v3-turbo |
|
|
metrics: |
|
|
- wer |
|
|
--- |
|
|
|
|
|
# Model Card for Model ID |
|
|
|
|
|
<!-- Provide a quick summary of what the model is/does. --> |
|
|
|
|
|
|
|
|
|
|
|
## Model Details |
|
|
|
|
|
Fine tuned with LoRa and merged. Parla Speech HR dataset + augmented additions. Full fine-tuned version is still in training. |
|
|
|
|
|
LoRa adapters: slsolucije/whisper-large-v3-turbo-hr-parla-lora-adapters |
|
|
|
|
|
### WER comparsion |
|
|
|
|
|
| Dataset | Model | WER (%) | |
|
|
|---------------------------------|----------------------------------------------------|----------| |
|
|
| google/fleurs hr_hr test | openai/whisper-base | 65.99 | |
|
|
| google/fleurs hr_hr test | openai/whisper-large-v3-turbo | 12.73 | |
|
|
| google/fleurs hr_hr test | **slsolucije/whisper-large-v3-turbo-hr-parla-lora-merged** | **9.93** | |
|
|
| GoranS/stt-croatian_99k_265_2 test | openai/whisper-large-v3-turbo | 22.93 | |
|
|
| GoranS/stt-croatian_99k_265_2 test | **slsolucije/whisper-large-v3-turbo-hr-parla-lora-merged** | **19.02** | |
|
|
| GoranS/stt-croatian-sl-31k test | openai/whisper-large-v3-turbo | 21.62 | |
|
|
| GoranS/stt-croatian-sl-31k test | **slsolucije/whisper-large-v3-turbo-hr-parla-lora-merged** | **17.07** | |
|
|
| parla_867k_2483_0.5 test | openai/whisper-large-v3-turbo | 10.23 | |
|
|
| parla_867k_2483_0.5 test | **slsolucije/whisper-large-v3-turbo-hr-parla-lora-merged** | **4.58** | |
|
|
|
|
|
|
|
|
### Model Description |
|
|
|
|
|
<!-- Provide a longer summary of what this model is. --> |
|
|
|
|
|
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated. |
|
|
|
|
|
- **Language(s):** Croatian (hr) |
|
|
- **Finetuned from model:** openai/whisper-large-v3-turbo |
