Fine-tuning Whisper for Translation ?

#1
by zsy12345 - opened

Hi @sanchit-gandhi

I wanted to know that if I want to fine-tune for translation instead of transcription, I only need to change the task in the WhisperAudioProcessor and the metrics (using BLEU instead of WER) in the compute metrics function right?

Do I need to make any other changes to modify the code for translation to English?

Best,
zsy

Sign up or log in to comment