sanchit-gandhi

/

whisper-medium-fleurs-lang-id

like 12

Can you please help me to fix the following error i am trying to run this on the data i have
refer the code

df_train = df[:400]
df_test = df[400:]
df_train['Audio_id'] = df_train['Audio_id'].map(lambda x: prefix_path + x)
df_test['Audio_id'] = df_test['Audio_id'].map(lambda x: prefix_path + x)
Data = DatasetDict()
Data['train'] = Dataset.from_dict({'audio' : df_train['Audio_id'], 'transcripts':df_train['input_text']}).cast_column("audio", Audio())
Data['test'] = Dataset.from_dict({'audio' : df_test['Audio_id'], 'transcripts':df_test['input_text']}).cast_column("audio", Audio())

These are the training arguments

from transformers import Seq2SeqTrainingArguments

training_args = Seq2SeqTrainingArguments(
output_dir="./whisper-small-hi", # change to a repo name of your choice
per_device_train_batch_size=8,
gradient_accumulation_steps=1, # increase by 2x for every 2x decrease in batch size
learning_rate=1e-5,
warmup_steps=25,
num_train_epochs=5,
max_steps=50,
gradient_checkpointing=True,
evaluation_strategy="steps",
per_device_eval_batch_size=4,
predict_with_generate=True,
generation_max_length=225,
save_steps=400,
eval_steps=400,
logging_steps=5,
report_to=["tensorboard"],
load_best_model_at_end=True,
metric_for_best_model="wer",
greater_is_better=False,
)

Now i am getting this error

Please help me