How do you convert pre-trained models to HF standard?

by morenolq - opened Jun 10, 2023

Jun 10, 2023

Hi,

I saw that pre trained AST models are released publicly and follow-up models follow the same structure of the backbone model (e.g., https://github.com/YuanGongND/ssast). Is there any way to convert them to match the HF model format? Is this what the HF team did?

Thanks

gaunernst

Aug 30, 2023

It's probably here
https://github.com/huggingface/transformers/blob/main/src/transformers/models/audio_spectrogram_transformer/convert_audio_spectrogram_transformer_original_to_pytorch.py

If the follow-up methods use the same model, it will be great if the HF team can do the conversion to publish the weights under the MIT org!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment