convert t5x into pytorch model
#1
by
Siddharth63
- opened
Hi. I have pretrained my own openmoe model using ul2 training procedure with t5x. I have got t5x checkpoint. which script to use to convert the t5x checkpoint to flax/pytorch model.
Sorry for the late reply. I just notice this question in hpcai-tech repo. We have a Colab demo on converting the jax checkpoint to pytorch.😃
https://colab.research.google.com/drive/1eIT1rtG7pORRQAYtQoMOAekUg7aZLDdn