Fine Tuning Molmo

#3
by chrishoertnagl - opened

Really cool work!
Is it possible to futher fine-tune the model e.g. on an OCR dataset or something? Are there any notebooks or examples you could share?

Ai2 org

Thank you! We will release full training code for these models but we do not have that ready yet. For now these models do support a forward pass and backpropagation so you can place them into a standard torch training loop yourself.

Any update about releasing the fine tuning molmo script? thanks in advance

Hey @mavericklsd , we are planning to release the code along with checkpoints and weights by the end of November.

@amanrangapur don't want to be that guy, but can't help it. Is this released yet?

Hey @delip , we're planning to release this week. Stay tuned.

Thanks @amanrangapur and MolMo team!

@amanrangapur I saw the Molmo dataset(s) were released. Is there still a plan to release the training code on GitHub as well this week?

Hey @scm-aiml ! Since it’s the holidays here, we’ll be releasing next week!

Sign up or log in to comment