Text Generation
Transformers
Safetensors
English
olmo
Inference Endpoints

Intermediate Checkpoints

#3
by mwhanna - opened

I noticed that there are intermediate checkpoints available for OLMo-1B, and for OLMo-7B and OLMo-1.7-7B-hf, but there are no checkpoints for this model (OLMo-1B-hf) or the other -hf 7B model (OLMo-7B-hf). Are there any plans to add the OLMo-1B checkpoints to this repo as well, so we can use them without setting trust_remote_code=True and installing ai2-olmo? Thanks to the creators of OLMo for this great resource :)

Ai2 org

As of today, we have released almost all the checkpoints of the newer allenai/OLMo-1.7-7B-hf model. The original 1B model (i.e. this repo) will probably be next.

If you have any particular intermediate checkpoints you are interested in using, then one option is to convert these to HF format yourself (it takes maybe 5-10 mins per checkpoint once you have the checkpoint on your machine). The instructions are in Checkpoints.md. The idea is to find the official checkpoint you want in https://github.com/allenai/OLMo/blob/main/checkpoints/official and then use convert_olmo_to_hf_new.py to convert it to HF format.

Ai2 org

These checkpoints are in progress now and will hopefully be done in a day or two

Ai2 org

They're all up now!

shanearora changed discussion status to closed

Sign up or log in to comment