Replace a architecture which uses LLAMA-2 with phi-2

#28
by fazlimaam - opened

Is it possible to replace a architecture which uses LLAMA-2 with phi-2? If so, what would be some of the challenges?
PS, I'm an amateur in the LLM space

Microsoft org

Hello @fazlimaam !

It is not supported since they use a different structure. However, we have plans of releasing Llama-style checkpoints in the future. Stay tuned!

Regards,
Gustavo.

gugarosa changed discussion status to closed

Sign up or log in to comment