rustformers

/

mpt-7b-ggml

like 46

Follow

rustformers 35

I'll take a look later and check if it's compatible without any architectural changes. Then i will upload it.

Thanks for taking a look

If the ggml alibi operation supports different context lengths this should work similar to the 30B models.