What is the context size of this model?

#5
by Okki - opened

What is the context size of this model? I use a clean llama.cpp so I need to fill it manually.

You can see that in config.json

32768

original qwen2 can be rope scaled to 128k, maybe it will work with this model too.

You can see that in config.json

32768

original qwen2 can be rope scaled to 128k, maybe it will work with this model too.

Thanks, man! You not only gave me a fish but also a fishing rod. I appreciate it.

Okki changed discussion status to closed

Sign up or log in to comment