Why context 8k?

#4
by mclassHF2023 - opened

Why is the context limited to 8k?

"max_position_embeddings": 8192,

It's due to compatibility issues, I'll try to update it soon

Sign up or log in to comment