google

/

gemma-2-9b-it

like 459

Test

It's in the config.json:
"max_position_embeddings": 8192,

Hi @shipWr3ck , You can find the context window size in it's config.json which is 8192. Kindly go through config.json document and let me know if you have any doubts . Thank you.

as with all gemma 2 models, it's 8192.

however they are also compatible with SelfExtend to extend the context to 32768 without degradation.

you need a lot of RAM to perform this action though, A100 or better only.