How to know what context window size(n_ctx) one can use on each model ?
#13
by
MrktWzrd
- opened
hey
i wanted to know if there is a way to check the context window size value of a model? or how can i check the default value of a model and its limits?
The most reusable way is to use huggingface's GGUF explorer and look for the context length value (I can provide screenshots later if unclear)
thank you! found it