License for tokenizer
#22
by
marksverdhei
- opened
Does the MRL license apply to the tokenizer too or is it Apache 2.0? There are certain cases where a tokenizer would be useful if you are using the model through a comercially licensed API.