tokenizer.model and tokenizer.model.v3 are identical
#15
by
wolfram
- opened
tokenizer.model and tokenizer.model.v3 are identical, so is one extraneous and should be deleted from the repo?
37f00374dea48658ee8f5d0f21895b9bc55cb0103939607c8185bfd1c6ca1f89 tokenizer.model
37f00374dea48658ee8f5d0f21895b9bc55cb0103939607c8185bfd1c6ca1f89 tokenizer.model.v3