tokenizer.model and tokenizer.model.v3 are identical

#15
by wolfram - opened

tokenizer.model and tokenizer.model.v3 are identical, so is one extraneous and should be deleted from the repo?

37f00374dea48658ee8f5d0f21895b9bc55cb0103939607c8185bfd1c6ca1f89 tokenizer.model
37f00374dea48658ee8f5d0f21895b9bc55cb0103939607c8185bfd1c6ca1f89 tokenizer.model.v3

Sign up or log in to comment