---
license: cc-by-4.0
language:
  - en
  - ja
tags:
  - tokenizer
  - sentencepiece
---