if001
/

sentencepiece_ja

Model card Files Files and versions Community

sentencepiece_ja / README.md

i.fujimoto

add tokenizer

fb7d963 about 1 year ago

|

89 Bytes

metadata

license: cc-by-4.0
language:
  - en
  - ja
tags:
  - tokenizer
  - sentencepiece