xmen-fr-ce-medmentions / added_tokens.json
phlobo's picture
add tokenizer
fe788f1
raw
history blame contribute delete
85 Bytes
{"[NIL]": 30525, "[END]": 30523, "[START]": 30522, "[TITLE]": 30524, "[TYPE]": 30526}