Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
ZhankuiHe
/
temp-kgsf-gen
like
0
Model card
Files
Files and versions
Community
09823ba
temp-kgsf-gen
/
tokenizer_config.json
ZhankuiHe
Upload tokenizer
09823ba
verified
9 months ago
raw
Copy download link
history
blame
197 Bytes
{
"tokenizers"
:
{
"word"
:
"KGSFBaseTokenizer"
,
"item"
:
"EntityTokenizer"
,
"entity"
:
"KGSFBaseTokenizer"
,
"concept"
:
"KGSFBaseTokenizer"
}
,
"tokenizer_key_for_decode"
:
"word"
}