Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
NovelAI
/
nerdstash-tokenizer-v2
like
7
Follow
NovelAI
44
English
Japanese
tokenizer
novelai
sentencepiece
License:
gpl-2.0
Model card
Files
Files and versions
Community
main
nerdstash-tokenizer-v2
Commit History
Add sentencepiece tag
24ff1b6
finetune
commited on
Aug 2, 2023
Add meta data
e5beb19
finetune
commited on
Aug 2, 2023
Add tokenizer
75d4e5d
finetune
commited on
Aug 2, 2023
initial commit
98f17f2
finetune
commited on
Aug 2, 2023