internlm2-math-base-20b / tokenization_internlm2_fast.py

Commit History

fix no white space when using stream_chat with fast tokenizer
4e7686d

x54-729 commited on

update name to internlm2
cd50b8a

x54-729 commited on