internlm2-1_8b / tokenization_internlm2_fast.py

Commit History

fix no white space when using stream_chat with fast tokenizer
35f91cd

x54-729 commited on

upload internlm2 1.8B
460f38b

x54-729 commited on