Spaces:

HuggingFaceH4

/

falcon-chat

like 556

Running

Hey guys! I was creeping your special_tokens.json like a degenerate and noticed some FIM tokens. I was excited to try them out but my test prompt makes the example app go way off the rails with nonsense output:

>>PREFIX<<It was the best of times, it was the worst of times>>SUFFIX<<it was the epoch of belief, it was the epoch of incredulity>>MIDDLE<<

Is my expectation of this models capability incorrect, or am I doing something wrong?

Thanks!