verbosity
This is a good model but the verbosity issue is still there like the alpha version. Why is that?
I think it is because it is trained on chat gpt data which is similarly verbose that's why it is verbose. It might be more good for more reasoning tasks as verbosity helps in getting to finally correct answer.
It's not just elaborate answers, but a simple "hello" would make it go on forever
Thank you for your feedback. The model generation is still on the longer side but the verbosity is slightly improved compared with the alpha version. The unnecessary generation should be mitigated with a second round RLHF, which we plan to investigate in the near future. For now we release the beta version since it's better than alpha version in some of the reasoning tasks we tested.