Never generates <bot_end>
#14
by
kjhamilton
- opened
Sending calls locally I see:
"choices": [
{
"index": 0,
"text": " \nCall: get_current_weather(location=getlatlong(location='San Francisco')) \nThought: The function call `get_current_weather(location=getlatlong(location='San Francisco'))` answers the question because
... on and on...
It never generates bot_end - instead if I set the stop to "Thought: " - then it does stop.
I see in the code that this may be due to the server not retaining special tokens. Thanks!
kjhamilton
changed discussion status to
closed