poiccard
/

jais-13b-chat-adn

Text Generation

Inference Endpoints

Model card Files Files and versions Community

poiccard commited on Oct 2, 2023

Commit

624d54c

•

1 Parent(s): 9e4a80d

Update handler.py

Files changed (1) hide show

handler.py +1 -1

handler.py CHANGED Viewed

@@ -36,7 +36,7 @@ class EndpointHandler():
         response = self.tokenizer.batch_decode(
             generate_ids, skip_special_tokens=True, clean_up_tokenization_spaces=True
         )[0]
-        final_response = response.split("### Response: [|AI|]").json)
         return [{"generated_text": final_response[-1]}]

         response = self.tokenizer.batch_decode(
             generate_ids, skip_special_tokens=True, clean_up_tokenization_spaces=True
         )[0]
+        final_response = response.split("### Response: [|AI|]").json()
         return [{"generated_text": final_response[-1]}]