ssaroya
/

gptq_model

Inference Endpoints

Model card Files Files and versions Community

ssaroya commited on May 25, 2023

Commit

e660f8f

·

1 Parent(s): c77d578

Update handler.py

Files changed (1) hide show

handler.py +1 -1

handler.py CHANGED Viewed

@@ -33,7 +33,7 @@ class EndpointHandler:
                 input_ids,
                 do_sample=True,
                 min_length=50,
-                max_length=len(input_ids)+250,
                 top_p=0.95,
                 temperature=0.8,
             )

                 input_ids,
                 do_sample=True,
                 min_length=50,
+                max_length=len(input_ids[0])+250,
                 top_p=0.95,
                 temperature=0.8,
             )