gradjitta
/

Poro-34B-AWQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

gradjitta commited on Nov 15, 2023

Commit

6e02c4c

•

1 Parent(s): 077a648

Update README.md

Files changed (1) hide show

README.md +1 -2

README.md CHANGED Viewed

@@ -48,8 +48,7 @@ tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=False)
-def generate(instruction):
-    prompt = instruction
     inputs = tokenizer(prompt, return_tensors="pt")
     input_ids = inputs["input_ids"].cuda()
     generation_output = model.generate(

+def generate(prompt):
     inputs = tokenizer(prompt, return_tensors="pt")
     input_ids = inputs["input_ids"].cuda()
     generation_output = model.generate(