Fixes an error when running on CPU mode. (#2)

- Fixes an error when running on CPU mode. (5653788477bae62b28187c8bc65912ae068eadf6)


Co-authored-by: Anton ANDREEV <toncho11@users.noreply.huggingface.co>

app.py

@@ -76,7 +76,8 @@ def generate_prompt(instruction, input=None):
 
 ### Response:"""
 
-model.half()
+if device != "cpu":
+    model.half()
 model.eval()
 if torch.__version__ >= "2":
     model = torch.compile(model)