How to solve Model inference speed is too slow？

by lanshan - opened Jun 12, 2023

Jun 12, 2023

I have got the sft model, when I use the model to inference I find it is slowly, do you have some way to accelerate。

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment