how to run over a local api
#180
by
jpfraneto
- opened
gmgm
ive been trying to just have the model run on my local gpu(s) [i have two 4090's] and so far been using pinokio, but the images that i get from the web interface of flux-dev on the textarea of this website are much better ones than the ones that i get from the merged of pinokio
all that to say: how do you personally run this model locally so that you can call it from an http (or grpc) request over localhost?
thank you for your help