Spaces:
Running
I tried running this space on GPU but I’m not sure if it’s using it?
Love your space btw,
I was trying to test out GPU usage on it by duplicating it after I found the cuda in your code for this space
When running I can’t tell if it’s using the GPU?
I don’t see any GPU usage % and the inference speed feels the same as cpu?
No you need to set GPU = True and maybe change cuda version depends on GPU I was running it locally on 1050ti 4gb but had to manually upload some missing DLLs to docker image
OK so GPU is possible! 👀✨
Before I start messing with it again would you say it’s worth it?
Like..how much of a speed up on infrence time did you see 🤔 😅 on GPU
On 1050 to was 5x speed of hugging spaces CPU especially for long 10 minutes and longer texts
Thx thx thx u have no idea how much this answer means to me 🔥✨
I was searching so long on the internet for a definitive answer and no one was saying anything XD 🙏