Inference server recommandation

by DeltaWhiplash - opened Sep 11

Sep 11

Hello I have an amd APU with ubuntu 24.04LTS
What inference software do you recommands for Q8 ?

Arcee AI org Sep 11

People like using ollama: https://ollama.com/

Sep 19

Oh I didn't see it's avaiable
Thanks

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment