Deployment issue?
#1
by
drmartin
- opened
I previously used Mozilla/Meta-Llama-3-70B-Instruct.Q4_0.llamafile which worked great.
Now I tried to run Mozilla/Meta-Llama-3.1-70B-Instruct.Q4_1.llamafile and the LLM always responds with empty.
Anyone else getting this?
FYI Mozilla/Meta-Llama-3.1-70B-Instruct.Q4_0.llamafile works as expected