LM Studio setting for ML2411?
#1
by
overhead520
- opened
Thank you very much for creating this MLX version. 🥰
I loaded your model in LM Studio as a backend, and it's fast. My goal was to use Silly Tavern as the frontend. I wasn't able to find good LM Studio settings for Temperature, Top K, Repeat Penalty, Top P and Min P. Those are the only settings available. My results where either…
- Full gibberish
- Frequent typo & strange words
- Exactly the same generation at each swipes
For those test used LM Studio as both Frontend and Backend, so it's not a Silly Tavern integration issue.
I tried another app, MLX Web UI, but the install failed.
I'm waiting for the next version of LM Studio to try again.
What software, or settings are you using?