ISSUE SOLVED: Slow text output
#2
by
TheEnthusiast
- opened
When I changed my config.json's "use_cache"
variable to true
this LLM's output sped up by quite a large margin, there's no reason I can think of for it to be set to false. I think it was an accident.