Spaces:
Running
on
CPU Upgrade
Performance optimizations
Hello there,
I have added 2 performance optimizations:
- use WebP instead of PNG. This should increase the speed a bit for various things (downloading images, zooming in and out..). A compression quality of 90% has been selected.
- Use Zephyr-7b-beta for the LLM, instead of Llama-2 70b https://huggingface.co/HuggingFaceH4/zephyr-7b-beta
In the future I will add an option to switch to a custom LLM model (eg. if you want to switch back to llama-2, or if one day Mistral releases a new 70b model, or if you want to use OpenAI etc) like I did for the rendering engine
Nice, and very fast!
Thank you! To be honest at first it might be a bit slow as all the traffic is shifting from LLama-2 to Zephyr-7b, we didn't expect that many requests for Zephyr so it may take some time to adjust
I think I will add an option to switch between both LLMs, with perhaps some random allocation to help the system scale a bit better (random until the user chooses one)
The art style for Modern American has changed dramatically in the last day. Is there any way to access the prior style? The lines and colors are completely changed. I was in the middle of a project and it's moved in a whole other direction.
It might be because the fast rendering mode is now on by default, can you check in the Settings button if it is activated or not?
This only tangentially relates to performance optimizations but I only recently noticed that changing the grid option (panel layout) automatically forces a redraw of the panels.
I don't recall that being there before... perhaps I just never tried changing panel layouts after initial page generation... and it's a useful way to regenerate pages with one click.
And with the speed of the rendering these days that can be a nice performance boost.
about the grid and layout re-rendering, that is because each panel of each layout has a unique image ratio, so changing the layout might turn a landscape into a portrait or cube etc which means the image needs to be re-renderer (the ratio greatly impacts how the AI will render the image, it influences the content)
It might be because the fast rendering mode is now on by default, can you check in the Settings button if it is activated or not?
Just dropping by to say thank you for the info! I didn't even realize the buttons at the bottom did anything. I still don't know how they work or what they do, but it fixed my images back to what it was.