Why use Gradio?

#432
by mrfakename - opened

Hi,
This is an incredible resource for the open source community. I was curious why you chose to use Gradio. Isn't Gradio usually used for more basic demos and AI inference demos, especially because of its real-time features w/ websockets?
I was wondering if perhaps an alternate framework would be better suited for this leaderboard. For example, I think some features could be faster in a different framework (ie FastUI/Flask), especially searching. Right now, it takes 2-3 seconds to search, it seems like this is something with Gradio.

Because Gradio is created by HuggingFace, simple that is

Open LLM Leaderboard org

Hi!
We made this choice for several reasons:

  • it's easy to setup and maintain, and neither @SaylorTwift nor I are front end devs
  • it's fast and responsive enough for most users (especially since the last Gradio update)
  • working closely with the Gradio team allows us to have very fast support when needed, which in turns allows us to support leaderboard users quite fast too

However, we are completely OK with having users creating other ways to access the leaderboard to suit their needs :)

If I change anything like unchecking a checkbox or filter by any word it will stuck at loading infinitely, does anyone get this problem?

Open LLM Leaderboard org

Hi @lixbo ,
I can't reproduce your problem - you need to wait for about 2 seconds for things to update. Please open a dedicated issue if the problem is still happening for you.

@mrfakename Closing this issue, I hope it answered your questions :)

clefourrier changed discussion status to closed

Ok, thanks! That makes sense.

Sign up or log in to comment