Testing of an LLMs with already tested remote_code

#208
by Kabumbus - opened
  1. MPT requires use_remote_code=True, it looks like Open LLM Leaderboard tested it.
  2. I created a fine-tuned MPT-Instruct changing 0 lines of their code here Nethermind/Mpt-Instruct-DotNet-S
  3. Could you please add my model to the ranking?

My submission card would look like:

  • Model name Nethermind/Mpt-Instruct-DotNet-S
  • Precision bfloat16
  • Model type⭕ : instruction-tuned
Open LLM Leaderboard org

Hi @Kabumbus ,
With the latest transformers release, we now support MPT models!
You should be able to submit your model to the leaderboard by yourself now, thank you for your patience :)

clefourrier changed discussion status to closed

Sign up or log in to comment