Add model to leaderboard
You may want to add your model to the Huggingface Leaderboard. I wonder, if your model beats https://huggingface.co/MaziyarPanahi/calme-2.1-phi3.5-4b, which apparently also is an uncensored phi-3.5
Feel free to add it for evaluation
I have never tried adding a model to the leaderboard before. It's my first time. Do you know how to deal with the "chat template" option?
I guess it's just about adding {{ bos_token }}{% for message in messages %}{% if (message['role'] == 'system') %}{{'<|system|>' + '\n' + message['content'] + '<|end|>' + '\n'}}{% elif (message['role'] == 'user') %}{{'<|user|>' + '\n' + message['content'] + '<|end|>' + '\n' + '<|assistant|>' + '\n'}}{% elif message['role'] == 'assistant' %}{{message['content'] + '<|end|>' + '\n'}}{% endif %}{% endfor %} or not?
Is it float16 or bfloat16?
Edit: Found FP16 in the model card, so I assume Float16
What type of finetuning did you do? RLHF, DPO or what?
