3rd-Degree-Burn/Llama-3.1-8B-Squareroot-v0

Llama-3.1-8B-Squareroot

This is a TIES merge that combines the performance of the following models:

• NousResearch/Meta-Llama-3.1-8B-Instruct
• EpistemeAI/Fireball-Alpaca-Llama3.1.07-8B-Philos-Math-KTO-beta
• nvidia/OpenMath2-Llama3.1-8B

Disclaimer: This one's a failed attempt. Working on a better version, so check back soon!

Benchmarks

The model ranks in the top 5 for MATH benchmarks but performs severely badly on others (which isn't quite what I was expecting). I’m hoping to improve its general abilities without losing its math skills. Qwen still has the top spot :(