ECE-ILAB-Q1
This model has been produced by :
- Louis Garcia, engineering student at French Engineering School ECE
- Matthieu Jollard, engineering student at French Engineering School ECE
- Andre-Louis Rochet, Lecturer at ECE & Co-Founder of TW3 Partners
- Paul Lemaistre, CTO of TW3 Partners
With the contribution of :
- ECE engineering school as sponsor
About ECE
ECE, a multi-program, multi-campus, and multi-sector engineering school specializing in digital engineering, trains engineers and technology experts for the 21st century, capable of meeting the challenges of the dual digital and sustainable development revolutions. French Engineering School ECE
merge-qwen2-72B is a merge of the following models using mergekit:
🧩 Configuration
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 40.93 |
| IFEval (0-Shot) | 78.65 |
| BBH (3-Shot) | 53.70 |
| MATH Lvl 5 (4-Shot) | 26.13 |
| GPQA (0-shot) | 18.23 |
| MuSR (0-shot) | 18.81 |
| MMLU-PRO (5-shot) | 50.06 |
- Downloads last month
- 2,503
Inference API (serverless) is not available, repository is disabled.
Evaluation results
- strict accuracy on IFEval (0-Shot)Open LLM Leaderboard78.650
- normalized accuracy on BBH (3-Shot)Open LLM Leaderboard53.700
- exact match on MATH Lvl 5 (4-Shot)Open LLM Leaderboard26.130
- acc_norm on GPQA (0-shot)Open LLM Leaderboard18.230
- acc_norm on MuSR (0-shot)Open LLM Leaderboard18.810
- accuracy on MMLU-PRO (5-shot)test set Open LLM Leaderboard50.060