Reason/COT
Collection
12 items
•
Updated
•
3
RA_Reasoner 2.0
Model Details
Developed by: Daemontatox
License: Apache 2.0
Base Model: Daemontatox/RA_Reasoner
This model is fine-tuned from the Falcon-10B-Instruct model, leveraging advanced training optimizations to enhance reasoning and instruction-following capabilities. It was trained 2x faster using Unsloth and Hugging Face's TRL library.
Training Details
- Frameworks Used: Unsloth, Hugging Face TRL
- Fine-Tuning Focus: Emphasis on reasoning, logic-based tasks, and instruction comprehension.
- Dataset: Includes examples from Daemontatox/Deepthinking-COT.
- Optimization: Significant speedup during fine-tuning while maintaining model quality.
Further details on hyperparameters and fine-tuning methodology will be added in future updates.
Intended Use
This model is intended for research and development in text generation, reasoning tasks, and instruction-following applications.
Key Features:
- Enhanced reasoning capabilities for multi-step logical problems.
- Robust instruction-following for complex tasks.
- Fine-tuned for Chain-of-Thought (COT) reasoning and inference.
Applications:
- Research on reasoning-based AI systems.
- Tasks requiring logical deductions, such as question answering and problem-solving.
- General text generation with a focus on nuanced understanding.
Limitations and Warnings
- This model is not designed for real-time or production-critical tasks.
- Outputs may vary based on input specificity and complexity.
- Users are responsible for ensuring ethical use and compliance with applicable regulations.
Acknowledgments
- Base model: Daemontatox/RA_Reasoner
- Training acceleration powered by Unsloth and Hugging Face's TRL library.
- Dataset contributions: Daemontatox/Deepthinking-COT.
---# Open LLM Leaderboard Evaluation Results Detailed results can be found here! Summarized results can be found here!
| Metric | Value (%) |
|---|---|
| Average | 29.00 |
| IFEval (0-Shot) | 53.66 |
| BBH (3-Shot) | 43.07 |
| MATH Lvl 5 (4-Shot) | 22.89 |
| GPQA (0-shot) | 9.96 |
| MuSR (0-shot) | 7.18 |
| MMLU-PRO (5-shot) | 37.26 |
- Downloads last month
- 69
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Model tree for Daemontatox/RA_Reasoner2.0
Base model
tiiuae/Falcon3-10B-Base
Finetuned
tiiuae/Falcon3-10B-Instruct
Finetuned
Daemontatox/RA_Reasoner
Dataset used to train Daemontatox/RA_Reasoner2.0
Collection including Daemontatox/RA_Reasoner2.0
Evaluation results
- averaged accuracy on IFEval (0-Shot)Open LLM Leaderboard53.660
- normalized accuracy on BBH (3-Shot)test set Open LLM Leaderboard43.070
- exact match on MATH Lvl 5 (4-Shot)test set Open LLM Leaderboard22.890
- acc_norm on GPQA (0-shot)Open LLM Leaderboard9.960
- acc_norm on MuSR (0-shot)Open LLM Leaderboard7.180
- accuracy on MMLU-PRO (5-shot)test set Open LLM Leaderboard37.260