---
license: apache-2.0
datasets:
- mlfoundations/dclm-baseline-1.0-parquet
---
<style>
table {
    border-collapse: collapse;
    width: 100%;
    margin-bottom: 20px;
}
th, td {
    border: 1px solid #ddd;
    padding: 8px;
    text-align: center;
}
.best {
    font-weight: bold;
    text-decoration: underline;
}
</style>

<div style="text-align: center; margin: 20px auto; padding: 20px; border: 3px solid #ddd; border-radius: 10px;">
  <h2 style="margin-bottom: 4px; margin-top: 0px;">OuteAI</h2>
  <a href="https://www.outeai.com/" target="_blank" style="margin-right: 10px;">🌎 OuteAI.com</a> 
  <a href="https://discord.gg/vyBM87kAmf" target="_blank" style="margin-right: 10px;">🤝 Join our Discord</a>
  <a href="https://x.com/OuteAI" target="_blank">𝕏 @OuteAI</a>
</div>

### Experimental Development Models

These development models are designed specifically for **experimental and testing purposes**. 

They have been trained using our pre-trained **BPE tokenizer** with a vocabulary size of 61,440. 

#### Model Details:
- **[Oute-Dev-0.7B-Checkpoint-40B](https://huggingface.co/OuteAI/Oute-Dev-0.7B-Checkpoint-40B)**: Built on the **Phi3 architecture**, trained on approximately **40 billion tokens**.
- **[Oute-Dev-1B-Checkpoint-40B](https://huggingface.co/OuteAI/Oute-Dev-1B-Checkpoint-40B)**: Built on the **LLaMa architecture**, trained on approximately **40 billion tokens**.

> [!IMPORTANT]
> These models were initially developed for internal testing and did not undergo extensive training.

### Benchmark Performance:

<table>
<tr>
    <th>Benchmark</th>
    <th>Oute-Dev-0.7B-Checkpoint-40B</th>
    <th>Oute-Dev-1B-Checkpoint-40B</th>
</tr>
<tr>
    <td>ARC-C (0-shot)</td>
    <td>28.24</td>
    <td>26.19</td>
</tr>
<tr>
    <td>ARC-E (0-shot)</td>
    <td>55.13</td>
    <td>57.32</td>
</tr>
<tr>
    <td>HellaSWAG (0-shot)</td>
    <td>41.20</td>
    <td>43.70</td>
</tr>
<tr>
    <td>PIQA (0-shot)</td>
    <td>68.39</td>
    <td>69.59</td>
</tr>
<tr>
    <td>Winogrande (0-shot)</td>
    <td>54.14</td>
    <td>50.51</td>
</tr>
</table>

## Disclaimer
By using this model, you acknowledge that you understand and assume the risks associated with its use. 
You are solely responsible for ensuring compliance with all applicable laws and regulations. 
We disclaim any liability for problems arising from the use of this open-source model, including but not limited to direct, indirect, incidental, consequential, or punitive damages. 
We make no warranties, express or implied, regarding the model's performance, accuracy, or fitness for a particular purpose. Your use of this model is at your own risk, and you agree to hold harmless and indemnify us, our affiliates, and our contributors from any claims, damages, or expenses arising from your use of the model.