---
pipeline_tag: text-generation
tags:
- Neuron
- Optimum-Neuron
- AWS
---


Compiled Mistral-7B-Instruct-v0.2 using optimum-neuron

```
optimum-cli export neuron  --model mistralai/Mistral-7B-Instruct-v0.2 --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16  ./models/mistralai/Mistral-7B-Instruct-v0.2
```