mistralai/Mistral-7B-v0.1

Text Generation • Updated Jul 24 • 390k • • 3.44k

Note The base model we aligned with Constitutional AI

HuggingFaceH4/mistral-7b-grok

Text Generation • Updated Feb 1 • 968 • 43

Note A fine-tuned version of Mistral 7B that was aligned to mimic the style of xAI's Grok assistant.

HuggingFaceH4/mistral-7b-anthropic

Text Generation • Updated Feb 1 • 1.35k • 7

Note A fine-tuned version of Mistral 7B that was aligned with Anthropic's constitution to mimic the style of their assistants.

mistralai/Mistral-7B-Instruct-v0.1

Text Generation • Updated Aug 22 • 196k • 1.52k

Note The chat model we used to generate the Constitutional AI datasets via self-critique

Note The source of prompts used to generate Constitutional AI datasets

Note The SFT and preference dataset that was generated via Anthropic's constitution.

Note The SFT and preference dataset that was generated by tweaking Anthropic's constitution to produces responses similar to Grok.

Note The original recipe from Anthropic on Consitutional AI. Note they used PPO for alignments, while we chose to use DPO as we find it much simpler to use in practice.