GritLM-8x7B / README.md
Muennighoff's picture
Update README.md
83b89f8 verified
|
raw
history blame
No virus
955 Bytes
metadata
pipeline_tag: text-generation
inference: true
license: apache-2.0
datasets:
  - GritLM/tulu2

Table of Contents

  1. Model Summary
  2. Use
  3. Training
  4. Citation

Model Summary

GritLM is a generative representational instruction tuned language model. It unifies text representation (embedding) and text generation into a single model achieving state-of-the-art performance on both types of tasks.

Model Description
GritLM 7B Mistral 7B finetuned using GRIT
GritLM 8x7B Mixtral 8x7B finetuned using GRIT

Use

The model usage is documented here. It supports GritLM, Transformers, Sentence Transformers.

Citation

TODO