metadata

pipeline_tag: text-generation
inference: true
license: apache-2.0
datasets:
  - GritLM/tulu2

Model Summary

GritLM is a generative representational instruction tuned language model. It unifies text representation (embedding) and text generation into a single model achieving state-of-the-art performance on both types of tasks.

Repository: ContextualAI/gritlm
Paper: TODO

Model	Description
GritLM 7B	Mistral 7B finetuned using GRIT
GritLM 8x7B	Mixtral 8x7B finetuned using GRIT

Use

The model usage is documented here. It supports GritLM, Transformers, Sentence Transformers.

Citation

TODO