README.md

ICE-GRT Model Card

Model Details

ICE-GRT is a chat assistant trained by Reinforcement Learning from Human Feedback (RLHF) by Vicuna model.

• ICE-GRT: Instruction Context Enhancement by Generative Reinforcement based Transformers
• Model type: An auto-regressive language model based on the transformer architecture
• License: The same as lmsys/vicuna-13b-v1.5
• Finetuned from model: lmsys/vicuna-13b-v1.5

Model Sources

Paper 1 (SFT: ICE-Instruct): https://arxiv.org/abs/2310.04945

Paper 2 (RLHF: ICE-GRT): Publish soon!

Uses

The primary use of Vicuna is research on large language models and chatbots. The primary intended users of the model are researchers and hobbyists in natural language processing, machine learning, and artificial intelligence.

Goal: Ice-breaking!

The choice of the acronym "ICE" for ICE-GRT is deliberate. It represents our aspiration to catalyze an 'ice-breaking' moment in the research of LLMs.This reflects our hope to encourage researchers to explore and realize the broad possibilities of ICE-GRT in a range of tasks. We aim to pave the way for novel discoveries and advancements in the field, demonstrating that the capabilities of our model are as extensive and varied as they are innovative.

Model Performance on 12 different Tasks