File size: 564 Bytes
d76d3c0 fe33182 f51a904 fe33182 f51a904 |
1 2 3 4 5 6 7 |
---
license: apache-2.0
---
# MoCLE Model Card
[MoCLE](https://arxiv.org/abs/2312.12379) is a Multi-modality Large Language Model (MLLM) with a Mixture-of-Experts (MoE) architecture for instruction customization and generalization based on [InstructBLIP](https://huggingface.co/docs/transformers/model_doc/instructblip).
This repo contains the MoCLE checkpoint with 64 instruction clusters and a routing temperature of 0.05.
Check detailed usage in our [Github repo](https://github.com/gyhdog99/mocle) and [Website](https://kaichen1998.github.io/projects/mocle/). |