Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,35 @@
|
|
1 |
-
---
|
2 |
-
license: cc-by-nc-sa-4.0
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: cc-by-nc-sa-4.0
|
3 |
+
library_name: transformers
|
4 |
+
pipeline_tag: text-generation
|
5 |
+
tags:
|
6 |
+
- Eagle
|
7 |
+
- VLM
|
8 |
+
---
|
9 |
+
|
10 |
+
# Eagle Model Card
|
11 |
+
|
12 |
+
## Model details
|
13 |
+
|
14 |
+
**Model type:**
|
15 |
+
Eagle is a family of Vision-Centric High-Resolution Multimodal LLMs. It presents a thorough exploration to strengthen multimodal LLM perception with a mixture of vision encoders and different input resolutions. The model contains a channel-concatenation-based "CLIP+X" fusion for vision experts with different architectures (ViT/ConvNets) and knowledge (detection/segmentation/OCR/SSL). The resulting family of Eagle models support up to over 1K input resolution and obtain strong results on multimodal LLM benchmarks, especially resolution-sensitive tasks such as optical character recognition and document understanding.
|
16 |
+
|
17 |
+
|
18 |
+
**Paper or resources for more information:**
|
19 |
+
https://github.com/NVlabs/Eagle
|
20 |
+
|
21 |
+
```
|
22 |
+
```
|
23 |
+
|
24 |
+
## License
|
25 |
+
- The code is released under the Apache 2.0 license as found in the [LICENSE](./LICENSE) file.
|
26 |
+
- The pretrained weights are released under the [CC-BY-NC-SA-4.0 license](https://creativecommons.org/licenses/by-nc-sa/4.0/deed.en).
|
27 |
+
- The service is a research preview intended for non-commercial use only, and is subject to the following licenses and terms:
|
28 |
+
- [Model License](https://github.com/facebookresearch/llama/blob/main/MODEL_CARD.md) of LLaMA
|
29 |
+
- [Terms of Use](https://openai.com/policies/terms-of-use) of the data generated by OpenAI
|
30 |
+
- [Dataset Licenses](https://github.com/Efficient-Large-Model/VILA/blob/main/data_prepare/LICENSE) for each one used during training.
|
31 |
+
|
32 |
+
**Where to send questions or comments about the model:**
|
33 |
+
https://github.com/NVlabs/Eagle/issues
|
34 |
+
|
35 |
+
|