File size: 817 Bytes
74585d2
 
8955e2f
 
 
 
 
74585d2
 
cfc3826
679c1b4
74585d2
 
 
 
d6f21f4
 
 
 
 
74585d2
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
---
license: apache-2.0
datasets:
- gokaygokay/random_instruct_docci
language:
- en
pipeline_tag: image-text-to-text
---

Fine tuned version of [xtuner/llava-llama-3-8b-v1_1](https://huggingface.co/xtuner/llava-llama-3-8b-v1_1) on [gokaygokay/random_instruct_docci](https://huggingface.co/datasets/gokaygokay/random_instruct_docci) dataset.  

```
pip install git+https://github.com/haotian-liu/LLaVA.git --no-deps
pip install lmdeploy
```
```python
# Google Colab Error Fix
import nest_asyncio
nest_asyncio.apply()
```

```python
from lmdeploy import pipeline
from lmdeploy.vl import load_image

pipe = pipeline('gokaygokay/llava-llama3-docci')

image = load_image('https://raw.githubusercontent.com/open-mmlab/mmdeploy/main/tests/data/tiger.jpeg')
response = pipe(('describe this image', image))
print(response)
```