README.md

---
license: apache-2.0
datasets:
- gokaygokay/random_instruct_docci
language:
- en
pipeline_tag: image-text-to-text
---

Fine tuned version of [xtuner/llava-llama-3-8b-v1_1](https://huggingface.co/xtuner/llava-llama-3-8b-v1_1) on [gokaygokay/random_instruct_docci](https://huggingface.co/datasets/gokaygokay/random_instruct_docci) dataset.  

```
pip install git+https://github.com/haotian-liu/LLaVA.git --no-deps
pip install lmdeploy
```
```python
# Google Colab Error Fix
import nest_asyncio
nest_asyncio.apply()
```

```python
from lmdeploy import pipeline
from lmdeploy.vl import load_image

pipe = pipeline('gokaygokay/llava-llama3-docci')

image = load_image('https://raw.githubusercontent.com/open-mmlab/mmdeploy/main/tests/data/tiger.jpeg')
response = pipe(('describe this image', image))
print(response)
```