metadata
library_name: transformers
datasets:
- HuggingFaceM4/VQAv2
language:
- en
pipeline_tag: image-text-to-text
license: gemma
Base model :
- google/paligemma-3b-pt-224
Dataset :
- HuggingFaceM4/VQAv2
Getting started :
from peft import PeftModel, PeftConfig
from transformers import AutoModelForCausalLM
config = PeftConfig.from_pretrained("ayoubkirouane/PaliGemma-VQAv2-Lora-finetuned")
base_model = AutoModelForCausalLM.from_pretrained("google/paligemma-3b-pt-224")
model = PeftModel.from_pretrained(base_model, "ayoubkirouane/PaliGemma-VQAv2-Lora-finetuned")