ayoubkirouane
commited on
Commit
•
b756a48
1
Parent(s):
bd54dfb
Update README.md
Browse files
README.md
CHANGED
@@ -7,8 +7,21 @@ language:
|
|
7 |
pipeline_tag: image-text-to-text
|
8 |
---
|
9 |
|
10 |
-
##
|
11 |
- google/paligemma-3b-pt-224
|
12 |
|
13 |
-
##
|
14 |
-
- HuggingFaceM4/VQAv2
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
7 |
pipeline_tag: image-text-to-text
|
8 |
---
|
9 |
|
10 |
+
## Base model :
|
11 |
- google/paligemma-3b-pt-224
|
12 |
|
13 |
+
## Dataset :
|
14 |
+
- HuggingFaceM4/VQAv2
|
15 |
+
|
16 |
+
|
17 |
+
## Getting started :
|
18 |
+
|
19 |
+
```python
|
20 |
+
from peft import PeftModel, PeftConfig
|
21 |
+
from transformers import AutoModelForCausalLM
|
22 |
+
|
23 |
+
config = PeftConfig.from_pretrained("ayoubkirouane/PaliGemma-VQAv2-Lora-finetuned")
|
24 |
+
base_model = AutoModelForCausalLM.from_pretrained("google/paligemma-3b-pt-224")
|
25 |
+
model = PeftModel.from_pretrained(base_model, "ayoubkirouane/PaliGemma-VQAv2-Lora-finetuned")
|
26 |
+
|
27 |
+
```
|