Update README.md
Browse files
README.md
CHANGED
@@ -1,12 +1,12 @@
|
|
1 |
---
|
2 |
-
license:
|
3 |
language:
|
4 |
- en
|
5 |
widget:
|
6 |
- text: >
|
7 |
-
'[CLS]\nQuestion: Are there any pedestrians crossing the road? If yes, how
|
|
|
8 |
example_title: Counting
|
9 |
-
|
10 |
tags:
|
11 |
- vision-language
|
12 |
- autonomous-driving
|
@@ -16,6 +16,9 @@ tags:
|
|
16 |
Lingo-Judge, a novel evaluation metric that aligns closely with human judgment on the LingoQA evaluation suite.
|
17 |
|
18 |
### How to use
|
|
|
|
|
|
|
19 |
```python
|
20 |
# Import necessary libraries
|
21 |
from transformers import pipeline
|
@@ -39,4 +42,17 @@ result = pipe(input)
|
|
39 |
# Print the result and score
|
40 |
score = result[0]['score']
|
41 |
print(score > 0.5, score)
|
|
|
|
|
|
|
|
|
|
|
42 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
+
license: other
|
3 |
language:
|
4 |
- en
|
5 |
widget:
|
6 |
- text: >
|
7 |
+
'[CLS]\nQuestion: Are there any pedestrians crossing the road? If yes, how
|
8 |
+
many?\nAnswer: 1\nStudent: One'
|
9 |
example_title: Counting
|
|
|
10 |
tags:
|
11 |
- vision-language
|
12 |
- autonomous-driving
|
|
|
16 |
Lingo-Judge, a novel evaluation metric that aligns closely with human judgment on the LingoQA evaluation suite.
|
17 |
|
18 |
### How to use
|
19 |
+
For LingoQA datasets and benchmark, please see https://github.com/wayveai/LingoQA
|
20 |
+
|
21 |
+
Try out this simple example of using Lingo-Judge:
|
22 |
```python
|
23 |
# Import necessary libraries
|
24 |
from transformers import pipeline
|
|
|
42 |
# Print the result and score
|
43 |
score = result[0]['score']
|
44 |
print(score > 0.5, score)
|
45 |
+
```
|
46 |
+
|
47 |
+
|
48 |
+
### Citation
|
49 |
+
If you find our work useful in your research, please consider citing:
|
50 |
|
51 |
+
```bibtex
|
52 |
+
@article{marcu2023lingoqa,
|
53 |
+
title={LingoQA: Video Question Answering for Autonomous Driving},
|
54 |
+
author={Ana-Maria Marcu and Long Chen and Jan Hünermann and Alice Karnsund and Benoit Hanotte and Prajwal Chidananda and Saurabh Nair and Vijay Badrinarayanan and Alex Kendall and Jamie Shotton and Oleg Sinavski},
|
55 |
+
journal={arXiv preprint arXiv:2312.14115},
|
56 |
+
year={2023},
|
57 |
+
}
|
58 |
+
```
|