XAI/vlmsareblind
Viewer
•
Updated
•
8.02k
•
121
•
21
Logan Bolton
loganbolton
AI & ML interests
Computer Vision, Explainable AI, NLP
Recent Activity
updated
a dataset
6 days ago
XAI/vlmsareblind
upvoted
a
paper
29 days ago
GPT-4o System Card
Organizations
loganbolton's activity
updated
a
dataset
6 days ago
upvoted
a
paper
29 days ago
upvoted
2
papers
3 months ago
upvoted
a
paper
4 months ago
liked
a
Space
4 months ago
upvoted
a
paper
4 months ago
Reacted to
Taylor658's
post with 🔥
5 months ago
Post
805
Researchers from Auburn University and the University of Alberta have explored the limitations of Vision Language Models (VLMs) in their recently published paper titled "Vision language models are blind." (
Vision language models are blind (2407.06581))
Key Findings:🔍
VLMs, including GPT-4o, Gemini-1.5 Pro, Claude-3 Sonnet, and Claude-3.5 Sonnet, struggle with basic visual tasks.
Tasks such as identifying where lines intersect or counting basic shapes are challenging for these models.
The authors noted, "The shockingly poor performance of four state-of-the-art VLMs suggests their vision is, at best, like of a person with myopia seeing fine details as blurry, and at worst, like an intelligent person that is blind making educated guesses"(Vision Language Models Are Blind; 2024).
Human-like Myopia? 👓
VLMs may have a blind spot similar to human myopia.
This limitation makes it difficult for VLMs to perceive details.
Suggests a potential parallel between human and machine vision limitations.
Technical Details: 🔧
The researchers created a new benchmark called BlindTest.
BlindTest consists of simple visual tasks to evaluate VLMs low-level vision capabilities.
Four VLMs were assessed using BlindTest.
Many shortcomings were revealed in the models ability to process basic visual information.
Learn More: 🖼️
For a deeper dive into this research, check out the project page: https://vlmsareblind.github.io/
Key Findings:🔍
VLMs, including GPT-4o, Gemini-1.5 Pro, Claude-3 Sonnet, and Claude-3.5 Sonnet, struggle with basic visual tasks.
Tasks such as identifying where lines intersect or counting basic shapes are challenging for these models.
The authors noted, "The shockingly poor performance of four state-of-the-art VLMs suggests their vision is, at best, like of a person with myopia seeing fine details as blurry, and at worst, like an intelligent person that is blind making educated guesses"(Vision Language Models Are Blind; 2024).
Human-like Myopia? 👓
VLMs may have a blind spot similar to human myopia.
This limitation makes it difficult for VLMs to perceive details.
Suggests a potential parallel between human and machine vision limitations.
Technical Details: 🔧
The researchers created a new benchmark called BlindTest.
BlindTest consists of simple visual tasks to evaluate VLMs low-level vision capabilities.
Four VLMs were assessed using BlindTest.
Many shortcomings were revealed in the models ability to process basic visual information.
Learn More: 🖼️
For a deeper dive into this research, check out the project page: https://vlmsareblind.github.io/
authored
a
paper
5 months ago
upvoted
a
paper
5 months ago
liked
a
dataset
5 months ago