File size: 1,841 Bytes
36877d4 bb5408e 36877d4 360ab62 7df4525 a0bcf5f 1380629 296854f 5f86cd7 e30a42a 5406276 296854f 5457ee3 c49837f 132ea2c f00bdc5 132ea2c b45f922 132ea2c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 |
---
license: llama2
pipeline_tag: image-text-to-text
---
# UGround
UGround is a storng GUI visual grounding model trained with a simple recipe. Check our homepage and paper for more details.
- **Homepage:** https://osu-nlp-group.github.io/UGround/
- **Repository:** https://github.com/OSU-NLP-Group/UGround
- **Paper:** https://arxiv.org/abs/2410.05243
- **Demo:** https://huggingface.co/spaces/orby-osu/UGround
- **Point of Contact:** [Boyu Gou](mailto:gou.43@osu.edu)
- [x] Model Weights
- [ ] Code
- [ ] Inference Code of UGround
- [x] Offline Experiments
- [x] Screenspot (along with referring expressions generated by GPT-4/4o)
- [x] Multimodal-Mind2Web
- [x] OmniAct
- [ ] Online Experiments
- [ ] Mind2Web-Live
- [ ] AndroidWorld
- [ ] Data
- [ ] Data Examples
- [ ] Data Construction Scripts
- [ ] Guidance of Open-source Data
- [x] Online Demo (HF Spaces)
## Citation Information
If you find this work useful, please consider citing our papers:
```
@article{gou2024uground,
title={Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents},
author={Boyu Gou and Ruohan Wang and Boyuan Zheng and Yanan Xie and Cheng Chang and Yiheng Shu and Huan Sun and Yu Su},
journal={arXiv preprint arXiv:2410.05243},
year={2024},
url={https://arxiv.org/abs/2410.05243},
}
@article{zheng2023seeact,
title={GPT-4V(ision) is a Generalist Web Agent, if Grounded},
author={Boyuan Zheng and Boyu Gou and Jihyung Kil and Huan Sun and Yu Su},
journal={arXiv preprint arXiv:2401.01614},
year={2024},
}
```
|