Do Vision-Language Transformers Exhibit Visual Commonsense? An Empirical Study of VCR-Reference-Cited by-同舟云学术

Do Vision-Language Transformers Exhibit Visual Commonsense? An Empirical Study of VCR

Published:2023-10-26 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 31st ACM International Conference on Multimedia
language:
Short-container-title:

Author:

Li Zhenyang¹^ORCID,Guo Yangyang²^ORCID,Wang Kejie¹^ORCID,Chen Xiaolin³^ORCID,Nie Liqiang⁴^ORCID,Kankanhalli Mohan²^ORCID

Affiliation:

1. Shandong University, Qingdao, China

2. National University of Singapore, Singapore, Singapore

3. Shandong University, Jinan, China

4. Harbin Institute of Technology, Shenzhen, Shenzhen, China

Funder

the National Research Foundation, Singapore

the National Natural Science Foundation of China

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3581783.3612395

Reference51 articles.

1. Peter Anderson , Xiaodong He , Chris Buehler , Damien Teney , Mark Johnson , Stephen Gould , and Lei Zhang . 2018 . Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering. In IEEE Conference on Computer Vision and Pattern Recognition. 6077--6086 . Peter Anderson, Xiaodong He, Chris Buehler, Damien Teney, Mark Johnson, Stephen Gould, and Lei Zhang. 2018. Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering. In IEEE Conference on Computer Vision and Pattern Recognition. 6077--6086.

2. Stanislaw Antol , Aishwarya Agrawal , Jiasen Lu , Margaret Mitchell , Dhruv Batra , C. Lawrence Zitnick , and Devi Parikh . 2015 . VQA: Visual Question Answering. In IEEE International Conference on Computer Vision. 2425--2433 . Stanislaw Antol, Aishwarya Agrawal, Jiasen Lu, Margaret Mitchell, Dhruv Batra, C. Lawrence Zitnick, and Devi Parikh. 2015. VQA: Visual Question Answering. In IEEE International Conference on Computer Vision. 2425--2433.

3. Nicolas Carion , Francisco Massa , Gabriel Synnaeve , Nicolas Usunier , Alexander Kirillov , and Sergey Zagoruyko . 2020 . End-to-End Object Detection with Transformers. In European Conference on Computer Vision , Vol. 12346 . 213--229. Nicolas Carion, Francisco Massa, Gabriel Synnaeve, Nicolas Usunier, Alexander Kirillov, and Sergey Zagoruyko. 2020. End-to-End Object Detection with Transformers. In European Conference on Computer Vision, Vol. 12346. 213--229.

4. Yen-Chun Chen , Linjie Li , Licheng Yu , Ahmed El Kholy , Faisal Ahmed , Zhe Gan , Yu Cheng , and Jingjing Liu . 2020 . UNITER: UNiversal Image-TExt Representation Learning. In European Conference on Computer Vision. 104--120 . Yen-Chun Chen, Linjie Li, Licheng Yu, Ahmed El Kholy, Faisal Ahmed, Zhe Gan, Yu Cheng, and Jingjing Liu. 2020. UNITER: UNiversal Image-TExt Representation Learning. In European Conference on Computer Vision. 104--120.

5. Jaemin Cho , Jie Lei , Hao Tan , and Mohit Bansal . 2021 . Unifying Vision-and-Language Tasks via Text Generation . In International Conference on Machine Learning. 1931--1942 . Jaemin Cho, Jie Lei, Hao Tan, and Mohit Bansal. 2021. Unifying Vision-and-Language Tasks via Text Generation. In International Conference on Machine Learning. 1931--1942.