Retrieval-based Knowledge Augmented Vision Language Pre-training-Reference-Cited by-同舟云学术

Retrieval-based Knowledge Augmented Vision Language Pre-training

Published:2023-10-26 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 31st ACM International Conference on Multimedia
language:
Short-container-title:

Author:

Rao Jiahua¹^ORCID,Shan Zifei²^ORCID,Liu Longpo²^ORCID,Zhou Yao²^ORCID,Yang Yuedong¹^ORCID

Affiliation:

1. Sun Yat-sen University, Guangzhou, China

2. Tencent, Shenzhen, China

Funder

National Natural Science Foundation of China

Guangdong Key Field Research and Development Plan

Guangzhou S&T Research Plan

National Key Research and Development Program of China

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3581783.3613848

Reference43 articles.

1. VQA: Visual Question Answering

2. Antoine Bordes , Nicolas Usunier , Alberto Garcia-Duran , Jason Weston , and Oksana Yakhnenko . 2013. Translating embeddings for modeling multi-relational data. Advances in neural information processing systems , Vol. 26 ( 2013 ). Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. 2013. Translating embeddings for modeling multi-relational data. Advances in neural information processing systems, Vol. 26 (2013).

3. Soravit Changpinyo Piyush Sharma Nan Ding and Radu Soricut. 2021. Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Concepts. In CVPR. Soravit Changpinyo Piyush Sharma Nan Ding and Radu Soricut. 2021. Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Concepts. In CVPR.

4. Kezhen Chen , Qiuyuan Huang , Yonatan Bisk , Daniel McDuff , and Jianfeng Gao . 2021 . Kb-vlp: Knowledge based vision and language pretraining. In ICML , workshop. Kezhen Chen, Qiuyuan Huang, Yonatan Bisk, Daniel McDuff, and Jianfeng Gao. 2021. Kb-vlp: Knowledge based vision and language pretraining. In ICML, workshop.

5. Wenhu Chen , Hexiang Hu , Xi Chen , Pat Verga , and William W Cohen . 2022a. MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text. arXiv preprint arXiv:2210.02928 ( 2022 ). Wenhu Chen, Hexiang Hu, Xi Chen, Pat Verga, and William W Cohen. 2022a. MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text. arXiv preprint arXiv:2210.02928 (2022).

Cited by 2 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Representation and Fusion Based on Knowledge Graph in Multi-Modal Semantic Communication;IEEE Wireless Communications Letters;2024-05

2. Multimodal Large Language Models: A Survey;2023 IEEE International Conference on Big Data (BigData);2023-12-15