Empowering MultiModal Models’ In-Context Learning Ability through Large Language Models-Reference-Cited by-同舟云学术

Empowering MultiModal Models’ In-Context Learning Ability through Large Language Models

Published:2023-07-28 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the ACM Turing Award Celebration Conference - China 2023
language:
Short-container-title:

Author:

Han Wenjuan¹^ORCID,Zhao Haozhe²^ORCID,Cai Zefan²^ORCID

Affiliation:

1. School of Computer and Information Technology, Beijing Jiaotong University, China

2. Peking University, China

Funder

the Talent Fund of Beijing Jiaotong University

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3603165.3607368

Reference10 articles.

1. Tom Brown , Benjamin Mann , Nick Ryder , Melanie Subbiah , Jared D Kaplan , Prafulla Dhariwal , Arvind Neelakantan , Pranav Shyam , Girish Sastry , Amanda Askell , 2020. Language models are few-shot learners. Advances in neural information processing systems 33 ( 2020 ), 1877–1901. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, 2020. Language models are few-shot learners. Advances in neural information processing systems 33 (2020), 1877–1901.

2. VLP: A Survey on Vision-language Pre-training

3. Wenliang Dai , Junnan Li , Dongxu Li , Anthony Meng Huat Tiong , Junqi Zhao, Weisheng Wang, Boyang Li, Pascale Fung, and Steven Hoi. 2023 . InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning . arxiv:2305.06500 [cs.CV] Wenliang Dai, Junnan Li, Dongxu Li, Anthony Meng Huat Tiong, Junqi Zhao, Weisheng Wang, Boyang Li, Pascale Fung, and Steven Hoi. 2023. InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning. arxiv:2305.06500 [cs.CV]

4. What can transformers learn in-context? a case study of simple function classes;Garg Shivam;Advances in Neural Information Processing Systems,2022

5. Junnan Li , Dongxu Li , Silvio Savarese , and Steven Hoi . 2023. Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models. arXiv preprint arXiv:2301.12597 ( 2023 ). Junnan Li, Dongxu Li, Silvio Savarese, and Steven Hoi. 2023. Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models. arXiv preprint arXiv:2301.12597 (2023).