Experiencing InstructPipe: Building Multi-modal AI Pipelines via Prompting LLMs and Visual Programming-Reference-Cited by-同舟云学术

Experiencing InstructPipe: Building Multi-modal AI Pipelines via Prompting LLMs and Visual Programming

Published:2024-05-11 Issue: Volume:24 Page:1-5
ISSN:
Container-title:Extended Abstracts of the CHI Conference on Human Factors in Computing Systems
language:
Short-container-title:

Author:

Zhou Zhongyi¹^ORCID,Jin Jing²^ORCID,Phadnis Vrushank²^ORCID,Yuan Xiuxiu²^ORCID,Jiang Jun²^ORCID,Qian Xun²^ORCID,Zhou Jingtao³^ORCID,Huang Yiyi²^ORCID,Xu Zheng²^ORCID,Zhang Yinda²^ORCID,Wright Kristen²^ORCID,Mayes Jason²^ORCID,Sherwood Mark²^ORCID,Lee Johnny²^ORCID,Olwal Alex²^ORCID,Kim David⁴^ORCID,Iyengar Ram²^ORCID,Li Na²^ORCID,Du Ruofei²^ORCID

Affiliation:

1. The University of Tokyo, Japan

2. Google Research, United States

3. Google Research, USA

4. Google Research, Switzerland

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3613905.3648656

Reference16 articles.

1. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. https://www.tensorflow.org/ Software available from tensorflow.org.

2. A morphological analysis of the design space of input devices

3. Xi Chen Josip Djolonga Piotr Padlewski Basil Mustafa Soravit Changpinyo Jialin Wu Carlos Riquelme Ruiz Sebastian Goodman Xiao Wang Yi Tay Siamak Shakeri Mostafa Dehghani Daniel Salz Mario Lucic Michael Tschannen Arsha Nagrani Hexiang Hu Mandar Joshi Bo Pang Ceslee Montgomery Paulina Pietrzyk Marvin Ritter AJ Piergiovanni Matthias Minderer Filip Pavetic Austin Waters Gang Li Ibrahim Alabdulmohsin Lucas Beyer Julien Amelot Kenton Lee Andreas Peter Steiner Yang Li Daniel Keysers Anurag Arnab Yuanzhong Xu Keran Rong Alexander Kolesnikov Mojtaba Seyedhosseini Anelia Angelova Xiaohua Zhai Neil Houlsby and Radu Soricut. 2023. PaLI-X: On Scaling Up a Multilingual Vision and Language Model. arxiv:2305.18565 [cs.CV]

4. Xi Chen Xiao Wang Soravit Changpinyo AJ Piergiovanni Piotr Padlewski Daniel Salz Sebastian Goodman Adam Grycner Basil Mustafa Lucas Beyer Alexander Kolesnikov Joan Puigcerver Nan Ding Keran Rong Hassan Akbari Gaurav Mishra Linting Xue Ashish Thapliyal James Bradbury Weicheng Kuo Mojtaba Seyedhosseini Chao Jia Burcu Karagol Ayan Carlos Riquelme Andreas Steiner Anelia Angelova Xiaohua Zhai Neil Houlsby and Radu Soricut. 2023. PaLI: A Jointly-Scaled Multilingual Language-Image Model. arxiv:2209.06794 [cs.CV]

5. PaLM: Scaling Language Modeling with Pathways;Chowdhery Aakanksha;Journal of Machine Learning Research,2023