MultiViz: Towards User-Centric Visualizations and Interpretations of Multimodal Models-Reference-Cited by-同舟云学术

MultiViz: Towards User-Centric Visualizations and Interpretations of Multimodal Models

Published:2023-04-19 Issue: Volume: Page:
ISSN:
Container-title:Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
language:
Short-container-title:

Author:

Liang Paul Pu¹^ORCID,Lyu Yiwei²^ORCID,Chhablani Gunjan³^ORCID,Jain Nihal⁴^ORCID,Deng Zihao⁵^ORCID,Wang Xingbo⁶^ORCID,Morency Louis-Philippe⁷^ORCID,Salakhutdinov Ruslan⁴^ORCID

Affiliation:

1. Machine Learning Department, Carnegie Mellon University, United States

2. University of Michigan, United States

3. Georgia Institute of Technology, United States

4. Carnegie Mellon University, United States

5. University of Pennsylvania, United States

6. Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, China

7. Language Technologies Institute, Carnegie Mellon University, United States

Funder

National Institutes of Health

National Science Foundation

Meta

BMW of North America

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3544549.3585604

Reference100 articles.

1. Julius Adebayo , Justin Gilmer , Michael Muelly , Ian J. Goodfellow , Moritz Hardt , and Been Kim . 2018. Sanity Checks for Saliency Maps. CoRR abs/1810.03292 ( 2018 ). arXiv:1810.03292http://arxiv.org/abs/1810.03292 Julius Adebayo, Justin Gilmer, Michael Muelly, Ian J. Goodfellow, Moritz Hardt, and Been Kim. 2018. Sanity Checks for Saliency Maps. CoRR abs/1810.03292 (2018). arXiv:1810.03292http://arxiv.org/abs/1810.03292

2. Saeed Amizadeh , Hamid Palangi , Alex Polozov , Yichen Huang , and Kazuhito Koishida . 2020 . Neuro-Symbolic Visual Reasoning: Disentangling Visual from Reasoning . In International Conference on Machine Learning. PMLR, 279–290 . Saeed Amizadeh, Hamid Palangi, Alex Polozov, Yichen Huang, and Kazuhito Koishida. 2020. Neuro-Symbolic Visual Reasoning: Disentangling Visual from Reasoning. In International Conference on Machine Learning. PMLR, 279–290.

3. Ankesh Anand , Eugene Belilovsky , Kyle Kastner , Hugo Larochelle , and Aaron Courville . 2018. Blindfold baselines for embodied QA. arXiv preprint arXiv:1811.05013 ( 2018 ). Ankesh Anand, Eugene Belilovsky, Kyle Kastner, Hugo Larochelle, and Aaron Courville. 2018. Blindfold baselines for embodied QA. arXiv preprint arXiv:1811.05013 (2018).

4. Neural Module Networks

5. VQA: Visual Question Answering