WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semantics-Reference-Cited by-同舟云学术

WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semantics

Published:2023-04-19 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
language:
Short-container-title:

Author:

Wu Jason¹^ORCID,Wang Siyan²^ORCID,Shen Siman³^ORCID,Peng Yi-Hao¹^ORCID,Nichols Jeffrey⁴^ORCID,Bigham Jeffrey P¹^ORCID

Affiliation:

1. Human-Computer Interaction Institute, Carnegie Mellon University, United States

2. Wellesley College, United States

3. Grinnell College, United States

4. Snooty Bird LLC, United States

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3544548.3581158

Reference55 articles.

1. 2022. AutoIt Function PixelSearch. https://www.autoitscript.com/autoit3/docs/functions/PixelSearch.htm. 2022. AutoIt Function PixelSearch. https://www.autoitscript.com/autoit3/docs/functions/PixelSearch.htm.

2. 2022. Chrome DevTools engineering blog Full Accessibility Tree in Chrome DevTools. https://developer.chrome.com/blog/full-accessibility-tree/. Accessed: 2022-09-15. 2022. Chrome DevTools engineering blog Full Accessibility Tree in Chrome DevTools. https://developer.chrome.com/blog/full-accessibility-tree/. Accessed: 2022-09-15.

3. 2022. Puppeteer - Chrome. https://developer.chrome.com/docs/puppeteer/. Accessed: 2022-09-15. 2022. Puppeteer - Chrome. https://developer.chrome.com/docs/puppeteer/. Accessed: 2022-09-15.

4. 2022. What is the ideal screen size for responsive design?https://www.browserstack.com/guide/ideal-screen-sizes-for-responsive-design. Accessed: 2022-09-15. 2022. What is the ideal screen size for responsive design?https://www.browserstack.com/guide/ideal-screen-sizes-for-responsive-design. Accessed: 2022-09-15.

5. Translating Video Recordings of Complex Mobile App UI Gestures into Replayable Scenarios

Cited by 14 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. UI semantic component group detection: Grouping UI elements with similar semantics in mobile graphical user interface;Displays;2024-07

2. Automating the Enterprise with Foundation Models;Proceedings of the VLDB Endowment;2024-07

3. On-device query intent prediction with lightweight LLMs to support ubiquitous conversations;Scientific Reports;2024-06-03

4. WiP: A Solution for Reducing MLLM-Based Agent Interaction Overhead;Proceedings of the Workshop on Edge and Mobile Foundation Models;2024-06-03

5. Computational Methodologies for Understanding, Automating, and Evaluating User Interfaces;Extended Abstracts of the CHI Conference on Human Factors in Computing Systems;2024-05-11