Auto-Icon+ : An Automated End-to-End Code Generation Tool for Icon Designs in UI Development

Author:

Feng Sidong1ORCID,Jiang Minmin2ORCID,Zhou Tingting2ORCID,Zhen Yankun2ORCID,Chen Chunyang1ORCID

Affiliation:

1. Monash University, Melbourne, Victoria, Australia

2. Alibaba Group, Hangzhou, Zhejiang, China

Abstract

Approximately 50% of development resources are devoted to user interface (UI) development tasks [ 9 ]. Occupying a large proportion of development resources, developing icons can be a time-consuming task, because developers need to consider not only effective implementation methods but also easy-to-understand descriptions. In this article, we present Auto-Icon+ , an approach for automatically generating readable and efficient code for icons from design artifacts. According to our interviews to understand the gap between designers (icons are assembled from multiple components) and developers (icons as single images), we apply a heuristic clustering algorithm to compose the components into an icon image. We then propose an approach based on a deep learning model and computer vision methods to convert the composed icon image to fonts with descriptive labels, thereby reducing the laborious manual effort for developers and facilitating UI development. We quantitatively evaluate the quality of our method in the real-world UI development environment and demonstrate that our method offers developers accurate, efficient, readable, and usable code for icon designs, in terms of saving 65.2% implementing time.

Publisher

Association for Computing Machinery (ACM)

Subject

Artificial Intelligence,Human-Computer Interaction

Reference112 articles.

1. Rakesh Agrawal and Ramakrishnan Srikant. 1994. Fast algorithms for mining association rules. In Proceedings of the 20th International Conference on Very Large Data Bases (VLDB’94), Vol. 1215. 487–499.

2. Sketching Interfaces: Generating Code from Low Fidelity Wireframes;https://airbnb.design/sketching-interfaces/.,2021

3. Iconfont+;https://www.iconfont.cn/.,2020

4. Imgcook;https://www.imgcook.com/.,2020

5. Navigate a Systrace Report;https://developer.android.com/studio/profile/sys trace/navigate-report.,2019

Cited by 8 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

1. Prompting Is All You Need: Automated Android Bug Replay with Large Language Models;Proceedings of the 46th IEEE/ACM International Conference on Software Engineering;2024-02-06

2. Towards Efficient Record and Replay: A Case Study in WeChat;Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering;2023-11-30

3. Transforming Ideas into Code: A Novel Approach to Design-to-Development Workflow;2023 International Conference on Computer and Applications (ICCA);2023-11-28

4. Video2Action: Reducing Human Interactions in Action Annotation of App Tutorial Videos;Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology;2023-10-29

5. What You See Is What You Get? It Is Not the Case! Detecting Misleading Icons for Mobile Applications;Proceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis;2023-07-12

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3