Auto-Icon+ : An Automated End-to-End Code Generation Tool for Icon Designs in UI Development

Author:

Feng Sidong1ORCID,Jiang Minmin2ORCID,Zhou Tingting2ORCID,Zhen Yankun2ORCID,Chen Chunyang1ORCID

Affiliation:

1. Monash University, Melbourne, Victoria, Australia

2. Alibaba Group, Hangzhou, Zhejiang, China

Abstract

Approximately 50% of development resources are devoted to user interface (UI) development tasks [ 9 ]. Occupying a large proportion of development resources, developing icons can be a time-consuming task, because developers need to consider not only effective implementation methods but also easy-to-understand descriptions. In this article, we present Auto-Icon+ , an approach for automatically generating readable and efficient code for icons from design artifacts. According to our interviews to understand the gap between designers (icons are assembled from multiple components) and developers (icons as single images), we apply a heuristic clustering algorithm to compose the components into an icon image. We then propose an approach based on a deep learning model and computer vision methods to convert the composed icon image to fonts with descriptive labels, thereby reducing the laborious manual effort for developers and facilitating UI development. We quantitatively evaluate the quality of our method in the real-world UI development environment and demonstrate that our method offers developers accurate, efficient, readable, and usable code for icon designs, in terms of saving 65.2% implementing time.

Publisher

Association for Computing Machinery (ACM)

Subject

Artificial Intelligence,Human-Computer Interaction

Reference112 articles.

1. Rakesh Agrawal and Ramakrishnan Srikant. 1994. Fast algorithms for mining association rules. In Proceedings of the 20th International Conference on Very Large Data Bases (VLDB’94), Vol. 1215. 487–499.

2. Sketching Interfaces: Generating Code from Low Fidelity Wireframes;https://airbnb.design/sketching-interfaces/.,2021

3. Iconfont+;https://www.iconfont.cn/.,2020

4. Imgcook;https://www.imgcook.com/.,2020

5. Navigate a Systrace Report;https://developer.android.com/studio/profile/sys trace/navigate-report.,2019

Cited by 12 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

1. On-device query intent prediction with lightweight LLMs to support ubiquitous conversations;Scientific Reports;2024-06-03

2. MUD: Towards a Large-Scale and Noise-Filtered UI Dataset for Modern Style UI Modeling;Proceedings of the CHI Conference on Human Factors in Computing Systems;2024-05-11

3. Prompting Is All You Need: Automated Android Bug Replay with Large Language Models;Proceedings of the IEEE/ACM 46th International Conference on Software Engineering;2024-02-06

4. Measuring Impact of Generative AI in Software Development and Innovation;Lecture Notes in Electrical Engineering;2024

5. Towards Efficient Record and Replay: A Case Study in WeChat;Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering;2023-11-30

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3