Aesthetic Attribute Assessment of Images Numerically on Mixed Multi-attribute Datasets

Author:

Jin Xin1ORCID,Li Xinning1ORCID,Lou Hao1ORCID,Fan Chenyu1ORCID,Deng Qiang1ORCID,Xiao Chaoen1ORCID,Cui Shuai2ORCID,Singh Amit Kumar3ORCID

Affiliation:

1. Beijing Electronic Science and Technology Institute, Beijing, China

2. University of California, Davis, USA

3. National Institute of Technology Patna, India

Abstract

With the continuous development of social software and multimedia technology, images have become a kind of important carrier for spreading information and socializing. How to evaluate an image comprehensively has become the focus of recent researches. The traditional image aesthetic assessment methods often adopt single numerical overall assessment scores, which has certain subjectivity and can no longer meet the higher aesthetic requirements. In this article, we construct an new image attribute dataset called aesthetic mixed dataset with attributes (AMD-A) and design external attribute features for fusion. Besides, we propose an efficient method for image aesthetic attribute assessment on mixed multi-attribute dataset and construct a multitasking network architecture by using the EfficientNet-B0 as the backbone network. Our model can achieve aesthetic classification, overall scoring, and attribute scoring. In each sub-network, we improve the feature extraction through ECA channel attention module. As for the final overall scoring, we adopt the idea of the teacher-student network and use the classification sub-network to guide the aesthetic overall fine-grain regression. Experimental results, using the MindSpore, show that our proposed method can effectively improve the performance of the aesthetic overall and attribute assessment.

Funder

National Natural Science Foundation of China

CAAI-Huawei MindSpore Open Fund

Open Fund Project of the State Key Laboratory of Complex System Management and Control

Project of Philosophy and Social Science Research, Ministry of Education of China

Advanced Discipline Construction Project of Beijing Universities

Publisher

Association for Computing Machinery (ACM)

Subject

Computer Networks and Communications,Hardware and Architecture

Reference41 articles.

1. Javad Azimi, Ruofei Zhang, Yang Zhou, Vidhya Navalpakkam, Jianchang Mao, and Xiaoli Fern. 2012. The impact of visual appearance on user response in online display advertising. In 21st International Conference on World Wide Web. 457–458.

2. Sean Bell, C. Lawrence Zitnick, Kavita Bala, and Ross Girshick. 2016. Inside-Outside Net: Detecting objects in context with skip pooling and recurrent neural networks. In IEEE Conference on Computer Vision and Pattern Recognition. 2874–2883.

3. Computational and experimental approaches to visual aesthetics;Brachmann Anselm;Front. Computat. Neurosci.,2017

4. Kuang-Yu Chang, Kung-Hung Lu, and Chu-Song Chen. 2017. Aesthetic critiques generation for photos. In IEEE International Conference on Computer Vision. 3514–3523.

5. Ritendra Datta, Dhiraj Joshi, Jia Li, and James Z. Wang. 2006. Studying aesthetics in photographic images using a computational approach. In European Conference on Computer Vision. Springer, 288–301.

Cited by 5 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

1. Integrating Subjective and Objective Features for Image Aesthetics Assessment;2024 International Joint Conference on Neural Networks (IJCNN);2024-06-30

2. Mobile Photography Guidance System via Aesthetic Assessment;2023 China Automation Congress (CAC);2023-11-17

3. Pedestrian Attribute Recognition via Spatio-Temporal Relationship Learning for Visual Surveillance;ACM Transactions on Multimedia Computing, Communications, and Applications;2023-11-13

4. Language Guidance Generation Using Aesthetic Attribute Comparison for Human Photography and AIGC;Proceedings of the 1st International Workshop on Multimedia Content Generation and Evaluation: New Methods and Practice;2023-10-29

5. Research Progress on the Aesthetic Quality Assessment of Complex Layout Images Based on Deep Learning;Applied Sciences;2023-08-29

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3