A Gastrointestinal Image Classification Method Based on Improved Adam Algorithm

Author:

Sun Haijing1,Cui Jiaqi2,Shao Yichuan1,Yang Jiapeng2ORCID,Xing Lei3ORCID,Zhao Qian4,Zhang Le1ORCID

Affiliation:

1. School of Intelligent Science & Engineering, Shenyang University, Shenyang 110044, China

2. School of Information Engineering, Shenyang University, Shenyang 110044, China

3. School of Chemistry and Chemical Engineering, University of Surrey, Surrey GU2 7XH, UK

4. School of Science, Shenyang University of Technology, Shenyang 110044, China

Abstract

In this study, a gastrointestinal image classification method based on the improved Adam algorithm is proposed. Gastrointestinal image classification is of great significance in the field of medical image analysis, but it presents numerous challenges, including slow convergence, susceptibility to local minima, and the complexity and imbalance of medical image data. Although the Adam algorithm is widely used in stochastic gradient descent, it tends to suffer from overfitting and gradient explosion issues when dealing with complex data. To address these problems, this paper proposes an improved Adam algorithm, AdamW_AGC, which combines the weight decay and Adaptive Gradient Clipping (AGC) strategies. Weight decay is a common regularization technique used to prevent machine learning models from overfitting. Adaptive gradient clipping avoids the gradient explosion problem by restricting the gradient to a suitable range and helps accelerate the convergence of the optimization process. In order to verify the effectiveness of the proposed algorithm, we conducted experiments on the HyperKvasir dataset and validation experiments on the MNIST and CIFAR10 standard datasets. Experimental results on the HyperKvasir dataset demonstrate that the improved algorithm achieved a classification accuracy of 75.8%, compared to 74.2% for the traditional Adam algorithm, representing an improvement of 1.6%. Furthermore, validation experiments on the MNIST and CIFAR10 datasets resulted in classification accuracies of 98.69% and 71.7%, respectively. These results indicate that the AdamW_AGC algorithm has advantages in handling complex, high-dimensional medical image classification tasks, effectively improving both classification accuracy and training stability. This study provides new ideas and expansions for future optimizer research.

Publisher

MDPI AG

Reference21 articles.

1. Gao, S.Q. (2023, January 12–14). A Research on Traditional Tangka Image Classification Based on Visual Features. Proceedings of the 2023 4th International Conference on Computer Vision, Image and Deep Learning (CVIDL), Zhuhai, China.

2. Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv.

3. Reddi, S.J., Kale, S., and Kumar, S. (2019). On the Convergence of Adam and Beyond. arXiv.

4. Fassold, H. (2022). AdaFamily: A Family of Adam-like Adaptive Gradient Methods. arXiv.

5. Loshchilov, I., and Hutter, F. (2019). Decoupled Weight Decay Regularization. arXiv.

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3