Enhancement of damaged-image prediction through Cahn–Hilliard image inpainting

Author:

Carrillo José A.1,Kalliadasis Serafim2,Liang Fuyue2,Perez Sergio P.23ORCID

Affiliation:

1. Mathematical Institute, University of Oxford, Oxford OX2 6GG, UK

2. Department of Chemical Engineering, Imperial College London, London SW7 2AZ, UK

3. Department of Mathematics, Imperial College London, London SW7 2AZ, UK

Abstract

We assess the benefit of including an image inpainting filter before passing damaged images into a classification neural network. We employ an appropriately modified Cahn–Hilliard equation as an image inpainting filter which is solved numerically with a finite-volume scheme exhibiting reduced computational cost and the properties of energy stability and boundedness. The benchmark dataset employed is Modified National Institute of Standards and Technology (MNIST) dataset, which consists of binary images of handwritten digits and is a standard dataset to validate image-processing methodologies. We train a neural network based on dense layers with MNIST, and subsequently we contaminate the test set with damages of different types and intensities. We then compare the prediction accuracy of the neural network with and without applying the Cahn–Hilliard filter to the damaged images test. Our results quantify the significant improvement of damaged-image prediction by applying the Cahn–Hilliard filter, which for specific damages can increase up to 50% and is advantageous for low to moderate damage.

Funder

H2020 European Research Council

Imperial College London

Engineering and Physical Sciences Research Council

Publisher

The Royal Society

Subject

Multidisciplinary

Reference50 articles.

1. Bertalmio M Sapiro G Caselles V Ballester C. 2000 Image inpainting. In Proc. 27th Annual Conf. on Computer Graphics and Interactive Techniques pp. 417–424. ACM Press. (doi:10.1145/344779.344972)

2. An axiomatic approach to image interpolation

3. Masnou S Morel J-M. 1998 Level lines based disocclusion. In Proc. 1998 Int. Conf. on Image Processing . ICIP98 (Cat. No. 98CB36269) pp. 259–263. IEEE. (doi:10.1109/ICIP.1998.999016)

4. Region Filling and Object Removal by Exemplar-Based Image Inpainting

5. Criminisi A Perez P Toyama K. 2003 Object removal by exemplar-based inpainting. In 2003 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition . vol. 2 pp. II–II. IEEE. (doi:10.1109/CVPR.2003.1211538)

Cited by 9 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

1. Asymptotic behavior of solutions to a fourth-order degenerate parabolic equation;Journal of Computational Methods in Sciences and Engineering;2024-08-14

2. A vector-valued PDE-constrained image inpainting model;Signal, Image and Video Processing;2024-04-03

3. An efficient and explicit local image inpainting method using the Allen–Cahn equation;Zeitschrift für angewandte Mathematik und Physik;2024-02-26

4. An efficient image inpainting algorithm based on a modified Gray–Scott model;Signal Processing;2024-01

5. Enhancement of damaged-image prediction based on digital twin technology;Journal of Cloud Computing;2023-12-14

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3