Semantic segmentation of pollen grain images generated from scattering patterns via deep learning

Author:

Grant-Jacob James AORCID,Praeger MatthewORCID,Eason Robert WORCID,Mills BenORCID

Abstract

Abstract Pollen can lead to individuals suffering from allergic rhinitis, with a person’s vulnerability being dependent on the species and the amount of pollen. Therefore, the ability to precisely quantify both the number and species of pollen grains in a certain volume would be invaluable. Lensless sensing offers the ability to classify pollen grains from their scattering patterns, with the use of very few optical components. However, since there could be 1000 s of species of pollen one may wish to identify, in order to avoid having to collect scattering patterns from all species (and mixtures of species) we propose using two separate neural networks. The first neural network generates a microscope equivalent image from the scattering pattern, having been trained on a limited number of experimentally collected pollen scattering data. The second neural network segments the generated image into its components, having been trained on microscope images, allowing pollen species identification (potentially allowing the use of existing databases of microscope images to expand range of species identified by the segmentation network). In addition to classification, segmentation also provides richer information, such as the number of pixels and therefore the potential size of particular pollen grains. Specifically, we demonstrate the identification and projected area of pollen grain species, via semantic image segmentation, in generated microscope images of pollen grains, containing mixtures and species that were previously unseen by the image generation network. The microscope images of mixtures of pollen grains, used for training the segmentation neural network, were created by fusing microscope images of isolated pollen grains together while the trained neural network was tested on microscope images of actual mixtures. The ability to carry out pollen species identification from reconstructed images without needing to train the identification network on the scattering patterns is useful for the real-world implementation of such technology.

Funder

Engineering and Physical Sciences Research Council

Publisher

IOP Publishing

Subject

General Physics and Astronomy

Cited by 3 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

1. Machine learning for automated, targeted, phototherapy;Optics Continuum;2024-05-07

2. Using Pure Pollen Species When Training a CNN to Segment Pollen Mixtures;2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW);2022-06

3. BiSeNet-oriented context attention model for image semantic segmentation;Computer Science and Information Systems;2022

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3