Weakly supervised semantic segmentation of leukocyte images based on class activation maps

Abstract

Leukocytes are an essential component of the human defense system, accurate segmentation of leukocyte images is a crucial step towards automating detection. Most existing methods for leukocyte images segmentation relied on fully supervised semantic segmentation (FSSS) with extensive pixel-level annotations, which are time-consuming and labor-intensive. To address this issue, this paper proposes a weakly supervised semantic segmentation (WSSS) approach for leukocyte images utilizing improved class activation maps (CAMs). Firstly, to alleviate ambiguous boundary problem between leukocytes and background, preprocessing technique is employed to enhance the image quality. Secondly, attention mechanism is added to refine the CAMs generated by improving the matching of local and global features. Random walks, dense conditional random fields and hole filling were leveraged to obtain final pseudo-segmentation labels. Finally, a fully supervised segmentation network is trained with pseudo-segmentation labels. The method is evaluated on BCCD and TMAMD datasets. Experimental results demonstrate that by employing the pseudo segmentation annotations generated through this method can be utilized to train UNet as close as possible to FSSS. This method effectively reduces manual annotation cost while achieving WSSS of leukocyte images.