Signed Fingermark Liveness Detection Method Based on Deep Residual Networks and Multimodal Decision Fusion

Abstract

Fingermarks play an important role in document identification. At the same time, fingermarks on paper documents are often accompanied by signatures and background text, which introduce noise to the original fingermark textures and increase the difficulty of detection. A signed fingermark detection method based on deep residual networks and a decision-level fusion strategy was proposed to defend against spoofing attacks from fake fingermarks. Firstly, the multi-scale structure was introduced in the residual module, which improved the network’s depth and breadth without increasing the parameters. Then, the multi-probability label strategy was refined and employed to enhance the local encoding ability of the feature extraction. A score fusion strategy was designed, with weights allocated based on the difference in signed interference levels of local image blocks. Finally, a model fusion strategy based on evidence theory was suggested, which improved detection accuracy by leveraging complementarity between models. A large-scale fingermark database was established, which included real fingermarks made from real fingers and fake fingermarks made from various materials, and this was divided into two sub databases: signed and unsigned. The experimental results show that the proposed method achieves 96.16% accuracy based on the fingerprint dataset of the global liveness detection competition called LivDet2017 and achieves 99.30% accuracy based on the signed fingermark database, while it has good resistance to spoofing attacks from unknown materials.