An image‐based facial acupoint detection approach using high‐resolution network and attention fusion

Abstract

AbstractWith the prevalence of Traditional Chinese Medicine (TCM), automation techniques are highly required to support the therapy and save human resources. As the fundamental of the TCM treatment, acupoint detection is attracting research attention in both academic and industrial domains, while current approaches suffer from poor accuracy even with sparse acupoints or require extra equipment. In this study, considering the decision‐making knowledge of human experts, an image‐based deep learning approach is proposed to detect facial acupoints by localising the centre of acupoints. In the proposed approach, high‐resolution networks are selected as the backbone to learn informative facial features with different resolution paths. To fuse the learnt features from the high‐resolution network, a resolution, channel, and spatial attention‐based fusion module is innovatively proposed to imitate human decision, that is, focusing on the facial features to detect required acupoints. Finally, the heatmap is designed to integrally achieve the acupoint classification and position localisation in a single step. A small‐scale real‐world dataset is constructed and annotated to evaluate the proposed approach based on the authorised face dataset. The experimental results demonstrate the proposed approach outperforms other baseline models, achieving a 2.4228% normalised mean error. Most importantly, the effectiveness and efficiency of the proposed technical improvements are also confirmed by extensive experiments. The authors believe that the proposed approach can achieve acupoint detection with considerable high performance, and further support TCM automation.