Developing Low-Cost Mobile Device and Apps for Accurate Skin Spectrum Measurement via Low-Cost Spectrum Sensors and Deep Neural Network Technology

Abstract

In recent years, skin spectral information has been gradually applied in various fields, such as the cosmetics industry and clinical medicine. However, the high price and the huge size of the skin spectrum measurement device make the related applications of the skin spectrum unable to be widely used in practical applications. We used convolutional neural network (CNN) to achieve a satisfying accuracy of the Fitzpatrick skin-type classification by using a simple self-developed device in 2018. Leveraging on the hardware, firmware, and software app-developing experience, a low-cost miniature skin spectrum measurement system (LMSSMS) using deep neural network (DNN) technology was further studied, and the feasibility of the system is verified in this paper. The developed LMSSMS is divided into three parts: (1) miniature skin spectrum measurement device (MSSMD), (2) DNN model, and (3) mobile app. The MSSMD was developed with innovative low-cost MSSC, 3D printing, and a simple LED light source. The DNN model is designed to enhance measurement accuracy. Finally, the mobile app is used to control and show the measurement results. The developed app also includes a variety of skin-spectrum-related applications, such as erythema index and melanin index (EI/MI) measurement, Fitzpatrick skin-type classification, Pantone SkinTone classification, sun-exposure estimation, and body-fat measurement. In order to verify the feasibility of LMSSMS, we used the standard instrumentation device as a reference. The results show that the accuracy of the LMSSMS can reach 94.7%, which also confirms that this development idea has much potential for further development.