Author:
Sakamoto Naoaki,Kakeno Hitoshi,Ozaki Noriko,Miyazaki Yusuke,Kobayashi Koji,Murata Takahisa
Abstract
Although the appropriate evaluation of mouse behavior is crucial in pharmacological research, most current methods focus on single mouse behavior under light conditions, owing to the limitations of human observation and experimental tools. In this study, we aimed to develop a novel marker-less tracking method for multiple mice with top-view videos using deep-learning-based techniques. The following stepwise method was introduced: (i) detection of mouse contours, (ii) assignment of identifiers (IDs) to each mouse, and (iii) correction of mis-predictions. The behavior of C57BL/6 mice was recorded in an open-field arena, and the mouse contours were manually annotated for hundreds of frame images. Then, we trained the mask regional convolutional neural network (Mask R-CNN) with all annotated images. The mouse contours predicted by the trained model in each frame were assigned to IDs by calculating the similarities of every mouse pair between frames. After assigning IDs, correction steps were applied to remove the predictive errors semi-automatically. The established method could accurately predict two to four mice for first-look videos recorded under light conditions. The method could also be applied to videos recorded under dark conditions, extending our ability to accurately observe and analyze the sociality of nocturnal mice. This technology would enable a new approach to understand mouse sociality and advance the pharmacological research.
Funder
Japan Society for the Promotion of Science
Subject
Behavioral Neuroscience,Cognitive Neuroscience,Neuropsychology and Physiological Psychology
Reference32 articles.
1. Zebrafish tracking using YOLOv2 and Kalman filter.;Barreiros;Sci. Rep.,2021
2. Living with a depressed spouse.;Benazon;J. Fam. Psychol.,2000
3. Establishment of an animal model of depression contagion.;Boyko;Behav. Brain Res.,2015
4. Gastric cancer diagnosis with Mask R-CNN; gastric cancer diagnosis with Mask R-CNN;Cao;Proceedings of the 2019 11th international conference on intelligent human-machine systems and cybernetics (IHMSC),2019
5. The VIA annotation software for images, audio and video;Dutta;Proceedings of the 27th ACM international conference on multimedia: MM 2019,2019
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献