MocapMe: DeepLabCut-Enhanced Neural Network for Enhanced Markerless Stability in Sit-to-Stand Motion Capture

Author:

Milone Dario1ORCID,Longo Francesco1ORCID,Merlino Giovanni1ORCID,De Marchis Cristiano1ORCID,Risitano Giacomo1ORCID,D’Agati Luca1ORCID

Affiliation:

1. Department of Engineering (DI), University of Messina, Contrada di Dio, 98166 Messina, Italy

Abstract

This study examined the efficacy of an optimized DeepLabCut (DLC) model in motion capture, with a particular focus on the sit-to-stand (STS) movement, which is crucial for assessing the functional capacity in elderly and postoperative patients. This research uniquely compared the performance of this optimized DLC model, which was trained using ’filtered’ estimates from the widely used OpenPose (OP) model, thereby emphasizing computational effectiveness, motion-tracking precision, and enhanced stability in data capture. Utilizing a combination of smartphone-captured videos and specifically curated datasets, our methodological approach included data preparation, keypoint annotation, and extensive model training, with an emphasis on the flow of the optimized model. The findings demonstrate the superiority of the optimized DLC model in various aspects. It exhibited not only higher computational efficiency, with reduced processing times, but also greater precision and consistency in motion tracking thanks to the stability brought about by the meticulous selection of the OP data. This precision is vital for developing accurate biomechanical models for clinical interventions. Moreover, this study revealed that the optimized DLC maintained higher average confidence levels across datasets, indicating more reliable and accurate detection capabilities compared with standalone OP. The clinical relevance of these findings is profound. The optimized DLC model’s efficiency and enhanced point estimation stability make it an invaluable tool in rehabilitation monitoring and patient assessments, potentially streamlining clinical workflows. This study suggests future research directions, including integrating the optimized DLC model with virtual reality environments for enhanced patient engagement and leveraging its improved data quality for predictive analytics in healthcare. Overall, the optimized DLC model emerged as a transformative tool for biomechanical analysis and physical rehabilitation, promising to enhance the quality of patient care and healthcare delivery efficiency.

Funder

European Union

Publisher

MDPI AG

Reference45 articles.

1. Movement analysis of sit-to-stand–research informing clinical practice;Frykberg;Phys. Ther. Rev.,2015

2. Sit-to-stand movement as a performance-based measure for patients with total knee arthroplasty;Boonstra;Phys. Ther.,2010

3. Inertial-based human motion capture: A technical summary of current processing methodologies for spatiotemporal and kinematic measures;Hindle;Appl. Bionics Biomech.,2021

4. Cao, Z., Hidalgo Martinez, G., Simon, T., Wei, S., and Sheikh, Y.A. (2019, January 21–16). OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. Proceedings of the IEEE Transactions on Pattern Analysis and Machine Intelligence, Honolulu, HI, USA.

5. Simon, T., Joo, H., Matthews, I., and Sheikh, Y. (2017, January 21–16). Hand Keypoint Detection in Single Images using Multiview Bootstrapping. Proceedings of the CVPR, Honolulu, HI, USA.

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3