Multi-Modal Motion-Capture-Based Biometric Systems for Emergency Response and Patient Rehabilitation

Abstract

This chapter outlines the current state of the art of Kinect sensor gait and activity authentication. It also focuses on emotional cues that could be observed from human body and posture. It presents a prototype of a system that combines recently developed behavioral gait and posture recognition methods for human emotion identification. A backbone of the system is Kinect sensor gait recognition, which explores the relationship between joint-relative angles and joint-relative distances through machine learning. The chapter then introduces a real-time gesture recognition system developed using Kinect sensor and trained with SVM classifier. Preliminary experimental results demonstrate accuracy and feasibility of using such systems in real-world scenarios. While gait and emotion from body movement has been researched in the context of standalone biometric security systems, they were never previously explored for physiotherapy rehabilitation and real-time patient feedback. The survey of recent progress and open problems in crucial areas of medical patient rehabilitation and rescue operations conclude this chapter.