A Lightweight Framework for Perception Analysis Based on Multimodal Cognition-Aware Computing

Abstract

The VUCA environment challenged neuropsychological research conducted in conventional laboratories. Researchers expected to perform complex multimodal testing tasks in natural, open, and non-laboratory settings. However, for most neuropsychological scientists, the independent construction of a multimodal laboratory in a VUCA environment, such as a construction site, was a significant and comprehensive technological challenge. This study presents a generalized lightweight framework for perception analysis based on multimodal cognition-aware computing, which provided practical updated strategies and technological guidelines for neuromanagement and automation. A real-life test experiment on a construction site was provided to illustrate the feasibility and superiority of the method. The study aimed to fill a technology gap in the application of multimodal physiological and neuropsychological techniques in an open VUCA environment. Meanwhile, it enabled the researchers to improve their systematic technological capabilities and reduce the threshold and trial-and-error costs of experiments to conform to the new trend of VUCA.