Visual-GRoup AFFEct Recognition (V-GRAFFER): A Unified Application for Real-Time Group Concentration Estimation in E-Lectures

Abstract

This paper presents the most recent version of V-GRAFFER, a novel system that we have been developing for Visual GRoup AFFEct Recognition research. This version includes new algorithms and features, as well as a new application extension for using and evaluating the new features. Specifically, we present novel methods to collect facial samples from other e-lecture applications. We use screen captures of lectures, which we track and connect with samples during the duration of e-educational events. We also developed and evaluated three new algorithms for drawing conclusions on group concentration states. As V-GRAFFER required such complex functionalities to be combined together, many corresponding microservices have been developed. The current version of V-GRAFFER allows drawing real-time conclusions using the input samples collected from the use of any tutoring system, which in turn leads to real-time feedback and allows adjustment of the course material.