Automated Emotion Classification in Free-moving Rats

Abstract

Studies involving emotion often use animal models and currently rely on manual labelling by researchers. This human-driven labelling approach leads to a number of challenges such as: long analysis times, imprecise results, observer drift, and varying correlation between observers. These problems impact reproducibility, and have contributed to our lack of understanding of fundamental mechanical questions such as how emotions arise from neuronal circuits. Recent success of machine learning models across similar problems show that it can help to mitigate these challenges while meeting or exceeding human accuracy.  We developed a classifier pipeline that takes in videos and produces an emotion label. The pipeline extracts body part positions from each frame using a pose estimator and feeds them into an Artificial Neural Network (ANN) classifier built using stacked Long Short Term Memory (LSTM) layers. The data was collected by treating nine rats with Lypopolysaccharide (LPS) injections (10mg/kg). First, rats were recorded for 10 minutes under control conditions with no manipulation and no observed symptoms of stress or malaise. A week later, rats were injected with LPS and filmed for 10 minutes two hours post-injection.  The classifier pipeline developed correctly labelled 78% of the 125,040 video segments from 8 test videos. When combined with a vote-based system, this led to 7 of the 8 test videos being classified correctly which was the same accuracy attained by a human expert from the lab. The test videos had varying environments and used rats that were different from the training videos, providing evidence of a degree of robustness in the model. Future work will focus on expanding the test data and incorporating models for 3D pose estimation and behavioral classification.