Deep learning-based lexical character identification in TV series

Abstract

Abstract Automated character identification in movies and TV series has been typically carried out through face detection in video and the association of faces with characters’ names extracted from dialogues or cast lists. We propose a deep learning architecture to identify characters based on subtitles only, precisely through the lexicon those characters employ. The identification task is formalized as a multi-class classification task. We apply our technique to the complete set of episodes in the Gomorrah TV series and achieve an average identification accuracy beyond 94 per cent on the full set of characters.