A novel unified deep neural networks methodology for use by date recognition in retail food package image

Abstract

AbstractThere exist various types of information on retail food packages, including use by date, food product name and so on. The correct coding of use by dates on food packages is vitally important for avoiding potential health risks to customers caused by erroneous mislabelling of use by dates. It is extremely tedious and laborious to check the use by dates coding manually by a human operator, which is prone to generate errors thus an automatic system for validating the correctness of the coding of use by dates is needed. In order to construct such a system, firstly it needs to correctly automatic recognize use by dates on food packages. In this work, we propose a novel dual deep neural networks-based methodology for automatic recognition of use by dates in food package photographs recorded by a camera, which is a combination of two networks: a fully convolutional network for use by date ROI detection and a convolutional recurrent neuron network for date character recognition. The proposed methodology is the first attempt to apply deep learning for automatic use by date recognition. From comprehensive experimental evaluations, it is shown that the proposed method can achieve high accuracies in use by date recognition (more than 95% on our testing dataset), given food package images with varying lighting conditions, poor printing quality and varied textual/pictorial contents collected from multiple real retailer sites.