Toggle Main Menu Toggle Search

Open Access padlockePrints

Coarse annotation refinement for segmentation of dot-matrix batchcodes

Lookup NU author(s): Dr Chris Holder, Stephen Bonner, Professor Boguslaw ObaraORCiD


Full text for this publication is not currently held within this repository. Alternative links are provided below where available.


© 2019 IEEE. Deep Convolutional Neural Networks (CNN) have been extensively applied in various computer vision tasks. Although such approaches have demonstrated exceptionally high performance in various open challenges, adapting them to more specialised tasks can be non-trivial. In this paper we discuss our design and implementation of a batchcode detection system capable of accurate segmentation of batchcode regions within images of consumer products. A batchcode is a unique identifier printed on the packaging of many products that encodes useful information such as date and location of manufacture. Detection of batchcodes in images of products is a useful step in many processes, including quality control, supply chain tracking and counterfeit detection. Beginning with a unique dataset of product images and a set of crowdsourced coarse annotations that roughly correspond to the locations of batchcodes, we demonstrate that such annotations are insufficient for training a reliable model, and subsequently describe a novel label refinement process, which we call the Maximally Stable Global Region (MSGR) method, that we use to generate accurate ground-truth data suitable for training a robust neural network. We also show that detection accuracy can be further improved by applying MSGR to the output of the neural network. We evaluate our approach using a manually labelled test dataset of images of shampoo bottles, and demonstrate the efficacy of the proposed method for accurate real-time batchcode detection.

Publication metadata

Author(s): Jia N, Holder C, Bonner S, Obara B

Publication type: Conference Proceedings (inc. Abstract)

Publication status: Published

Conference Name: 18th IEEE International Conference on Machine Learning and Applications (ICMLA 2019)

Year of Conference: 2019

Pages: 2001-2007

Online publication date: 17/02/2020

Acceptance date: 02/04/2018

Publisher: IEEE


DOI: 10.1109/ICMLA.2019.00320

Library holdings: Search Newcastle University Library for this item

ISBN: 9781728145501