Toggle Main Menu Toggle Search

Open Access padlockePrints

Back to Butterworth - a Fourier basis for 3D surface relief hole filling within RGB-D imagery

Lookup NU author(s): Dr Amir Atapour AbarghoueiORCiD



This is the authors' accepted manuscript of a conference proceedings (inc. abstract) that has been published in its final definitive form by IEEE, 2016.

For re-use rights please refer to the publisher's terms and conditions.


We address the problem of hole filling in RGB-D (color and depth) images, obtained from either active or stereo based sensing, for the purposes of object removal and missing depth estimation. This is performed independently on the low frequency depth information (surface shape) and the high frequency depth detail (relief) by way of a Fourier space transform and classical Butterworth high/low pass filtering. The high frequency detail is then filled using a texture synthesis method, whilst the low frequency shape information is inpainted using structural inpainting. Here, a classical non-parametric sampling approach is extended, using the concept of query expansion, to perform high frequency depth synthesis with the final output then recombined in Fourier space. In order to improve the overall depth relief (D) and edge detail accuracy, color information (RGB) is also used to constrain the sampling process within high frequency component completion. Experimental results demonstrate the efficacy of the proposed method outperforming prior work for generalized depth filling in the presence of high frequency surface relief detail.

Publication metadata

Author(s): Atapour-Abarghouei A, Payen de La Garanderie G, Breckon TP

Publication type: Conference Proceedings (inc. Abstract)

Publication status: Published

Conference Name: 23rd International Conference on Pattern Recognition (ICPR 2016)

Year of Conference: 2016

Pages: 2813-2818

Online publication date: 22/04/2017

Acceptance date: 21/07/2016

Date deposited: 06/02/2021

Publisher: IEEE


DOI: 10.1109/ICPR.2016.7900062

Library holdings: Search Newcastle University Library for this item

ISBN: 9781509048472