Toggle Main Menu Toggle Search

Open Access padlockePrints

A comparative review of plausible hole filling strategies in the context of scene depth image completion

Lookup NU author(s): Dr Amir Atapour Abarghouei

Downloads


Licence

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (CC BY-NC-ND).


Abstract

Despite significant research focus on 3D scene capture systems, numerous unresolved challenges remain in relation to achieving full coverage scene depth estimation which is the key part of any modern 3D sensing system. This has created an area of research where the goal is to complete the missing 3D information post capture via a secondary depth filling process. In many downstream applications, an incomplete depth scene is of limited value, requiring many special cases for subsequent utilization, and thus techniques are required to “fill the holes” that exist in terms of both missing depth and color scene information. An analogous problem exists within the scope of scene filling post object removal in the same context. Although considerable research has resulted in notable progress in the synthetic expansion or reconstruction of missing color scene information in both statistical (texture synthesis) and structural (image completion) forms, work on the plausible completion of missing scene depth is contrastingly limited. This survey aims to provide a state of the art overview within this growing field of depth synthesis work whilst noting related solutions in the space of traditional texture synthesis and color image completion for hole filling. To these ends, we concentrate on the plausible completion of both underlying depth structure and relief texture to provide both greater understanding and future development in the area. Our analyses are in part supported by illustrative experimental examples of the comparative use of a subset of representative approaches over common depth completion examples.


Publication metadata

Author(s): Atapour-Abarghouei A, Breckon TP

Publication type: Article

Publication status: Published

Journal: Computers & Graphics

Year: 2018

Volume: 72

Pages: 39-58

Print publication date: 01/05/2018

Online publication date: 15/02/2018

Acceptance date: 06/02/2018

Date deposited: 06/02/2021

ISSN (print): 0097-8493

ISSN (electronic): 1873-7684

Publisher: Elsevier

URL: https://doi.org/10.1016/j.cag.2018.02.001

DOI: 10.1016/j.cag.2018.02.001


Altmetrics

Altmetrics provided by Altmetric


Actions

Find at Newcastle University icon    Link to this publication


Share