Toggle Main Menu Toggle Search

Open Access padlockePrints

Entropy-weighted reconstruction adversary and curriculum pseudo labeling for domain adaptation in semantic segmentation

Lookup NU author(s): Dr Shidong WangORCiD

Downloads

Full text for this publication is not currently held within this repository. Alternative links are provided below where available.


Abstract

© 2022 Elsevier B.V.Supervised learning has dominated and gradually evolved into a de facto choice for automated semantic segmentation tasks, in spite of the need for large corpora of pixel-level annotated real-world data. Domain adaptation (DA), especially methods based on adversarial machine learning, can lessen labeling costs by securing that knowledge learned from synthetic (source) data with free annotations is transferable to unlabeled real-world data. However, commonly employed approaches in adversarial-based DA merely consider the correlation alignment between the source and target domains while completely neglecting the uncertainty information introduced from the generator. In this paper, we aim to alleviate this issue by introducing a novel entropy-guided adversarial learning framework with the reconstruction error constraint. Firstly, a perceptual-based color space is employed to transform the synthetic source images into the desired new space to approximate the appearances of the real-world images in the target domain. Secondly, an entropy-weighted adversarial framework is designed to enhance the discriminativeness and transferability of the presented model to the target domain via an autoencoder-based discriminator. In addition, a dynamic pseudo-labeling mechanism is introduced to work in conjunction with the curriculum-based self-training strategy to further improve the domain adaptability of the model. Experimental results on two well-known DA benchmarks demonstrate that the proposed method outperforms existing similar approaches in the task of semantic segmentation.


Publication metadata

Author(s): Bi X, Zhang X, Wang S, Zhang H

Publication type: Article

Publication status: Published

Journal: Neurocomputing

Year: 2022

Volume: 506

Pages: 277-289

Online publication date: 26/07/2022

Acceptance date: 24/07/2022

ISSN (print): 0925-2312

ISSN (electronic): 1872-8286

Publisher: Elsevier B.V.

URL: https://doi.org/10.1016/j.neucom.2022.07.073

DOI: 10.1016/j.neucom.2022.07.073


Altmetrics

Altmetrics provided by Altmetric


Share