Toggle Main Menu Toggle Search

Open Access padlockePrints

Combining Pixel-Level and Structure-Level Adaptation for Semantic Segmentation

Lookup NU author(s): Dr Shidong WangORCiD

Downloads


Licence

This work is licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0).


Abstract

© 2023, The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.Domain adaptation for semantic segmentation requires pixel-level knowledge transfer from a labeled source domain to an unlabeled target domain. Existing approaches typically align the features of the source and target domains at different levels. However, they usually neglect the different adaptive complexities of different information flows within images. In this paper, we focus on combining two main information flows in semantic segmentation, ie., the pixel-level disparate information and image structure information. Specifically, we propose to combine two feature map-based prediction heads, which are thought to focus on pixel-level and structure-level information, to accommodate different complexities by adjusting the attention to adaptation functions of the target domain. We then align the outputs from the two heads through a consistency regularization to realize informative complementarity. The combined prediction head further enables regularizing the distance between different pixel representations of different classes, thereby mitigating the mis-adaptation problem of similar classes. The proposed method can achieve more competitive results than current state-of-the-art results on two publicly available benchmark datasets, ie., SYNTHIA → Cityscapes and GTA5 → Cityscapes.


Publication metadata

Author(s): Bi X, Chen D, Huang H, Wang S, Zhang H

Publication type: Article

Publication status: Published

Journal: Neural Processing Letters

Year: 2023

Volume: 55

Pages: 9669–9684

Online publication date: 12/03/2023

Acceptance date: 26/02/2023

Date deposited: 16/05/2023

ISSN (print): 1370-4621

ISSN (electronic): 1573-773X

Publisher: Springer

URL: https://doi.org/10.1007/s11063-023-11220-5

DOI: 10.1007/s11063-023-11220-5

ePrints DOI: 10.57711/ekzm-0r45


Altmetrics

Altmetrics provided by Altmetric


Share