Toggle Main Menu Toggle Search

Open Access padlockePrints

Few-Shot Medical Image Segmentation via Generating Multiple Representative Descriptors

Lookup NU author(s): Dr Shidong WangORCiD, Dr Tong XinORCiD

Downloads

Full text for this publication is not currently held within this repository. Alternative links are provided below where available.


Abstract

IEEEAutomatic medical image segmentation has witnessed significant development with the success of large models on massive datasets. However, acquiring and annotating vast medical image datasets often proves to be impractical due to the time consumption, specialized expertise requirements, and compliance with patient privacy standards, etc. As a result, Few-shot Medical Image Segmentation (FSMIS) has become an increasingly compelling research direction. Conventional FSMIS methods usually learn prototypes from support images and apply nearest-neighbor searching to segment the query images. However, only a single prototype cannot well represent the distribution of each class, thus leading to restricted performance. To address this problem, we propose to Generate Multiple Representative Descriptors (GMRD), which can comprehensively represent the commonality within the corresponding class distribution. In addition, we design a Multiple Affinity Maps based Prediction (MAMP) module to fuse the multiple affinity maps generated by the aforementioned descriptors. Furthermore, to address intra-class variation and enhance the representativeness of descriptors, we introduce two novel losses. Notably, our model is structured as a dual-path design to achieve a balance between foreground and background differences in medical images. Extensive experiments on four publicly available medical image datasets demonstrate that our method outperforms the state-of-the-art methods, and the detailed analysis also verifies the effectiveness of our designed module.


Publication metadata

Author(s): Cheng Z, Wang S, Xin T, Zhou T, Zhang H, Shao L

Publication type: Article

Publication status: Published

Journal: IEEE Transactions on Medical Imaging

Year: 2024

Pages: epub ahead of print

Online publication date: 24/01/2024

Acceptance date: 02/04/2023

ISSN (print): 0278-0062

ISSN (electronic): 1558-254X

Publisher: Institute of Electrical and Electronics Engineers Inc.

URL: https://doi.org/10.1109/TMI.2024.3358295

DOI: 10.1109/TMI.2024.3358295

PubMed id: 38265915


Altmetrics

Altmetrics provided by Altmetric


Share