OTRE: Where Optimal Transport Guided Unpaired Image-to-Image Translation Meets Regularization by Enhancing

Wenhui Zhu, Peijie Qiu, Oana M. Dumitrascu, Jacob M. Sobczak, Mohammad Farazi, Zhangsihao Yang, Keshav Nandakumar, Yalin Wang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Non-mydriatic retinal color fundus photography (CFP) is widely available due to the advantage of not requiring pupillary dilation, however, is prone to poor quality due to operators, systemic imperfections, or patient-related causes. Optimal retinal image quality is mandated for accurate medical diagnoses and automated analyses. Herein, we leveraged the Optimal Transport (OT) theory to propose an unpaired image-to-image translation scheme for mapping low-quality retinal CFPs to high-quality counterparts. Furthermore, to improve the flexibility, robustness, and applicability of our image enhancement pipeline in the clinical practice, we generalized a state-of-the-art model-based image reconstruction method, regularization by denoising, by plugging in priors learned by our OT-guided image-to-image translation network. We named it as regularization by enhancing (RE). We validated the integrated framework, OTRE, on three publicly available retinal image datasets by assessing the quality after enhancement and their performance on various downstream tasks, including diabetic retinopathy grading, vessel segmentation, and diabetic lesion segmentation. The experimental results demonstrated the superiority of our proposed framework over some state-of-the-art unsupervised competitors and a state-of-the-art supervised method.

Original languageEnglish (US)
Title of host publicationInformation Processing in Medical Imaging - 28th International Conference, IPMI 2023, Proceedings
EditorsAlejandro Frangi, Marleen de Bruijne, Demian Wassermann, Nassir Navab
PublisherSpringer Science and Business Media Deutschland GmbH
Pages415-427
Number of pages13
ISBN (Print)9783031340475
DOIs
StatePublished - 2023
Externally publishedYes
Event28th International Conference on Information Processing in Medical Imaging, IPMI 2023 - San Carlos de Bariloche, Argentina
Duration: Jun 18 2023Jun 23 2023

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13939 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference28th International Conference on Information Processing in Medical Imaging, IPMI 2023
Country/TerritoryArgentina
CitySan Carlos de Bariloche
Period6/18/236/23/23

Keywords

  • Image enhancement
  • Optimal transport
  • Regularization by enhancing
  • Retinal color fundus photography
  • Unsupervised learning

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'OTRE: Where Optimal Transport Guided Unpaired Image-to-Image Translation Meets Regularization by Enhancing'. Together they form a unique fingerprint.

Cite this