Improving utility of brain tumor confocal laser endomicroscopy: Objective value assessment and diagnostic frame detection with convolutional neural networks

Mohammadhassan Izadyyazdanabadi, Evgenii Belykh, Nikolay Martirosyan, Jennifer Eschbacher, Peter Nakaji, Yezhou Yang, Mark C. Preul

Research output: Chapter in Book/Report/Conference proceedingConference contribution

13 Scopus citations


Confocal laser endomicroscopy (CLE), although capable of obtaining images at cellular resolution during surgery of brain tumors in real time, creates as many non-diagnostic as diagnostic images. Non-useful images are often distorted due to relative motion between probe and brain or blood artifacts. Many images, however, simply lack diagnostic features immediately informative to the physician. Examining all the hundreds or thousands of images from a single case to discriminate diagnostic images from nondiagnostic ones can be tedious. Providing a real time diagnostic value assessment of images (fast enough to be used during the surgical acquisition process and accurate enough for the pathologist to rely on) to automatically detect diagnostic frames would streamline the analysis of images and filter useful images for the pathologist/surgeon. We sought to automatically classify images as diagnostic or non-diagnostic. AlexNet, a deep-learning architecture, was used in a 4-fold cross validation manner. Our dataset includes 16,795 images (8572 nondiagnostic and 8223 diagnostic) from 74 CLE-aided brain tumor surgery patients. The ground truth for all the images is provided by the pathologist. Average model accuracy on test data was 91% overall (90.79 % accuracy, 90.94 % sensitivity and 90.87 % specificity). To evaluate the model reliability we also performed receiver operating characteristic (ROC) analysis yielding 0.958 average for area under ROC curve (AUC). These results demonstrate that a deeply trained AlexNet network can achieve a model that reliably and quickly recognizes diagnostic CLE images.

Original languageEnglish (US)
Title of host publicationMedical Imaging 2017
Subtitle of host publicationComputer-Aided Diagnosis
EditorsNicholas A. Petrick, Samuel G. Armato
ISBN (Electronic)9781510607132
StatePublished - 2017
EventMedical Imaging 2017: Computer-Aided Diagnosis - Orlando, United States
Duration: Feb 13 2017Feb 16 2017

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
ISSN (Print)1605-7422


OtherMedical Imaging 2017: Computer-Aided Diagnosis
Country/TerritoryUnited States


  • Brain tumor surgery
  • Computer aided diagnosis
  • Confocal laser endomicroscopy
  • Convolutional neural networks
  • Image quality assessment
  • Precision surgery

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Biomaterials
  • Atomic and Molecular Physics, and Optics
  • Radiology Nuclear Medicine and imaging


Dive into the research topics of 'Improving utility of brain tumor confocal laser endomicroscopy: Objective value assessment and diagnostic frame detection with convolutional neural networks'. Together they form a unique fingerprint.

Cite this