Deep attention super-resolution of brain magnetic resonance images acquired under clinical protocols

Bryan M. Li, Leonardo V. Castorina, Maria Del C. Valdés Hernández, Una Clancy, Stewart J. Wiseman, Eleni Sakka, Amos J. Storkey, Daniela Jaime Garcia, Yajun Cheng, Fergus Doubal, Michael T. Thrippleton, Michael Stringer, Joanna M. Wardlaw

Research output: Contribution to journalArticlepeer-review

Abstract

Vast quantities of Magnetic Resonance Images (MRI) are routinely acquired in clinical practice but, to speed up acquisition, these scans are typically of a quality that is sufficient for clinical diagnosis but sub-optimal for large-scale precision medicine, computational diagnostics, and large-scale neuroimaging collaborative research. Here, we present a critic-guided framework to upsample low-resolution (often 2D) MRI full scans to help overcome these limitations. We incorporate feature-importance and self-attention methods into our model to improve the interpretability of this study. We evaluate our framework on paired low- and high-resolution brain MRI structural full scans (i.e., T1-, T2-weighted, and FLAIR sequences are simultaneously input) obtained in clinical and research settings from scanners manufactured by Siemens, Phillips, and GE. We show that the upsampled MRIs are qualitatively faithful to the ground-truth high-quality scans (PSNR = 35.39; MAE = 3.78E−3; NMSE = 4.32E−10; SSIM = 0.9852; mean normal-appearing gray/white matter ratio intensity differences ranging from 0.0363 to 0.0784 for FLAIR, from 0.0010 to 0.0138 for T1-weighted and from 0.0156 to 0.074 for T2-weighted sequences). The automatic raw segmentation of tissues and lesions using the super-resolved images has fewer false positives and higher accuracy than those obtained from interpolated images in protocols represented with more than three sets in the training sample, making our approach a strong candidate for practical application in clinical and collaborative research.
Original languageEnglish
Article number887633
Number of pages30
JournalFrontiers in Computational Neuroscience
Volume16
DOIs
Publication statusPublished - 25 Aug 2022

Keywords

  • super-resolution
  • Magnetic Resonance Imaging
  • deep learning
  • image reconstruction
  • explainable artificial intelligence
  • brain imaging
  • U-Net
  • generative adversarial networks

Fingerprint

Dive into the research topics of 'Deep attention super-resolution of brain magnetic resonance images acquired under clinical protocols'. Together they form a unique fingerprint.

Cite this