Projects per year
Deep learning technologies have been successfully applied to automatic diagnostics of ex-vivo lung cancer with fluorescence lifetime imaging endomicroscopy (FLIM). Recent advance in convolutional neural networks (CNNs) by splitting input features for multi-scale feature extraction as a feature-level aggregation, has achieved further improvement in visual recognition. However, due to the splitting, correlations among input features are no longer retained. To exploit the advantages of hierarchical multi-scale architectures, while maintaining the correlations as global information, we propose a novel architecture, namely multi-scale concatenated-dilation (MSCD) at a layer level. The MSCD performs multi-scale feature extraction on input features without the splitting. In addition, we substitute the Addition aggregation in the original hierarchical architecture with the Concatenation to retrieve more features. At the same time, we also introduce dilated convolutions to replace the linear convolutions to further enlarge the receptive field. We evaluate the performance of MSCD by integrating it into ResNet, on over 60,000 FLIM images collected from 14 patients, using a custom fiber-based FLIM system, with various user-specified configurations. Accuracy, precision, recall, and the area under the receiver operating characteristic curve are used as the metrics. We first demonstrate the superiority of our MSCD model over the backbone ResNet and other state-of-the-art CNNs in terms of higher scores with lower complexity over the metrics. Moreover, we empirically demonstrate the superiority of the Concatenation aggregation over the Addition on convolution and scale efficiency. Furthermore, we compare the MSCD with Res2Net to illustrate the advantages and disadvantages of feature-/layer-level multi-scale aggregation.
Deep Learning in ex-vivo Lung Cancer Discrimination using Fluorescence Lifetime Endomicroscopic ImagesWang, Q., Hopgood, J., Finlayson, N., Williams, G., Fernandes, S., Williams, E., Akram, A., Dhaliwal, K. & Vallejo, M., 27 Aug 2020, (E-pub ahead of print) 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society. Institute of Electrical and Electronics Engineers (IEEE)
Research output: Chapter in Book/Report/Conference proceeding › Conference contributionOpen AccessFile
Fluorescence Lifetime Endomicroscopic Image-based ex-vivo Human Lung Cancer Differentiation Using Machine LearningWang, Q., Hopgood, J. & Vallejo, M., 15 Jan 2020, TechRxiv.
Research output: Working paper