Assessment of perivascular space filtering methods using a three-dimensional computational model

Growing interest surrounds the assessment of perivascular spaces (PVS) on magnetic resonance imaging (MRI) and their validation as a clinical biomarker of adverse brain health. Nonetheless, the limits of validity of current state-of-the-art segmentation methods are still unclear. Here, we propose an open-source three-dimensional computational framework comprising 3D digital reference objects and evaluate the performance of three PVS filtering methods under various spatiotemporal imaging considerations (including sampling, motion artefacts, and Rician noise). Specifically, we study the performance of the Frangi, Jerman and RORPO filters in enhancing PVS-like structures to facilitate segmentation. Our findings were three-fold. First, as long as voxels are isotropic, RORPO outperforms the other two filters, regardless of imaging quality. Unlike the Frangi and Jerman filters, RORPO's performance does not deteriorate as PVS volume increases. Second, the performance of all “vesselness” filters is heavily influenced by imaging quality, with sampling and motion artefacts being the most damaging for these types of analyses. Third, none of the filters can distinguish PVS from other hyperintense structures (e.g. white matter hyperintensities, stroke lesions, or lacunes) effectively, the area under precision-recall curve dropped substantially (Frangi: from 94.21 [IQR 91.60, 96.16] to 43.76 [IQR 25.19, 63.38]; Jerman: from 94.51 [IQR 91.90, 95.37] to 58.00 [IQR 35.68, 64.87]; RORPO: from 98.72 [IQR 95.37, 98.96] to 71.87 [IQR 57.21, 76.63] without and with other hyperintense structures, respectively). The use of our computational model enables comparing segmentation methods and identifying their advantages and disadvantages, thereby providing means for testing and optimising pipelines for ongoing and future studies.