Toggle Main Menu Toggle Search

Open Access padlockePrints

Applying machine learning classifiers to automate quality assessment of paediatric dynamic susceptibility contrast (DSC-) MRI data

Lookup NU author(s): Professor Simon BaileyORCiD, Dr Dipayan Mitra



This work is licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0).


OBJECTIVE: Investigate the performance of qualitative review (QR) for assessing dynamic susceptibility contrast (DSC-) MRI data quality in paediatric normal brain and develop an automated alternative to QR. METHODS: 1027 signal-time courses were assessed by Reviewer 1 using QR. 243 were additionally assessed by Reviewer 2 and % disagreements and Cohen's κ (κ) were calculated. The signal drop-to-noise ratio (SDNR), root mean square error (RMSE), full width half maximum (FWHM) and percentage signal recovery (PSR) were calculated for the 1027 signal-time courses. Data quality thresholds for each measure were determined using QR results. The measures and QR results trained machine learning classifiers. Sensitivity, specificity, precision, classification error and area under the curve from a receiver operating characteristic curve were calculated for each threshold and classifier. RESULTS: Comparing reviewers gave 7% disagreements and κ = 0.83. Data quality thresholds of: 7.6 for SDNR; 0.019 for RMSE; 3 s and 19 s for FWHM; and 42.9 and 130.4% for PSR were produced. SDNR gave the best sensitivity, specificity, precision, classification error and area under the curve values of 0.86, 0.86, 0.93, 14.2% and 0.83. Random forest was the best machine learning classifier, giving sensitivity, specificity, precision, classification error and area under the curve of 0.94, 0.83, 0.93, 9.3% and 0.89. CONCLUSION: The reviewers showed good agreement. Machine learning classifiers trained on signal-time course measures and QR can assess quality. Combining multiple measures reduces misclassification. ADVANCES IN KNOWLEDGE: A new automated quality control method was developed, which trained machine learning classifiers using QR results.

Publication metadata

Author(s): Powell SJ, Withey SB, Sun Y, Grist JT, Novak J, MacPherson L, Abernethy L, Pizer B, Grundy R, Morgan PS, Jaspan T, Bailey S, Mitra D, Auer DP, Avula S, Arvanitis TN, Peet A

Publication type: Article

Publication status: Published

Journal: The British journal of radiology

Year: 2023

Volume: 96

Issue: 1145

Online publication date: 16/02/2023

Acceptance date: 24/01/2023

Date deposited: 11/05/2023

ISSN (print): 0007-1285

ISSN (electronic): 1748-880X

Publisher: John Wiley & Sons Ltd.


DOI: 10.1259/bjr.20201465

PubMed id: 36802769


Altmetrics provided by Altmetric


Funder referenceFunder name