Comparison of machine learning and conventional logistic regression-based prediction models for gestational diabetes in an ethnically diverse population: the Monash GDM Machine learning modelShow others and affiliations
2023 (English)In: International Journal of Medical Informatics, ISSN 1386-5056, E-ISSN 1872-8243, Vol. 179, article id 105228Article in journal (Refereed) Published
Abstract [en]
Background: Early identification of pregnant women at high risk of developing gestational diabetes (GDM) is desirable as effective lifestyle interventions are available to prevent GDM and to reduce associated adverse outcomes. Personalised probability of developing GDM during pregnancy can be determined using a risk prediction model. These models extend from traditional statistics to machine learning methods; however, accuracy remains sub-optimal.
Objective: We aimed to compare multiple machine learning algorithms to develop GDM risk prediction models, then to determine the optimal model for predicting GDM.
Methods: A supervised machine learning predictive analysis was performed on data from routine antenatal care at a large health service network from January 2016 to June 2021. Predictor set 1 were sourced from the existing, internationally validated Monash GDM model: GDM history, body mass index, ethnicity, age, family history of diabetes, and past poor obstetric history. New models with different predictors were developed, considering statistical principles with inclusion of more robust continuous and derivative variables. A randomly selected 80% dataset was used for model development, with 20% for validation. Performance measures, including calibration and discrimination metrics, were assessed. Decision curve analysis was performed.
Results: Upon internal validation, the machine learning and logistic regression model's area under the curve (AUC) ranged from 71% to 93% across the different algorithms, with the best being the CatBoost Classifier (CBC). Based on the default cut-off point of 0.32, the performance of CBC on predictor set 4 was: Accuracy (85%), Precision (90%), Recall (78%), F1-score (84%), Sensitivity (81%), Specificity (90%), positive predictive value (92%), negative predictive value (78%), and Brier Score (0.39).
Conclusions: In this study, machine learning approaches achieved the best predictive performance over traditional statistical methods, increasing from 75 to 93%. The CatBoost classifier method achieved the best with the model including continuous variables.
Place, publisher, year, edition, pages
Elsevier, 2023. Vol. 179, article id 105228
Keywords [en]
Gestational diabetes mellitus, Machine learning, Predictive model, Prognosis
National Category
Endocrinology and Diabetes
Identifiers
URN: urn:nbn:se:umu:diva-215085DOI: 10.1016/j.ijmedinf.2023.105228ISI: 001086174900001Scopus ID: 2-s2.0-85172738329OAI: oai:DiVA.org:umu-215085DiVA, id: diva2:1804630
2023-10-132023-10-132025-04-24Bibliographically approved