Umeå University's logo

umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Acromegaly detection using machine learning for face classification
Umeå University, Faculty of Medicine, Department of Public Health and Clinical Medicine.ORCID iD: 0000-0002-9501-6763
Department of Science and Technology, AIDA Data Hub, Linköping University, SE-58185 Linköping, Sweden.ORCID iD: 0000-0001-5027-1552
Umeå University, Faculty of Medicine, Department of Public Health and Clinical Medicine.ORCID iD: 0000-0001-7768-1076
Department of Endocrinology, Karolinska University Hospital and Department of Molecular Medicine and Surgery, Karolinska Institutet, SE-171 76 Stockholm, Sweden.ORCID iD: 0000-0003-2488-0375
Show others and affiliations
(English)Manuscript (preprint) (Other academic)
Abstract [en]

Background. There is a substantial delay in the diagnosis of acromegaly contributing to increased morbidity. Analysis of face images using machine learning to identify acromegaly has been investigated with impressive results but for clinical utilization there is a need for reassessment in different, large acromegaly cohorts using new methodological insights of machine learning development. 

Methods. Video recordings from patients with acromegaly and matched controls were collected at all Swedish University hospitals. Facial pictures from different angles were extracted. Clinical data regarding disease course and status were collected. Machine learning models based on four pre-trained deep neural networks (FaRL and 3 ImageNet models: ResNet50, InceptionV2 and DenseNet121) were trained to distinguish photographs of patients with acromegaly from controls. The models were compared to the performance of 12 experienced endocrinologists. 

Results. The FaRL based model matched the diagnostic precision of human experts (ROC AUC 0.89, balanced accuracy 0.89 for both) but had a higher sensitivity (0.82 vs 0.66) and comparable specificity (0.87 vs 0.93). An ensemble of the ImageNet models was inferior to FaRL (ROC AUC 0.85, sensitivity 0.75 and specificity 0.80). All models and human experts showed a higher sensitivity in the classification of males compared to females. There was a high level of agreement between FaRL, ImageNet ensemble, and the experts for true negatives (76%) but lower agreement for true positives (55%). 

Conclusions. The FaRL based model shows the same accuracy as expert endocrinologists in acromegaly identification by face photographs, but with a higher sensitivity. This supports that digital face analysis can be useful in acromegaly detection, but further studies are needed for validation and evaluation in a clinical setting. 

Keywords [en]
acromegaly, diagnostic delay, screening, face classification, face photographs, machine learning, deep learning
National Category
Endocrinology and Diabetes
Identifiers
URN: urn:nbn:se:umu:diva-232700OAI: oai:DiVA.org:umu-232700DiVA, id: diva2:1919017
Available from: 2024-12-06 Created: 2024-12-06 Last updated: 2024-12-10Bibliographically approved
In thesis
1. Acromegaly: comorbidities and novel diagnostic tools
Open this publication in new window or tab >>Acromegaly: comorbidities and novel diagnostic tools
2024 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Background/aim: Acromegaly is a rare disease caused by a pituitary tumor secreting excess growth hormone, which leads to acral growth, organ enlargement, and facial changes. Patients with acromegaly have an increased risk of type 2 diabetes, cardiovascular disease, and arthropathy. Due to the rarity and slow progression of the disease, there is a considerable diagnostic delay (5–8 years), which contributes to increased morbidity and mortality. This thesis is based on four studies aimed at investigating the presentation of sleep apnea and carpal tunnel syndrome (CTS) in patients with acromegaly and the potential for digital analysis of voice and face to identify patients with acromegaly. 

Methods and results: Paper I was a cross-sectional, multicenter study of 259 patients with acromegaly: 29% of the patients were previously diagnosed with sleep apnea, with more than half (57%) of these diagnosed prior to the diagnosis of acromegaly. Another 8% of this cohort were found to have undiagnosed sleep apnea by targeted clinical assessment and sleep investigation. Paper II was a retrospective, national registry-based study of 556 patients with a diagnosis of acromegaly from the National Patient Registry. It found a 6-fold higher incidence of CTS diagnosis and surgery prior to acromegaly diagnosis compared to the general population. The risk of CTS was higher in women with acromegaly, and 84% of patients with CTS were diagnosed and surgically treated before the diagnosis of acromegaly. The potential window of opportunity to diagnose acromegaly earlier led us to investigate new non-invasive screening tools. In Paper III, a multicenter cohort study, we collected voice recordings from 151 patients with acromegaly (23% biochemically active) and 139 matched controls to create a machine learning algorithm, which identified the voice of patients with acromegaly at higher accuracy than experienced endocrinologists (ROC AUC 0.84 vs 0.69). Both biochemically active and controlled patients with acromegaly reported increased voice impairment (Voice Handicap Index) compared to controls. In Paper IV, we used facial images from 155 patients and 153 controls from the same cohort and machine learning algorithms for face analysis to train several machine learning models. The best model matched the accuracy of the compound assessment of 12 experienced endocrinologists (ROC AUC 0.85 vs 0.89) in acromegaly prediction while showing a higher sensitivity (0.82 vs 0.66). 

Conclusions: The diagnostic delay in acromegaly leads to the presence of comorbidities long before the disease is recognized. In this time window, non-invasive screening tools based on facial and voice analysis may improve the chances for earlier diagnosis. 

Place, publisher, year, edition, pages
Umeå: Umeå University, 2024. p. 109
Series
Umeå University medical dissertations, ISSN 0346-6612 ; 2336
Keywords
Acromegaly, diagnostic delay, sleep apnea, carpal tunnel syndrome, face analysis, voice analysis, machine learning
National Category
Endocrinology and Diabetes
Research subject
Medicine
Identifiers
urn:nbn:se:umu:diva-232706 (URN)978-91-8070-559-2 (ISBN)978-91-8070-558-5 (ISBN)
Public defence
2025-01-24, Triple Helix, Universitetsledningshuset, Umeå, 09:00 (English)
Opponent
Supervisors
Available from: 2024-12-20 Created: 2024-12-06 Last updated: 2025-01-13Bibliographically approved

Open Access in DiVA

No full text in DiVA

Authority records

Vouzouneraki, KonstantinaOlsson, TommyDahlqvist, Per

Search in DiVA

By author/editor
Vouzouneraki, KonstantinaErik, YlipääOlsson, TommyBerinder, KatarinaHöybye, CharlottePetersson, MariaBensing, SophieÅkerman, Anna-KarinBorg, HenrikEkman, BertilRobért, JonasEdén Engström, BrittRagnarsson, OskarBurman, PiaDahlqvist, Per
By organisation
Department of Public Health and Clinical Medicine
Endocrinology and Diabetes

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 58 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf