Umeå University's logo

umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
QU-BraTS: MICCAI BraTS 2020 Challenge on QuantifyingUncertainty in Brain Tumor Segmentation - Analysis of Ranking Scores and Benchmarking Results
Show others and affiliations
2022 (English)In: Journal of Machine Learning for Biomedical Imaging, ISSN 2766-905X, p. 1-54, article id 026Article in journal (Refereed) Published
Abstract [en]

Deep learning (DL) models have provided the state-of-the-art performance in a wide variety of medical imaging benchmarking challenges, including the Brain Tumor Segmentation (BraTS) challenges. However, the task of focal pathology multi-compartment segmentation (e.g., tumor and lesion sub-regions) is particularly challenging, and potential errors hinder the translation of DL models into clinical workflows. Quantifying the reliability of DL model predictions in the form of uncertainties, could enable clinical review of the most uncertain regions, thereby building trust and paving the way towards clinical translation. Recently, a number of uncertainty estimation methods have been introduced for DL medical image segmentation tasks. Developing scores to evaluate and compare the performance of uncertainty measures will assist the end-user in making more informed decisions. In this study, we explore and evaluate a score developed during the BraTS 2019-2020 task on uncertainty quantification (QU-BraTS), and designed to assess and rank uncertainty estimates for brain tumor multi-compartment segmentation. This score (1) rewards uncertainty estimates that produce high confidence in correct assertions, and those that assign low confidence levels at incorrect assertions, and (2) penalizes uncertainty measures that lead to a higher percentages of under-confident correct assertions. We further benchmark the segmentation uncertainties generated by 14 independent participating teams of QU-BraTS 2020, all of which also participated in the main BraTS segmentation task. Overall, our findings confirm the importance and complementary value that uncertainty estimates provide to segmentation algorithms, and hence highlight the need for uncertainty quantification in medical image analyses. Our evaluation code is made publicly available at https://github.com/RagMeh11/QU-BraTS

Place, publisher, year, edition, pages
2022. p. 1-54, article id 026
Keywords [en]
Uncertainty Quantification, Trustworthiness, Segmentation, Brain Tumors, Deep Learning, Neuro-Oncology, Glioma, Glioblastoma
National Category
Computer Vision and Robotics (Autonomous Systems) Other Medical Sciences not elsewhere specified
Identifiers
URN: urn:nbn:se:umu:diva-198857OAI: oai:DiVA.org:umu-198857DiVA, id: diva2:1690582
Available from: 2022-08-26 Created: 2022-08-26 Last updated: 2024-07-02Bibliographically approved

Open Access in DiVA

fulltext(5796 kB)323 downloads
File information
File name FULLTEXT01.pdfFile size 5796 kBChecksum SHA-512
7f19de55aeda8d8f060c5dc39b0f8b55c24d90d2963ae11670bb1dafcd9cda05f47b1b5568d98517eca06f73a42684af1955657b527d9cacca291f9463952147
Type fulltextMimetype application/pdf

Other links

Publisher´s fulltext

Authority records

Vu, Minh HoangNyholm, TufveLöfstedt, Tommy

Search in DiVA

By author/editor
Vu, Minh HoangNyholm, TufveLöfstedt, Tommy
By organisation
Radiation PhysicsDepartment of Computing Science
Computer Vision and Robotics (Autonomous Systems)Other Medical Sciences not elsewhere specified

Search outside of DiVA

GoogleGoogle Scholar
Total: 323 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 1122 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf