Umeå University's logo

umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Improving MR image quality with a multi-task model, using convolutional losses
Umeå University, Faculty of Medicine, Department of Radiation Sciences.
Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, Netherlands.
Umeå University, Faculty of Science and Technology, Department of Computing Science.ORCID iD: 0000-0001-7119-7646
Umeå University, Faculty of Medicine, Department of Radiation Sciences.ORCID iD: 0000-0002-0532-232X
Show others and affiliations
2023 (English)In: BMC Medical Imaging, E-ISSN 1471-2342, Vol. 23, no 1, article id 148Article in journal (Refereed) Published
Abstract [en]

PURPOSE: During the acquisition of MRI data, patient-, sequence-, or hardware-related factors can introduce artefacts that degrade image quality. Four of the most significant tasks for improving MRI image quality have been bias field correction, super-resolution, motion-, and noise correction. Machine learning has achieved outstanding results in improving MR image quality for these tasks individually, yet multi-task methods are rarely explored.

METHODS: In this study, we developed a model to simultaneously correct for all four aforementioned artefacts using multi-task learning. Two different datasets were collected, one consisting of brain scans while the other pelvic scans, which were used to train separate models, implementing their corresponding artefact augmentations. Additionally, we explored a novel loss function that does not only aim to reconstruct the individual pixel values, but also the image gradients, to produce sharper, more realistic results. The difference between the evaluated methods was tested for significance using a Friedman test of equivalence followed by a Nemenyi post-hoc test.

RESULTS: Our proposed model generally outperformed other commonly-used correction methods for individual artefacts, consistently achieving equal or superior results in at least one of the evaluation metrics. For images with multiple simultaneous artefacts, we show that the performance of using a combination of models, trained to correct individual artefacts depends heavily on the order that they were applied. This is not an issue for our proposed multi-task model. The model trained using our novel convolutional loss function always outperformed the model trained with a mean squared error loss, when evaluated using Visual Information Fidelity, a quality metric connected to perceptual quality.

CONCLUSION: We trained two models for multi-task MRI artefact correction of brain, and pelvic scans. We used a novel loss function that significantly improves the image quality of the outputs over using mean squared error. The approach performs well on real world data, and it provides insight into which artefacts it detects and corrects for. Our proposed model and source code were made publicly available.

Place, publisher, year, edition, pages
BioMed Central (BMC), 2023. Vol. 23, no 1, article id 148
Keywords [en]
Image artefact correction, Machine learning, Magnetic resonance imaging
National Category
Radiology, Nuclear Medicine and Medical Imaging
Identifiers
URN: urn:nbn:se:umu:diva-215277DOI: 10.1186/s12880-023-01109-zISI: 001151676000001PubMedID: 37784039Scopus ID: 2-s2.0-85173046817OAI: oai:DiVA.org:umu-215277DiVA, id: diva2:1805543
Funder
Cancerforskningsfonden i Norrland, LP 18-2182Cancerforskningsfonden i Norrland, AMP 18-912Cancerforskningsfonden i Norrland, AMP 20-1014Cancerforskningsfonden i Norrland, LP 22-2319Region VästerbottenAvailable from: 2023-10-17 Created: 2023-10-17 Last updated: 2025-04-24Bibliographically approved
In thesis
1. Contributions to deep learning for imaging in radiotherapy
Open this publication in new window or tab >>Contributions to deep learning for imaging in radiotherapy
2023 (English)Doctoral thesis, comprehensive summary (Other academic)
Alternative title[sv]
Bidrag till djupinlärning för bildbehandling inom strålbehandling
Abstract [en]

Purpose: The increasing importance of medical imaging in cancer treatment, combined with the growing popularity of deep learning gave relevance to the presented contributions to deep learning solutions with applications in medical imaging.

Relevance: The projects aim to improve the efficiency of MRI for automated tasks related to radiotherapy, building on recent advancements in the field of deep learning.

Approach: Our implementations are built on recently developed deep learning methodologies, while introducing novel approaches in the main aspects of deep learning, with regards to physics-informed augmentations and network architectures, and implicit loss functions. To make future comparisons easier, we often evaluated our methods on public datasets, and made all solutions publicly available.

Results: The results of the collected projects include the development of robust models for MRI bias field correction, artefact removal, contrast transfer and sCT generation. Furthermore, the projects stress the importance of reproducibility in deep learning research and offer guidelines for creating transparent and usable code repositories.

Conclusions: Our results collectively build the position of deep learning in the field of medical imaging. The projects offer solutions that are both novel and aim to be highly applicable, while emphasizing generalization towards a wide variety of data and the transparency of the results.

Place, publisher, year, edition, pages
Umeå: Umeå University, 2023. p. 100
Series
Umeå University medical dissertations, ISSN 0346-6612 ; 2264
Keywords
deep learning, medical imaging, radiotherapy, artefact correction, bias field correction, contrast transfer, synthetic CT, reproducibility
National Category
Radiology, Nuclear Medicine and Medical Imaging
Identifiers
urn:nbn:se:umu:diva-215693 (URN)9789180701945 (ISBN)9789180701952 (ISBN)
Public defence
2024-01-26, E04, Norrlands universitetssjukhus, Umeå, 13:00 (English)
Opponent
Supervisors
Available from: 2023-11-08 Created: 2023-10-25 Last updated: 2024-07-02Bibliographically approved

Open Access in DiVA

fulltext(2628 kB)94 downloads
File information
File name FULLTEXT01.pdfFile size 2628 kBChecksum SHA-512
1b626aba266938c6e6e45a09b1c28bca51ab45bcad98c81ad52b53135e9697eee707919a5b2fdcdfe92b2a4fe8c262597c1bb505a23988fec1bac30ac3bf6cbe
Type fulltextMimetype application/pdf

Other links

Publisher's full textPubMedScopus

Authority records

Simkó, AttilaLöfstedt, TommyGarpebring, AndersNyholm, TufveBylund, MikaelJonsson, Joakim

Search in DiVA

By author/editor
Simkó, AttilaLöfstedt, TommyGarpebring, AndersNyholm, TufveBylund, MikaelJonsson, Joakim
By organisation
Department of Radiation SciencesDepartment of Computing Science
In the same journal
BMC Medical Imaging
Radiology, Nuclear Medicine and Medical Imaging

Search outside of DiVA

GoogleGoogle Scholar
Total: 94 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
pubmed
urn-nbn

Altmetric score

doi
pubmed
urn-nbn
Total: 365 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf