Umeå University's logo

umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Off the Beaten Path: Modelling Path Uncertainty using Markov Decision Processes
Umeå University, Faculty of Science and Technology, Department of Computing Science.
2024 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

Uncertainty has been an important topic, in research, as well as a social concern. The notion of path uncertainty is introduced as the likelihood of encountering a wide variety of possible trajectories when following a given strategy. The research question is: “How can path uncertainty be modelled?”. This thesis proposes the Path Uncertainty Aware Markov Decision Process (PUA-MDP), based on other types of MDPs related to other types of uncertainty. Its algorithm finds optimal policies for balancing maximal reward with minimal cumulative path uncertainty exposure. Experimental validation demonstrates that the algorithm’s behaviour resembles human behavioural responses to uncertainty. It also demonstrates that a small decrease in reward can result in a drastic decrease in uncertainty. If such a method is applied to any classic MDP, path uncertainty could be reduced greatly.

Place, publisher, year, edition, pages
2024.
Series
UMNAD ; 1500
Keywords [en]
Uncertainty, Artificial Intelligence, Markov Decision Process
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:umu:diva-227407OAI: oai:DiVA.org:umu-227407DiVA, id: diva2:1878936
Supervisors
Examiners
Available from: 2024-06-28 Created: 2024-06-27 Last updated: 2024-06-28Bibliographically approved

Open Access in DiVA

fulltext(492 kB)77 downloads
File information
File name FULLTEXT01.pdfFile size 492 kBChecksum SHA-512
c170be93781a775501e42a00533759978316944d79314acb3de190df228176aa08f18199f9ac40b023fa1b475726bed31ba0b6da0aea47535f9d81848fb91760
Type fulltextMimetype application/pdf

By organisation
Department of Computing Science
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 77 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 328 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf