Change search
ReferencesLink to record
Permanent link

Direct link
The brain and interaction in a multimodal reality
Umeå University, Faculty of Science and Technology, Department of Computing Science.
2009 (English)Report (Other academic)
Abstract [en]

This paper reviews the neural correlates of multimodal integration and the role it plays in the creation and maintenance of perception of reality. These issues are illuminated by reviewing concepts and research from a number of related subjects and we explore some of the relevant cognitive models, such as the memory-prediction framework. We further focus on how multimodal integration affects reality-based interaction (RBI) in general and virtual reality (VR) in particular. In this case the reality in question is generated by a computer and perception of reality may be unstable. In VR-related research the quality of the perception of reality is commonly referred to as presence and a review of the conditions for and effects of varying degrees of presence is presented. An increased understanding of the role of multimodal integration in the creation and maintenance of presence is one of the primary goals of this paper. The hope is that this will help us to understand and improve presence, something that we will show to be of great value. The effect of disturbances and failure in the multimodal integration on the perception of reality and presence is of particular interest. This is related to the concept of breaks in presence and prediction errors, to provide some framework for understanding. Also, the importance of understanding the neural correlates of these cognitive functions is related to the possible use of VR in combination with brain imaging, exemplified with functional magnetic resonance imaging (fMRI). Finally, we discuss possible future work and possibilities to advance the understanding of the brain and reality in the context of human computer interaction.

Place, publisher, year, edition, pages
Umeå: Umeå universitet , 2009. , 19 p.
Report / UMINF, ISSN 0348-0542 ; 09
Keyword [en]
interaction, brain, VR, fMRI, multimodal, reality, reality-based interaction
National Category
Computer Science
URN: urn:nbn:se:umu:diva-40044OAI: diva2:397638
Available from: 2011-02-15 Created: 2011-02-15 Last updated: 2011-02-15Bibliographically approved

Open Access in DiVA

No full text

Other links


Search in DiVA

By author/editor
Sjölie, Daniel
By organisation
Department of Computing Science
Computer Science

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 43 hits
ReferencesLink to record
Permanent link

Direct link