umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Action Augmented Real Virtuality Design for Presence
Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics. (immersive interaction Lab (i2lab))ORCID iD: 0000-0002-3037-4244
Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics. (immersive interaction Lab (i2lab))
2017 (English)In: Article in journal (Refereed) In press
Abstract [en]

This article addresses an important question of howto design a video teleconferencing setup to increase the experienceof spatial and social presence. The traditional video teleconferencingsetups are abortive in presenting nonverbal behaviors ashumans express in face to face communication, which results inlack of presence. In order to address this issue, in this article,we first present a conceptual framework of presence for videoteleconferencing.We introduce a modern presence concept namedreal virtuality and propose a new way of achieving real virtuality.Our new way is based on bodily or artifact actions to increase thepresence and we named this concept presence through actions.Using this new concept, we present a design of a novel actionaugmentedreal virtuality prototype which consider the challengesrelated to design of an action prototype, action embodimentand face representation. Our action prototype is telepresencemechatronic robot (TEBoT) and action embodiment is done byhead mounted display (HMD). The face representation solvesthe problem of face occlusion introduced by HMD. The novelcombination of HMD, TEBoT and face representation algorithmis put into real video teleconferencing scenario to see howsuccessful is such a system in solving challenges related to spatialand social presence. We have performed a user study where theinvited participants were requested to experience our novel setupand compare it with the traditional video teleconferencing setup.The results show that the action capabilities not only increasethe spatial presence but also increase the social presence of aremote person among local collaborators.

Place, publisher, year, edition, pages
2017.
Keyword [en]
Real virtuality, Virtual reality, Embodiment, Telepresence, Actions, Perception, Embodied telepresence system, Webrtc, Face occlusion, Face retrieval.
National Category
Signal Processing Computer Systems
Research subject
Computing Science; Computerized Image Analysis
Identifiers
URN: urn:nbn:se:umu:diva-138278OAI: oai:DiVA.org:umu-138278DiVA: diva2:1133611
Available from: 2017-08-16 Created: 2017-08-16 Last updated: 2017-08-16
In thesis
1. Presence through actions: theories, concepts, and implementations
Open this publication in new window or tab >>Presence through actions: theories, concepts, and implementations
2017 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

During face-to-face meetings, humans use multimodal information, including verbal information, visual information, body language, facial expressions, and other non-verbal gestures. In contrast, during computer-mediated-communication (CMC), humans rely either on mono-modal information such as text-only, voice-only, or video-only or on bi-modal information by using audiovisual modalities such as video teleconferencing. Psychologically, the difference between the two lies in the level of the subjective experience of presence, where people perceive a reduced feeling of presence in the case of CMC. Despite the current advancements in CMC, it is still far from face-to-face communication, especially in terms of the experience of presence.

This thesis aims to introduce new concepts, theories, and technologies for presence design where the core is actions for creating presence. Thus, the contribution of the thesis can be divided into a technical contribution and a knowledge contribution. Technically, this thesis details novel technologies for improving presence experience during mediated communication (video teleconferencing). The proposed technologies include action robots (including a telepresence mechatronic robot (TEBoT) and a face robot), embodied control techniques (head orientation modeling and virtual reality headset based collaboration), and face reconstruction/retrieval algorithms. The introduced technologies enable action possibilities and embodied interactions that improve the presence experience between the distantly located participants. The novel setups were put into real experimental scenarios, and the well-known social, spatial, and gaze related problems were analyzed.

The developed technologies and the results of the experiments led to the knowledge contribution of this thesis. In terms of knowledge contribution, this thesis presents a more general theoretical conceptual framework for mediated communication technologies. This conceptual framework can guide telepresence researchers toward the development of appropriate technologies for mediated communication applications. Furthermore, this thesis also presents a novel strong concept – presence through actions - that brings in philosophical understandings for developing presence- related technologies. The strong concept - presence through actions is an intermediate-level knowledge that proposes a new way of creating and developing future 'presence artifacts'. Presence- through actions is an action-oriented phenomenological approach to presence that differs from traditional immersive presence approaches that are based (implicitly) on rationalist, internalist views.

Place, publisher, year, edition, pages
Umeå: Umeå universitet, 2017. 172 p.
Series
Digital Media Lab, ISSN 1652-6295 ; 22
Keyword
Presence, Immersion, Computer mediated communication, Strong concept, Phenomenology, Philosophy, Biologically inspired system, Neck robot, Head pose estimation, Embodied interaction, Virtual reality headset, Social presence, Spatial presence, Face reconstruction/retrieval, Telepresence system, Quality of interaction, Embodied telepresence system, Mona-Lisa gaze effect, eye-contact
National Category
Electrical Engineering, Electronic Engineering, Information Engineering Computer Systems Communication Systems Signal Processing
Research subject
design; Computer Science; Computer Systems; Computerized Image Analysis
Identifiers
urn:nbn:se:umu:diva-138280 (URN)978-91-7601-730-2 (ISBN)
Public defence
2017-10-10, N320, Naturvetarhuset, Umeå, 10:30 (English)
Opponent
Supervisors
Available from: 2017-08-21 Created: 2017-08-16 Last updated: 2017-08-21Bibliographically approved

Open Access in DiVA

No full text

Search in DiVA

By author/editor
Khan, Muhammad Sikandar Lalur Réhman, Shafiq
By organisation
Department of Applied Physics and Electronics
Signal ProcessingComputer Systems

Search outside of DiVA

GoogleGoogle Scholar

Total: 11 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf