umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Face-off: a Face ReconstructionTechnique for Virtual Reality(VR) Scenarios
Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics. (immersive interaction Lab (i2lab))ORCID iD: 0000-0002-3037-4244
Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics. (immersive interaction Lab (i2lab))
Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
Show others and affiliations
2016 (English)In: The 1st Int. Workshop on Egocentric, perception, interaction andcomputing,, 2016Conference paper, Presentation (Refereed)
Abstract [en]

Virtual Reality (VR) headsets occlude a significant portionof human face. The real human face is required in many VR applications,for example, video teleconferencing. This paper proposes a wearable camerasetup-based solution to reconstruct the real face of a person wearingVR headset. Our solution lies in the core of asymmetrical principal componentanalysis (aPCA). A user-specific training model is built usingaPCA with full face, lips and eye region information. During testingphase, lower face region and partial eye information is used to reconstructthe wearer face. Online testing session consists of two phases, i)calibration phase and ii) reconstruction phase. In former, a small calibrationstep is performed to align test information with training data,while the later uses half face information to reconstruct the full face usingaPCA-based trained-data. The proposed approach is validated withqualitative and quantitative analysis.

Place, publisher, year, edition, pages
2016.
Keyword [en]
Virtual Reality, VR headset, Face reconstruction, PCA, wearable setup, Oculus.
National Category
Electrical Engineering, Electronic Engineering, Information Engineering Computer Systems Signal Processing
Research subject
Computer Science; Computerized Image Analysis
Identifiers
URN: urn:nbn:se:umu:diva-138277DOI: 10.1007/978-3-319-46604-0_35OAI: oai:DiVA.org:umu-138277DiVA: diva2:1133605
Conference
European Conference on Computer Vision
Available from: 2017-08-16 Created: 2017-08-16 Last updated: 2017-08-16
In thesis
1. Presence through actions: theories, concepts, and implementations
Open this publication in new window or tab >>Presence through actions: theories, concepts, and implementations
2017 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

During face-to-face meetings, humans use multimodal information, including verbal information, visual information, body language, facial expressions, and other non-verbal gestures. In contrast, during computer-mediated-communication (CMC), humans rely either on mono-modal information such as text-only, voice-only, or video-only or on bi-modal information by using audiovisual modalities such as video teleconferencing. Psychologically, the difference between the two lies in the level of the subjective experience of presence, where people perceive a reduced feeling of presence in the case of CMC. Despite the current advancements in CMC, it is still far from face-to-face communication, especially in terms of the experience of presence.

This thesis aims to introduce new concepts, theories, and technologies for presence design where the core is actions for creating presence. Thus, the contribution of the thesis can be divided into a technical contribution and a knowledge contribution. Technically, this thesis details novel technologies for improving presence experience during mediated communication (video teleconferencing). The proposed technologies include action robots (including a telepresence mechatronic robot (TEBoT) and a face robot), embodied control techniques (head orientation modeling and virtual reality headset based collaboration), and face reconstruction/retrieval algorithms. The introduced technologies enable action possibilities and embodied interactions that improve the presence experience between the distantly located participants. The novel setups were put into real experimental scenarios, and the well-known social, spatial, and gaze related problems were analyzed.

The developed technologies and the results of the experiments led to the knowledge contribution of this thesis. In terms of knowledge contribution, this thesis presents a more general theoretical conceptual framework for mediated communication technologies. This conceptual framework can guide telepresence researchers toward the development of appropriate technologies for mediated communication applications. Furthermore, this thesis also presents a novel strong concept – presence through actions - that brings in philosophical understandings for developing presence- related technologies. The strong concept - presence through actions is an intermediate-level knowledge that proposes a new way of creating and developing future 'presence artifacts'. Presence- through actions is an action-oriented phenomenological approach to presence that differs from traditional immersive presence approaches that are based (implicitly) on rationalist, internalist views.

Place, publisher, year, edition, pages
Umeå: Umeå universitet, 2017. 172 p.
Series
Digital Media Lab, ISSN 1652-6295 ; 22
Keyword
Presence, Immersion, Computer mediated communication, Strong concept, Phenomenology, Philosophy, Biologically inspired system, Neck robot, Head pose estimation, Embodied interaction, Virtual reality headset, Social presence, Spatial presence, Face reconstruction/retrieval, Telepresence system, Quality of interaction, Embodied telepresence system, Mona-Lisa gaze effect, eye-contact
National Category
Electrical Engineering, Electronic Engineering, Information Engineering Computer Systems Communication Systems Signal Processing
Research subject
design; Computer Science; Computer Systems; Computerized Image Analysis
Identifiers
urn:nbn:se:umu:diva-138280 (URN)978-91-7601-730-2 (ISBN)
Public defence
2017-10-10, N320, Naturvetarhuset, Umeå, 10:30 (English)
Opponent
Supervisors
Available from: 2017-08-21 Created: 2017-08-16 Last updated: 2017-08-21Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full text

Search in DiVA

By author/editor
Khan, Muhammad Sikandar Lalur Réhman, Shafiq
By organisation
Department of Applied Physics and Electronics
Electrical Engineering, Electronic Engineering, Information EngineeringComputer SystemsSignal Processing

Search outside of DiVA

GoogleGoogle Scholar

Altmetric score

Total: 314 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf