umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Multimodal Hand and Foot Gesture Interaction for Handheld Devices
Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics. Chinese Academy of Science, China.
Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics. Palestine Polytechnic University. (Digital Media Lab)
Chinese Academy of Science, China.
Royal Institute of Technology, Stockholm, Sweden.
Show others and affiliations
2014 (English)In: ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), ISSN 1551-6857, E-ISSN 1551-6865, Vol. 11, no 1, Article No. 10- p.Article in journal (Refereed) Published
Abstract [en]

We present a hand-and-foot-based multimodal interaction approach for handheld devices. Our method combines input modalities (i.e., hand and foot) and provides a coordinated output to both modalities along with audio and video. Human foot gesture is detected and tracked using contour-based template detection (CTD) and Tracking-Learning-Detection (TLD) algorithm. 3D foot pose is estimated from passive homography matrix of the camera. 3D stereoscopic and vibrotactile are used to enhance the immersive feeling. We developed a multimodal football game based on the multimodal approach as a proof-of-concept. We confirm our systems user satisfaction through a user study.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2014. Vol. 11, no 1, Article No. 10- p.
National Category
Media and Communication Technology Computer Systems Human Computer Interaction
Identifiers
URN: urn:nbn:se:umu:diva-94057DOI: 10.1145/2645860OAI: oai:DiVA.org:umu-94057DiVA: diva2:752295
Available from: 2014-10-03 Created: 2014-10-03 Last updated: 2017-12-05Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full text

Search in DiVA

By author/editor
Lu, ZhihanHalawani, AlaaLi, HaiboUr Réhman, Shafiq
By organisation
Department of Applied Physics and Electronics
In the same journal
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Media and Communication TechnologyComputer SystemsHuman Computer Interaction

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 144 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf