oru.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Haptic feedback combined with movement sonification using a friction sound improves task performance in a virtual throwing task
KTH Royal Institute of Technology, Stockholm, Sweden.ORCID iD: 0000-0002-4422-5223
Uppsala University, Uppsala, Sweden.ORCID iD: 0000-0002-4772-4730
KTH Royal Institute of Technology, Stockholm, Sweden.ORCID iD: 0000-0002-3086-0322
KTH Royal Institute of Technology, Stockholm, Sweden.ORCID iD: 0000-0003-3743-100X
2019 (English)In: Journal on Multimodal User Interfaces, ISSN 1783-7677, E-ISSN 1783-8738, Vol. 13, no 4, p. 279-290Article in journal (Refereed) Epub ahead of print
Abstract [en]

In this paper we present a study on the effects of auditory- and haptic feedback in a virtual throwing task performed with a point-based haptic device. The main research objective was to investigate if and how task performance and perceived intuitiveness is affected when interactive sonification and/or haptic feedback is used to provide real-time feedback about a movement performed in a 3D virtual environment. Emphasis was put on task solving efficiency and subjective accounts of participants’ experiences of the multimodal interaction in different conditions. The experiment used a within-subjects design in which the participants solved the same task in different conditions: visual-only, visuohaptic, audiovisual and audiovisuohaptic. Two different sound models were implemented and compared. Significantly lower error rates were obtained in the audiovisuohaptic condition involving movement sonification based on a physical model of friction, compared to the visual-only condition. Moreover, a significant increase in perceived intuitiveness was observed for most conditions involving haptic and/or auditory feedback, compared to the visual-only condition. The main finding of this study is that multimodal feedback can not only improve perceived intuitiveness of an interface but that certain combinations of haptic feedback and movement sonification can also contribute with performance-enhancing properties. This highlights the importance of carefully designing feedback combinations for interactive applications.

Place, publisher, year, edition, pages
Springer , 2019. Vol. 13, no 4, p. 279-290
Keywords [en]
Sonification, Haptic feedback, Multimodal interaction, Task performance
National Category
Media Engineering Interaction Technologies Signal Processing
Research subject
Media Technology; Human-computer Interaction; Information and Communication Technology
Identifiers
URN: urn:nbn:se:oru:diva-76894DOI: 10.1007/s12193-018-0264-4OAI: oai:DiVA.org:oru-76894DiVA, id: diva2:1356458
Projects
MuMi - Multi-agent Multimodal Interaction
Funder
Swedish Research Council, D0511301Available from: 2019-10-01 Created: 2019-10-01 Last updated: 2020-01-28Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full text

Authority records BETA

Moll, Jonas

Search in DiVA

By author/editor
Frid, EmmaMoll, JonasBresin, RobertoSallnäs Pysander, Eva-Lotta
In the same journal
Journal on Multimodal User Interfaces
Media EngineeringInteraction TechnologiesSignal Processing

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 85 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf