Multimodality Evaluation Metrics for Human-Robot Interaction Needed: A Case Study in Immersive Telerobotics

Iina Aaltonen; Susanna Aromaa; Kaj Helin; Ali Muhammad

doi:10.1007/978-3-319-60384-1_32

Multimodality Evaluation Metrics for Human-Robot Interaction Needed: A Case Study in Immersive Telerobotics

Iina Aaltonen
, Susanna Aromaa
, Kaj Helin
, Ali Muhammad

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

6 Citations (Scopus)

Abstract

Multimodal, wearable technologies have the potential to enable a completely immersive teleoperation experience, which can be beneficial for a number of teleoperated robotic applications. To gain the full benefit of these technologies, understanding the user perspective of human-robot interaction (HRI) is of special relevance for highly advanced telerobotic systems in the future. In telerobotics research, however, the complex nature of multimodal interaction has not attracted much attention. We studied HRI with a wearable multimodal control system used for teleoperating a mobile robot, and recognized a need for evaluation metrics for multimodality. In the case study, questionnaires, interviews, observations and video analysis were used to evaluate usability, ergonomics, immersion, and the nature of multimodal interaction. Although the technical setup was challenging, our findings provide insights to the design and evaluation of user interaction of future immersive teleoperation systems. We propose new HRI evaluation metrics: Type of multimodal interaction and Wearability.

Original language	English
Title of host publication	Advances in Human Factors in Robots and Unmanned Systems. AHFE 2017
Editors	Jessie Chen
Publisher	Springer
Pages	335-347
Number of pages	13
ISBN (Print)	978-3-319-60383-4, 978-3-319-60384-1
DOIs	https://doi.org/10.1007/978-3-319-60384-1_32
Publication status	Published - 1 Jan 2018
MoE publication type	A4 Article in a conference publication
Event	8th International Conference on Applied Human Factors and Ergonomics, AHFE 2015 - Los Angeles, United States Duration: 17 Jul 2017 → 21 Jul 2017 Conference number: 8

Publication series

Series	Advances in Intelligent Systems and Computing
ISSN	2194-5357

Conference

Conference	8th International Conference on Applied Human Factors and Ergonomics, AHFE 2015
Abbreviated title	AHFE 2017
Country/Territory	United States
City	Los Angeles
Period	17/07/17 → 21/07/17

Keywords

human-robot interaction
immersion
metrics
multimodal
telerobotics
user studies
wearable

Access to Document

10.1007/978-3-319-60384-1_32

Cite this

@inproceedings{49a7247cd80943868eabec6f8aa70091,

title = "Multimodality Evaluation Metrics for Human-Robot Interaction Needed: A Case Study in Immersive Telerobotics",

abstract = "Multimodal, wearable technologies have the potential to enable a completely immersive teleoperation experience, which can be beneficial for a number of teleoperated robotic applications. To gain the full benefit of these technologies, understanding the user perspective of human-robot interaction (HRI) is of special relevance for highly advanced telerobotic systems in the future. In telerobotics research, however, the complex nature of multimodal interaction has not attracted much attention. We studied HRI with a wearable multimodal control system used for teleoperating a mobile robot, and recognized a need for evaluation metrics for multimodality. In the case study, questionnaires, interviews, observations and video analysis were used to evaluate usability, ergonomics, immersion, and the nature of multimodal interaction. Although the technical setup was challenging, our findings provide insights to the design and evaluation of user interaction of future immersive teleoperation systems. We propose new HRI evaluation metrics: Type of multimodal interaction and Wearability.",

keywords = "human-robot interaction, immersion, metrics, multimodal, telerobotics, user studies, wearable",

author = "Iina Aaltonen and Susanna Aromaa and Kaj Helin and Ali Muhammad",

note = "Funding Information: We thank test participants. Research funded under the European Commission{\textquoteright}s Seventh Framework Aeronautics and Air Transport (AAT) programme in the project VR-HYPERSPACE (AAT-285681) {\textquoteleft}The innovative use of virtual and mixed reality to increase human comfort by changing the perception of self and space{\textquoteright}. The work of I. Aaltonen was supported by Wihuri Foundation. Funding Information: Acknowledgements. We thank test participants. Research funded under the European Commission{\textquoteright}s Seventh Framework Aeronautics and Air Transport (AAT) programme in the project VR-HYPERSPACE (AAT-285681) {\textquoteleft}The innovative use of virtual and mixed reality to increase human comfort by changing the perception of self and space{\textquoteright}. The work of I. Aaltonen was supported by Wihuri Foundation. Publisher Copyright: {\textcopyright} Springer International Publishing AG 2018. Copyright: Copyright 2018 Elsevier B.V., All rights reserved.; 8th International Conference on Applied Human Factors and Ergonomics, AHFE 2015, AHFE 2017 ; Conference date: 17-07-2017 Through 21-07-2017",

year = "2018",

month = jan,

day = "1",

doi = "10.1007/978-3-319-60384-1\_32",

language = "English",

isbn = "978-3-319-60383-4",

series = "Advances in Intelligent Systems and Computing",

pages = "335--347",

editor = "Jessie Chen",

booktitle = "Advances in Human Factors in Robots and Unmanned Systems. AHFE 2017",

publisher = "Springer",

address = "Germany",

}

Aaltonen, I, Aromaa, S , Helin, K & Muhammad, A 2018, Multimodality Evaluation Metrics for Human-Robot Interaction Needed: A Case Study in Immersive Telerobotics. in J Chen (ed.), Advances in Human Factors in Robots and Unmanned Systems. AHFE 2017. Springer, Advances in Intelligent Systems and Computing, pp. 335-347, 8th International Conference on Applied Human Factors and Ergonomics, AHFE 2015, Los Angeles, California, United States, 17/07/17. https://doi.org/10.1007/978-3-319-60384-1_32

Multimodality Evaluation Metrics for Human-Robot Interaction Needed: A Case Study in Immersive Telerobotics. / Aaltonen, Iina; Aromaa, Susanna ; Helin, Kaj et al.
Advances in Human Factors in Robots and Unmanned Systems. AHFE 2017. ed. / Jessie Chen. Springer, 2018. p. 335-347 (Advances in Intelligent Systems and Computing).

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

TY - GEN

T1 - Multimodality Evaluation Metrics for Human-Robot Interaction Needed

T2 - 8th International Conference on Applied Human Factors and Ergonomics, AHFE 2015

AU - Aaltonen, Iina

AU - Aromaa, Susanna

AU - Helin, Kaj

AU - Muhammad, Ali

N1 - Conference code: 8

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Multimodal, wearable technologies have the potential to enable a completely immersive teleoperation experience, which can be beneficial for a number of teleoperated robotic applications. To gain the full benefit of these technologies, understanding the user perspective of human-robot interaction (HRI) is of special relevance for highly advanced telerobotic systems in the future. In telerobotics research, however, the complex nature of multimodal interaction has not attracted much attention. We studied HRI with a wearable multimodal control system used for teleoperating a mobile robot, and recognized a need for evaluation metrics for multimodality. In the case study, questionnaires, interviews, observations and video analysis were used to evaluate usability, ergonomics, immersion, and the nature of multimodal interaction. Although the technical setup was challenging, our findings provide insights to the design and evaluation of user interaction of future immersive teleoperation systems. We propose new HRI evaluation metrics: Type of multimodal interaction and Wearability.

AB - Multimodal, wearable technologies have the potential to enable a completely immersive teleoperation experience, which can be beneficial for a number of teleoperated robotic applications. To gain the full benefit of these technologies, understanding the user perspective of human-robot interaction (HRI) is of special relevance for highly advanced telerobotic systems in the future. In telerobotics research, however, the complex nature of multimodal interaction has not attracted much attention. We studied HRI with a wearable multimodal control system used for teleoperating a mobile robot, and recognized a need for evaluation metrics for multimodality. In the case study, questionnaires, interviews, observations and video analysis were used to evaluate usability, ergonomics, immersion, and the nature of multimodal interaction. Although the technical setup was challenging, our findings provide insights to the design and evaluation of user interaction of future immersive teleoperation systems. We propose new HRI evaluation metrics: Type of multimodal interaction and Wearability.

KW - human-robot interaction

KW - immersion

KW - metrics

KW - multimodal

KW - telerobotics

KW - user studies

KW - wearable

UR - https://www.scopus.com/pages/publications/85041041850

U2 - 10.1007/978-3-319-60384-1_32

DO - 10.1007/978-3-319-60384-1_32

M3 - Conference article in proceedings

SN - 978-3-319-60383-4

SN - 978-3-319-60384-1

T3 - Advances in Intelligent Systems and Computing

SP - 335

EP - 347

BT - Advances in Human Factors in Robots and Unmanned Systems. AHFE 2017

A2 - Chen, Jessie

PB - Springer

Y2 - 17 July 2017 through 21 July 2017

ER -

Multimodality Evaluation Metrics for Human-Robot Interaction Needed: A Case Study in Immersive Telerobotics

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this