Multimodality Evaluation Metrics for Human-Robot Interaction Needed: A Case Study in Immersive Telerobotics

Iina Aaltonen, Susanna Aromaa, Kaj Helin, Ali Muhammad

    Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

    4 Citations (Scopus)


    Multimodal, wearable technologies have the potential to enable a completely immersive teleoperation experience, which can be beneficial for a number of teleoperated robotic applications. To gain the full benefit of these technologies, understanding the user perspective of human-robot interaction (HRI) is of special relevance for highly advanced telerobotic systems in the future. In telerobotics research, however, the complex nature of multimodal interaction has not attracted much attention. We studied HRI with a wearable multimodal control system used for teleoperating a mobile robot, and recognized a need for evaluation metrics for multimodality. In the case study, questionnaires, interviews, observations and video analysis were used to evaluate usability, ergonomics, immersion, and the nature of multimodal interaction. Although the technical setup was challenging, our findings provide insights to the design and evaluation of user interaction of future immersive teleoperation systems. We propose new HRI evaluation metrics: Type of multimodal interaction and Wearability.

    Original languageEnglish
    Title of host publicationAdvances in Human Factors in Robots and Unmanned Systems. AHFE 2017
    EditorsJessie Chen
    Number of pages13
    ISBN (Print)978-3-319-60383-4, 978-3-319-60384-1
    Publication statusPublished - 1 Jan 2018
    MoE publication typeA4 Article in a conference publication
    EventInternational Conference on Applied Human Factors and Ergonomics: International Conference on Human Factors in Robots and Unmanned Systems - Los Angeles, United States
    Duration: 17 Jul 201721 Jul 2017

    Publication series

    SeriesAdvances in Intelligent Systems and Computing


    ConferenceInternational Conference on Applied Human Factors and Ergonomics
    Abbreviated titleAHFE 2017
    Country/TerritoryUnited States
    CityLos Angeles


    • human-robot interaction
    • immersion
    • metrics
    • multimodal
    • telerobotics
    • user studies
    • wearable


    Dive into the research topics of 'Multimodality Evaluation Metrics for Human-Robot Interaction Needed: A Case Study in Immersive Telerobotics'. Together they form a unique fingerprint.

    Cite this