User-based Evaluation of a Proof-of-Concept for a Complex Service Robot System

The use of advanced technologies that collaborate with humans in work contexts is increasing. Designing these complex systems to support smooth collaboration and a good user experience can be challenging. The goal of this study was two-fold: to understand which kinds of human factors and ergonomics (HFE) methods would be suitable for user-based evaluation of a proof-of-concept (PoC) and to examine the experience of interacting with a multipurpose robot. To achieve these objectives, three HFE methods were applied: a questionnaire, interviews, and observation. Additionally, a Wizard of Oz approach was utilised. As a result, qualitative HFE approaches such as interviews and observations were seen as beneficial in the evaluation of novel PoCs in an early design phase. Regarding the robot system, the results revealed that the interaction was experienced as fluent and natural. However, some concerns were identified, such as the robot interrupting other tasks, understanding the status of the robot, and privacy issues. The findings from this study can be used when designing human-robot interactions for multipurpose robots in work contexts and when selecting suitable HFE methods for user-based PoC testing