The MuMMER project: Engaging human-robot interaction in real-world public spaces

Mary Ellen Foster (Corresponding author), Rachid Alami, Olli Gestranius, Oliver Lemon, Marketta Niemelä, Jean-Marc Odobez, Amit Kumar Pandey

    Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

    52 Citations (Scopus)


    MuMMER (MultiModal Mall Entertainment Robot) is a four-year, EU-funded project with the overall goal of developing a humanoid robot (SoftBank Robotics' Pepper robot being the primary robot platform) with the social intelligence to interact autonomously and naturally in the dynamic environments of a public shopping mall, providing an engaging and entertaining experience to the general public. Using co-design methods, we will work together with stakeholders including customers, retailers, and business managers to develop truly engaging robot behaviours. Crucially, our robot will exhibit behaviour that is socially appropriate and engaging by combining speech-based interaction with non-verbal communication and human-aware navigation. To support this behaviour, we will develop and integrate new methods from audiovisual scene processing, socials ignal processing, high-level action selection, and human-aware robot navigation. Throughout the project, the robot will be regularly deployed in Ideapark, a large public shopping mall in Finland. This position paper describes the MuMMER project: its needs, the objectives, R&D challenges and our approach. It will serve as reference for the robotics community and stakeholders about this ambitious project, demonstrating how a co-design approach can address some of the barriers and help in building follow-up projects.
    Original languageEnglish
    Title of host publicationSocial Robotics
    ISBN (Print)978-3-319-47436-6, 978-3-319-47437-3
    Publication statusPublished - 2016
    MoE publication typeA4 Article in a conference publication
    Event8th International Conference on Social Robotics, ICSR 2016 - Kansas City, United States
    Duration: 1 Nov 20163 Nov 2016

    Publication series

    SeriesLecture Notes in Computer Science
    VolumeVolume 9979


    Conference8th International Conference on Social Robotics, ICSR 2016
    Abbreviated title ICSR 2016
    Country/TerritoryUnited States
    CityKansas City


    • social robots
    • pepper
    • humanoid
    • human-robot interaction
    • social intelligence
    • shopping mall
    • retail
    • co-design
    • acceptance


    Dive into the research topics of 'The MuMMER project: Engaging human-robot interaction in real-world public spaces'. Together they form a unique fingerprint.

    Cite this