The MuMMER project: Engaging human-robot interaction in real-world public spaces

Mary Ellen Foster (Corresponding author), Rachid Alami, Olli Gestranius, Oliver Lemon, Marketta Niemelä, Jean-Marc Odobez, Amit Kumar Pandey

    Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

    21 Citations (Scopus)

    Abstract

    MuMMER (MultiModal Mall Entertainment Robot) is a four-year, EU-funded project with the overall goal of developing a humanoid robot (SoftBank Robotics' Pepper robot being the primary robot platform) with the social intelligence to interact autonomously and naturally in the dynamic environments of a public shopping mall, providing an engaging and entertaining experience to the general public. Using co-design methods, we will work together with stakeholders including customers, retailers, and business managers to develop truly engaging robot behaviours. Crucially, our robot will exhibit behaviour that is socially appropriate and engaging by combining speech-based interaction with non-verbal communication and human-aware navigation. To support this behaviour, we will develop and integrate new methods from audiovisual scene processing, socials ignal processing, high-level action selection, and human-aware robot navigation. Throughout the project, the robot will be regularly deployed in Ideapark, a large public shopping mall in Finland. This position paper describes the MuMMER project: its needs, the objectives, R&D challenges and our approach. It will serve as reference for the robotics community and stakeholders about this ambitious project, demonstrating how a co-design approach can address some of the barriers and help in building follow-up projects.
    Original languageEnglish
    Title of host publicationSocial Robotics
    PublisherSpringer
    Pages753-763
    ISBN (Print)978-3-319-47436-6, 978-3-319-47437-3
    DOIs
    Publication statusPublished - 2016
    MoE publication typeA4 Article in a conference publication
    Event8th International Conference on Social Robotics, ICSR 2016 - Kansas City, United States
    Duration: 1 Nov 20163 Nov 2016

    Publication series

    SeriesLecture Notes in Computer Science
    VolumeVolume 9979

    Conference

    Conference8th International Conference on Social Robotics, ICSR 2016
    Abbreviated title ICSR 2016
    CountryUnited States
    CityKansas City
    Period1/11/163/11/16

    Fingerprint

    Shopping centers
    Human robot interaction
    Robots
    Navigation
    Robotics
    Processing
    Managers

    Keywords

    • social robots
    • pepper
    • humanoid
    • human-robot interaction
    • social intelligence
    • shopping mall
    • retail
    • co-design
    • acceptance

    Cite this

    Foster, M. E., Alami, R., Gestranius, O., Lemon, O., Niemelä, M., Odobez, J-M., & Pandey, A. K. (2016). The MuMMER project: Engaging human-robot interaction in real-world public spaces. In Social Robotics (pp. 753-763). Springer. Lecture Notes in Computer Science, Vol.. Volume 9979 https://doi.org/10.1007/978-3-319-47437-3_74
    Foster, Mary Ellen ; Alami, Rachid ; Gestranius, Olli ; Lemon, Oliver ; Niemelä, Marketta ; Odobez, Jean-Marc ; Pandey, Amit Kumar. / The MuMMER project: Engaging human-robot interaction in real-world public spaces. Social Robotics. Springer, 2016. pp. 753-763 (Lecture Notes in Computer Science, Vol. Volume 9979).
    @inproceedings{6e66d676e387468a83f949056d65d253,
    title = "The MuMMER project: Engaging human-robot interaction in real-world public spaces",
    abstract = "MuMMER (MultiModal Mall Entertainment Robot) is a four-year, EU-funded project with the overall goal of developing a humanoid robot (SoftBank Robotics' Pepper robot being the primary robot platform) with the social intelligence to interact autonomously and naturally in the dynamic environments of a public shopping mall, providing an engaging and entertaining experience to the general public. Using co-design methods, we will work together with stakeholders including customers, retailers, and business managers to develop truly engaging robot behaviours. Crucially, our robot will exhibit behaviour that is socially appropriate and engaging by combining speech-based interaction with non-verbal communication and human-aware navigation. To support this behaviour, we will develop and integrate new methods from audiovisual scene processing, socials ignal processing, high-level action selection, and human-aware robot navigation. Throughout the project, the robot will be regularly deployed in Ideapark, a large public shopping mall in Finland. This position paper describes the MuMMER project: its needs, the objectives, R&D challenges and our approach. It will serve as reference for the robotics community and stakeholders about this ambitious project, demonstrating how a co-design approach can address some of the barriers and help in building follow-up projects.",
    keywords = "social robots, pepper, humanoid, human-robot interaction, social intelligence, shopping mall, retail, co-design, acceptance",
    author = "Foster, {Mary Ellen} and Rachid Alami and Olli Gestranius and Oliver Lemon and Marketta Niemel{\"a} and Jean-Marc Odobez and Pandey, {Amit Kumar}",
    year = "2016",
    doi = "10.1007/978-3-319-47437-3_74",
    language = "English",
    isbn = "978-3-319-47436-6",
    series = "Lecture Notes in Computer Science",
    publisher = "Springer",
    pages = "753--763",
    booktitle = "Social Robotics",
    address = "Germany",

    }

    Foster, ME, Alami, R, Gestranius, O, Lemon, O, Niemelä, M, Odobez, J-M & Pandey, AK 2016, The MuMMER project: Engaging human-robot interaction in real-world public spaces. in Social Robotics. Springer, Lecture Notes in Computer Science, vol. Volume 9979, pp. 753-763, 8th International Conference on Social Robotics, ICSR 2016, Kansas City, United States, 1/11/16. https://doi.org/10.1007/978-3-319-47437-3_74

    The MuMMER project: Engaging human-robot interaction in real-world public spaces. / Foster, Mary Ellen (Corresponding author); Alami, Rachid; Gestranius, Olli; Lemon, Oliver; Niemelä, Marketta; Odobez, Jean-Marc; Pandey, Amit Kumar.

    Social Robotics. Springer, 2016. p. 753-763 (Lecture Notes in Computer Science, Vol. Volume 9979).

    Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

    TY - GEN

    T1 - The MuMMER project: Engaging human-robot interaction in real-world public spaces

    AU - Foster, Mary Ellen

    AU - Alami, Rachid

    AU - Gestranius, Olli

    AU - Lemon, Oliver

    AU - Niemelä, Marketta

    AU - Odobez, Jean-Marc

    AU - Pandey, Amit Kumar

    PY - 2016

    Y1 - 2016

    N2 - MuMMER (MultiModal Mall Entertainment Robot) is a four-year, EU-funded project with the overall goal of developing a humanoid robot (SoftBank Robotics' Pepper robot being the primary robot platform) with the social intelligence to interact autonomously and naturally in the dynamic environments of a public shopping mall, providing an engaging and entertaining experience to the general public. Using co-design methods, we will work together with stakeholders including customers, retailers, and business managers to develop truly engaging robot behaviours. Crucially, our robot will exhibit behaviour that is socially appropriate and engaging by combining speech-based interaction with non-verbal communication and human-aware navigation. To support this behaviour, we will develop and integrate new methods from audiovisual scene processing, socials ignal processing, high-level action selection, and human-aware robot navigation. Throughout the project, the robot will be regularly deployed in Ideapark, a large public shopping mall in Finland. This position paper describes the MuMMER project: its needs, the objectives, R&D challenges and our approach. It will serve as reference for the robotics community and stakeholders about this ambitious project, demonstrating how a co-design approach can address some of the barriers and help in building follow-up projects.

    AB - MuMMER (MultiModal Mall Entertainment Robot) is a four-year, EU-funded project with the overall goal of developing a humanoid robot (SoftBank Robotics' Pepper robot being the primary robot platform) with the social intelligence to interact autonomously and naturally in the dynamic environments of a public shopping mall, providing an engaging and entertaining experience to the general public. Using co-design methods, we will work together with stakeholders including customers, retailers, and business managers to develop truly engaging robot behaviours. Crucially, our robot will exhibit behaviour that is socially appropriate and engaging by combining speech-based interaction with non-verbal communication and human-aware navigation. To support this behaviour, we will develop and integrate new methods from audiovisual scene processing, socials ignal processing, high-level action selection, and human-aware robot navigation. Throughout the project, the robot will be regularly deployed in Ideapark, a large public shopping mall in Finland. This position paper describes the MuMMER project: its needs, the objectives, R&D challenges and our approach. It will serve as reference for the robotics community and stakeholders about this ambitious project, demonstrating how a co-design approach can address some of the barriers and help in building follow-up projects.

    KW - social robots

    KW - pepper

    KW - humanoid

    KW - human-robot interaction

    KW - social intelligence

    KW - shopping mall

    KW - retail

    KW - co-design

    KW - acceptance

    U2 - 10.1007/978-3-319-47437-3_74

    DO - 10.1007/978-3-319-47437-3_74

    M3 - Conference article in proceedings

    SN - 978-3-319-47436-6

    SN - 978-3-319-47437-3

    T3 - Lecture Notes in Computer Science

    SP - 753

    EP - 763

    BT - Social Robotics

    PB - Springer

    ER -

    Foster ME, Alami R, Gestranius O, Lemon O, Niemelä M, Odobez J-M et al. The MuMMER project: Engaging human-robot interaction in real-world public spaces. In Social Robotics. Springer. 2016. p. 753-763. (Lecture Notes in Computer Science, Vol. Volume 9979). https://doi.org/10.1007/978-3-319-47437-3_74