Evaluating the experiential user experience of public display applications in the wild

Tuuli Keskinen, Jaakko Hakulinen, Tomi Heimonen, Markku Turunen, Sumita Sharma, Toni Miettinen, Matti Luhtala

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

10 Citations (Scopus)

Abstract

Studying pervasive systems in the wild has recently gained significant interest. However, few methods exist that focus on the subjective of user experience of such systems rather than objective metrics, like performance and task success. Especially multimodal interaction in this context poses challenges to understanding how different input and output methods affect the users' experience. We present a new method for evaluating the experiential user experience of interactive systems. It combines two existing approaches from different fields: a questionnaire-based evaluation method called SUXES, intended for evaluating user expectations and experiences, and a theoretical experience framework, Experience Pyramid, originally developed for analyzing and improving experiential tourism products. The new method was used in two field studies of multimodal public display applications. Our findings show that the method is a practical approach for user experience evaluation in the wild, especially in the case of pervasive applications that aim to provide novel experiences rather than facilitate task-oriented information access. © 2013 ACM.
Original languageEnglish
Title of host publicationMUM '13: Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia
PublisherAssociation for Computing Machinery ACM
Number of pages10
ISBN (Print)978-1-4503-2648-3
DOIs
Publication statusPublished - 2013
MoE publication typeA4 Article in a conference publication
Event12th International Conference on Mobile and Ubiquitous Multimedia, MUM'13 - Luleå, Sweden
Duration: 2 Dec 20135 Dec 2013

Conference

Conference12th International Conference on Mobile and Ubiquitous Multimedia, MUM'13
CountrySweden
CityLuleå
Period2/12/135/12/13

Fingerprint

Display devices

Keywords

  • In situ evaluation
  • Measurement
  • Public displays
  • User experience

Cite this

Keskinen, T., Hakulinen, J., Heimonen, T., Turunen, M., Sharma, S., Miettinen, T., & Luhtala, M. (2013). Evaluating the experiential user experience of public display applications in the wild. In MUM '13: Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia [7] Association for Computing Machinery ACM. https://doi.org/10.1145/2541831.2541840
Keskinen, Tuuli ; Hakulinen, Jaakko ; Heimonen, Tomi ; Turunen, Markku ; Sharma, Sumita ; Miettinen, Toni ; Luhtala, Matti. / Evaluating the experiential user experience of public display applications in the wild. MUM '13: Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia. Association for Computing Machinery ACM, 2013.
@inproceedings{332da6e30aeb48829615b0ae53fa9c59,
title = "Evaluating the experiential user experience of public display applications in the wild",
abstract = "Studying pervasive systems in the wild has recently gained significant interest. However, few methods exist that focus on the subjective of user experience of such systems rather than objective metrics, like performance and task success. Especially multimodal interaction in this context poses challenges to understanding how different input and output methods affect the users' experience. We present a new method for evaluating the experiential user experience of interactive systems. It combines two existing approaches from different fields: a questionnaire-based evaluation method called SUXES, intended for evaluating user expectations and experiences, and a theoretical experience framework, Experience Pyramid, originally developed for analyzing and improving experiential tourism products. The new method was used in two field studies of multimodal public display applications. Our findings show that the method is a practical approach for user experience evaluation in the wild, especially in the case of pervasive applications that aim to provide novel experiences rather than facilitate task-oriented information access. {\circledC} 2013 ACM.",
keywords = "In situ evaluation, Measurement, Public displays, User experience",
author = "Tuuli Keskinen and Jaakko Hakulinen and Tomi Heimonen and Markku Turunen and Sumita Sharma and Toni Miettinen and Matti Luhtala",
year = "2013",
doi = "10.1145/2541831.2541840",
language = "English",
isbn = "978-1-4503-2648-3",
booktitle = "MUM '13: Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia",
publisher = "Association for Computing Machinery ACM",
address = "United States",

}

Keskinen, T, Hakulinen, J, Heimonen, T, Turunen, M, Sharma, S, Miettinen, T & Luhtala, M 2013, Evaluating the experiential user experience of public display applications in the wild. in MUM '13: Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia., 7, Association for Computing Machinery ACM, 12th International Conference on Mobile and Ubiquitous Multimedia, MUM'13, Luleå, Sweden, 2/12/13. https://doi.org/10.1145/2541831.2541840

Evaluating the experiential user experience of public display applications in the wild. / Keskinen, Tuuli; Hakulinen, Jaakko; Heimonen, Tomi; Turunen, Markku; Sharma, Sumita; Miettinen, Toni; Luhtala, Matti.

MUM '13: Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia. Association for Computing Machinery ACM, 2013. 7.

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

TY - GEN

T1 - Evaluating the experiential user experience of public display applications in the wild

AU - Keskinen, Tuuli

AU - Hakulinen, Jaakko

AU - Heimonen, Tomi

AU - Turunen, Markku

AU - Sharma, Sumita

AU - Miettinen, Toni

AU - Luhtala, Matti

PY - 2013

Y1 - 2013

N2 - Studying pervasive systems in the wild has recently gained significant interest. However, few methods exist that focus on the subjective of user experience of such systems rather than objective metrics, like performance and task success. Especially multimodal interaction in this context poses challenges to understanding how different input and output methods affect the users' experience. We present a new method for evaluating the experiential user experience of interactive systems. It combines two existing approaches from different fields: a questionnaire-based evaluation method called SUXES, intended for evaluating user expectations and experiences, and a theoretical experience framework, Experience Pyramid, originally developed for analyzing and improving experiential tourism products. The new method was used in two field studies of multimodal public display applications. Our findings show that the method is a practical approach for user experience evaluation in the wild, especially in the case of pervasive applications that aim to provide novel experiences rather than facilitate task-oriented information access. © 2013 ACM.

AB - Studying pervasive systems in the wild has recently gained significant interest. However, few methods exist that focus on the subjective of user experience of such systems rather than objective metrics, like performance and task success. Especially multimodal interaction in this context poses challenges to understanding how different input and output methods affect the users' experience. We present a new method for evaluating the experiential user experience of interactive systems. It combines two existing approaches from different fields: a questionnaire-based evaluation method called SUXES, intended for evaluating user expectations and experiences, and a theoretical experience framework, Experience Pyramid, originally developed for analyzing and improving experiential tourism products. The new method was used in two field studies of multimodal public display applications. Our findings show that the method is a practical approach for user experience evaluation in the wild, especially in the case of pervasive applications that aim to provide novel experiences rather than facilitate task-oriented information access. © 2013 ACM.

KW - In situ evaluation

KW - Measurement

KW - Public displays

KW - User experience

U2 - 10.1145/2541831.2541840

DO - 10.1145/2541831.2541840

M3 - Conference article in proceedings

SN - 978-1-4503-2648-3

BT - MUM '13: Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia

PB - Association for Computing Machinery ACM

ER -

Keskinen T, Hakulinen J, Heimonen T, Turunen M, Sharma S, Miettinen T et al. Evaluating the experiential user experience of public display applications in the wild. In MUM '13: Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia. Association for Computing Machinery ACM. 2013. 7 https://doi.org/10.1145/2541831.2541840