Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making

Brian Cleland, Jonathan Wallace, Raymond Bond, Salla Muuraiskangas, Juha Pajula, Gorka Epelde, Mónica Arrúe, Roberto Álvarez, Michaela Black, Maurice D. Mulvenna, Deborah Rankin, Paul Carlin

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

Abstract

The increasingly important role of big data in organisational decision-making brings with it significant challenges in terms of designing usable software interfaces. Specifically, such interfaces must allow users to explore, analyse, and visualise complex data from heterogeneous sources and derive insights to support management decisions. This paper describes a usability evaluation of the MIDAS Project, a big data platform for health policy-making, developed by an EU-funded Horizon 2020 project involving a number of international partners and pilot sites. We describe how a combination of heuristic and formative user-centred evaluation methods were employed, and give a summary of the key findings. We discuss key insights from the evaluation, including the importance of having diverse users, the role played by users’ prior expectations, and the logistical challenge of coordinating user testing across multiple sites. Finally, we explore the relative value of each of the evaluation methods, and outline how our approach to usability testing will evolve for future iterations of the MIDAS platform.

Original languageEnglish
Title of host publicationHuman Interface and the Management of Information
Subtitle of host publicationVisual Information and Knowledge Management, HCII 2019
EditorsSakae Yamamoto, Hirohiko Mori
PublisherSpringer
Pages194-207
Number of pages14
ISBN (Electronic)978-3-030-22660-2
ISBN (Print)978-3-030-22659-6
DOIs
Publication statusPublished - 2019
MoE publication typeA4 Article in a conference publication
EventThematic Area on Human Interface and the Management of Information, HIMI 2019 : held as part of the 21st International Conference on Human-Computer Interaction, HCI International 2019 - Orlando, United States
Duration: 26 Jul 201931 Jul 2019

Conference

ConferenceThematic Area on Human Interface and the Management of Information, HIMI 2019
CountryUnited States
CityOrlando
Period26/07/1931/07/19

Fingerprint

Usability Evaluation
Health
Testing
Evaluation Method
Decision making
Usability Testing
Multiple Testing
Horizon
Decision Making
Policy
Big data
Heuristics
Iteration
Software
Evaluation

Keywords

  • Big data
  • Evaluation
  • Health
  • Policy-making
  • Usability
  • User-centred

Cite this

Cleland, B., Wallace, J., Bond, R., Muuraiskangas, S., Pajula, J., Epelde, G., ... Carlin, P. (2019). Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. In S. Yamamoto, & H. Mori (Eds.), Human Interface and the Management of Information: Visual Information and Knowledge Management, HCII 2019 (pp. 194-207). Springer. Lecture Notes in Computer Science, Vol.. 11569 https://doi.org/10.1007/978-3-030-22660-2_13
Cleland, Brian ; Wallace, Jonathan ; Bond, Raymond ; Muuraiskangas, Salla ; Pajula, Juha ; Epelde, Gorka ; Arrúe, Mónica ; Álvarez, Roberto ; Black, Michaela ; Mulvenna, Maurice D. ; Rankin, Deborah ; Carlin, Paul. / Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. Human Interface and the Management of Information: Visual Information and Knowledge Management, HCII 2019. editor / Sakae Yamamoto ; Hirohiko Mori. Springer, 2019. pp. 194-207 (Lecture Notes in Computer Science, Vol. 11569).
@inproceedings{d60951b090bd40a092da2e29f2067c3a,
title = "Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making",
abstract = "The increasingly important role of big data in organisational decision-making brings with it significant challenges in terms of designing usable software interfaces. Specifically, such interfaces must allow users to explore, analyse, and visualise complex data from heterogeneous sources and derive insights to support management decisions. This paper describes a usability evaluation of the MIDAS Project, a big data platform for health policy-making, developed by an EU-funded Horizon 2020 project involving a number of international partners and pilot sites. We describe how a combination of heuristic and formative user-centred evaluation methods were employed, and give a summary of the key findings. We discuss key insights from the evaluation, including the importance of having diverse users, the role played by users’ prior expectations, and the logistical challenge of coordinating user testing across multiple sites. Finally, we explore the relative value of each of the evaluation methods, and outline how our approach to usability testing will evolve for future iterations of the MIDAS platform.",
keywords = "Big data, Evaluation, Health, Policy-making, Usability, User-centred",
author = "Brian Cleland and Jonathan Wallace and Raymond Bond and Salla Muuraiskangas and Juha Pajula and Gorka Epelde and M{\'o}nica Arr{\'u}e and Roberto {\'A}lvarez and Michaela Black and Mulvenna, {Maurice D.} and Deborah Rankin and Paul Carlin",
year = "2019",
doi = "10.1007/978-3-030-22660-2_13",
language = "English",
isbn = "978-3-030-22659-6",
pages = "194--207",
editor = "Sakae Yamamoto and Hirohiko Mori",
booktitle = "Human Interface and the Management of Information",
publisher = "Springer",
address = "Germany",

}

Cleland, B, Wallace, J, Bond, R, Muuraiskangas, S, Pajula, J, Epelde, G, Arrúe, M, Álvarez, R, Black, M, Mulvenna, MD, Rankin, D & Carlin, P 2019, Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. in S Yamamoto & H Mori (eds), Human Interface and the Management of Information: Visual Information and Knowledge Management, HCII 2019. Springer, Lecture Notes in Computer Science, vol. 11569, pp. 194-207, Thematic Area on Human Interface and the Management of Information, HIMI 2019 , Orlando, United States, 26/07/19. https://doi.org/10.1007/978-3-030-22660-2_13

Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. / Cleland, Brian; Wallace, Jonathan; Bond, Raymond; Muuraiskangas, Salla; Pajula, Juha; Epelde, Gorka; Arrúe, Mónica; Álvarez, Roberto; Black, Michaela; Mulvenna, Maurice D.; Rankin, Deborah; Carlin, Paul.

Human Interface and the Management of Information: Visual Information and Knowledge Management, HCII 2019. ed. / Sakae Yamamoto; Hirohiko Mori. Springer, 2019. p. 194-207 (Lecture Notes in Computer Science, Vol. 11569).

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

TY - GEN

T1 - Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making

AU - Cleland, Brian

AU - Wallace, Jonathan

AU - Bond, Raymond

AU - Muuraiskangas, Salla

AU - Pajula, Juha

AU - Epelde, Gorka

AU - Arrúe, Mónica

AU - Álvarez, Roberto

AU - Black, Michaela

AU - Mulvenna, Maurice D.

AU - Rankin, Deborah

AU - Carlin, Paul

PY - 2019

Y1 - 2019

N2 - The increasingly important role of big data in organisational decision-making brings with it significant challenges in terms of designing usable software interfaces. Specifically, such interfaces must allow users to explore, analyse, and visualise complex data from heterogeneous sources and derive insights to support management decisions. This paper describes a usability evaluation of the MIDAS Project, a big data platform for health policy-making, developed by an EU-funded Horizon 2020 project involving a number of international partners and pilot sites. We describe how a combination of heuristic and formative user-centred evaluation methods were employed, and give a summary of the key findings. We discuss key insights from the evaluation, including the importance of having diverse users, the role played by users’ prior expectations, and the logistical challenge of coordinating user testing across multiple sites. Finally, we explore the relative value of each of the evaluation methods, and outline how our approach to usability testing will evolve for future iterations of the MIDAS platform.

AB - The increasingly important role of big data in organisational decision-making brings with it significant challenges in terms of designing usable software interfaces. Specifically, such interfaces must allow users to explore, analyse, and visualise complex data from heterogeneous sources and derive insights to support management decisions. This paper describes a usability evaluation of the MIDAS Project, a big data platform for health policy-making, developed by an EU-funded Horizon 2020 project involving a number of international partners and pilot sites. We describe how a combination of heuristic and formative user-centred evaluation methods were employed, and give a summary of the key findings. We discuss key insights from the evaluation, including the importance of having diverse users, the role played by users’ prior expectations, and the logistical challenge of coordinating user testing across multiple sites. Finally, we explore the relative value of each of the evaluation methods, and outline how our approach to usability testing will evolve for future iterations of the MIDAS platform.

KW - Big data

KW - Evaluation

KW - Health

KW - Policy-making

KW - Usability

KW - User-centred

UR - http://www.scopus.com/inward/record.url?scp=85069809567&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-22660-2_13

DO - 10.1007/978-3-030-22660-2_13

M3 - Conference article in proceedings

SN - 978-3-030-22659-6

SP - 194

EP - 207

BT - Human Interface and the Management of Information

A2 - Yamamoto, Sakae

A2 - Mori, Hirohiko

PB - Springer

ER -

Cleland B, Wallace J, Bond R, Muuraiskangas S, Pajula J, Epelde G et al. Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. In Yamamoto S, Mori H, editors, Human Interface and the Management of Information: Visual Information and Knowledge Management, HCII 2019. Springer. 2019. p. 194-207. (Lecture Notes in Computer Science, Vol. 11569). https://doi.org/10.1007/978-3-030-22660-2_13