Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making

Brian Cleland; Jonathan Wallace; Raymond Bond; Salla Muuraiskangas; Juha Pajula; Gorka Epelde; Mónica Arrúe; Roberto Álvarez; Michaela Black; Maurice D. Mulvenna; Deborah Rankin; Paul Carlin

doi:10.1007/978-3-030-22660-2_13

Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making

Brian Cleland, Jonathan Wallace, Raymond Bond, Salla Muuraiskangas, Juha Pajula, Gorka Epelde, Mónica Arrúe, Roberto Álvarez, Michaela Black, Maurice D. Mulvenna, Deborah Rankin, Paul Carlin

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

Abstract

The increasingly important role of big data in organisational decision-making brings with it significant challenges in terms of designing usable software interfaces. Specifically, such interfaces must allow users to explore, analyse, and visualise complex data from heterogeneous sources and derive insights to support management decisions. This paper describes a usability evaluation of the MIDAS Project, a big data platform for health policy-making, developed by an EU-funded Horizon 2020 project involving a number of international partners and pilot sites. We describe how a combination of heuristic and formative user-centred evaluation methods were employed, and give a summary of the key findings. We discuss key insights from the evaluation, including the importance of having diverse users, the role played by users’ prior expectations, and the logistical challenge of coordinating user testing across multiple sites. Finally, we explore the relative value of each of the evaluation methods, and outline how our approach to usability testing will evolve for future iterations of the MIDAS platform.

Original language	English
Title of host publication	Human Interface and the Management of Information
Subtitle of host publication	Visual Information and Knowledge Management, HCII 2019
Editors	Sakae Yamamoto, Hirohiko Mori
Publisher	Springer
Pages	194-207
Number of pages	14
ISBN (Electronic)	978-3-030-22660-2
ISBN (Print)	978-3-030-22659-6
DOIs	https://doi.org/10.1007/978-3-030-22660-2_13
Publication status	Published - 2019
MoE publication type	A4 Article in a conference publication
Event	Thematic Area on Human Interface and the Management of Information, HIMI 2019 : held as part of the 21st International Conference on Human-Computer Interaction, HCI International 2019 - Orlando, United States Duration: 26 Jul 2019 → 31 Jul 2019

Publication series

Series	Lecture Notes in Computer Science
Volume	11569
ISSN	0302-9743

Conference

Conference	Thematic Area on Human Interface and the Management of Information, HIMI 2019
Country	United States
City	Orlando
Period	26/07/19 → 31/07/19

Fingerprint

Keywords

Big data
Evaluation
Health
Policy-making
Usability
User-centred

Cite this

Cleland, B., Wallace, J., Bond, R., Muuraiskangas, S., Pajula, J., Epelde, G., Arrúe, M., Álvarez, R., Black, M., Mulvenna, M. D., Rankin, D., & Carlin, P. (2019). Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. In S. Yamamoto, & H. Mori (Eds.), Human Interface and the Management of Information: Visual Information and Knowledge Management, HCII 2019 (pp. 194-207). Springer. Lecture Notes in Computer Science, Vol.. 11569 https://doi.org/10.1007/978-3-030-22660-2_13

Cleland, Brian ; Wallace, Jonathan ; Bond, Raymond ; Muuraiskangas, Salla ; Pajula, Juha ; Epelde, Gorka ; Arrúe, Mónica ; Álvarez, Roberto ; Black, Michaela ; Mulvenna, Maurice D. ; Rankin, Deborah ; Carlin, Paul. / Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. Human Interface and the Management of Information: Visual Information and Knowledge Management, HCII 2019. editor / Sakae Yamamoto ; Hirohiko Mori. Springer, 2019. pp. 194-207 (Lecture Notes in Computer Science, Vol. 11569).

@inproceedings{d60951b090bd40a092da2e29f2067c3a,

title = "Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making",

abstract = "The increasingly important role of big data in organisational decision-making brings with it significant challenges in terms of designing usable software interfaces. Specifically, such interfaces must allow users to explore, analyse, and visualise complex data from heterogeneous sources and derive insights to support management decisions. This paper describes a usability evaluation of the MIDAS Project, a big data platform for health policy-making, developed by an EU-funded Horizon 2020 project involving a number of international partners and pilot sites. We describe how a combination of heuristic and formative user-centred evaluation methods were employed, and give a summary of the key findings. We discuss key insights from the evaluation, including the importance of having diverse users, the role played by users{\textquoteright} prior expectations, and the logistical challenge of coordinating user testing across multiple sites. Finally, we explore the relative value of each of the evaluation methods, and outline how our approach to usability testing will evolve for future iterations of the MIDAS platform.",

keywords = "Big data, Evaluation, Health, Policy-making, Usability, User-centred",

author = "Brian Cleland and Jonathan Wallace and Raymond Bond and Salla Muuraiskangas and Juha Pajula and Gorka Epelde and M{\'o}nica Arr{\'u}e and Roberto {\'A}lvarez and Michaela Black and Mulvenna, {Maurice D.} and Deborah Rankin and Paul Carlin",

year = "2019",

doi = "10.1007/978-3-030-22660-2_13",

language = "English",

isbn = "978-3-030-22659-6",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "194--207",

editor = "Sakae Yamamoto and Hirohiko Mori",

booktitle = "Human Interface and the Management of Information",

address = "Germany",

note = "Thematic Area on Human Interface and the Management of Information, HIMI 2019 : held as part of the 21st International Conference on Human-Computer Interaction, HCI International 2019 ; Conference date: 26-07-2019 Through 31-07-2019",

}

Cleland, B, Wallace, J, Bond, R, Muuraiskangas, S , Pajula, J, Epelde, G, Arrúe, M, Álvarez, R, Black, M, Mulvenna, MD, Rankin, D & Carlin, P 2019, Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. in S Yamamoto & H Mori (eds), Human Interface and the Management of Information: Visual Information and Knowledge Management, HCII 2019. Springer, Lecture Notes in Computer Science, vol. 11569, pp. 194-207, Thematic Area on Human Interface and the Management of Information, HIMI 2019 , Orlando, United States, 26/07/19. https://doi.org/10.1007/978-3-030-22660-2_13

Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. / Cleland, Brian; Wallace, Jonathan; Bond, Raymond; Muuraiskangas, Salla ; Pajula, Juha; Epelde, Gorka; Arrúe, Mónica; Álvarez, Roberto; Black, Michaela; Mulvenna, Maurice D.; Rankin, Deborah; Carlin, Paul.

Human Interface and the Management of Information: Visual Information and Knowledge Management, HCII 2019. ed. / Sakae Yamamoto; Hirohiko Mori. Springer, 2019. p. 194-207 (Lecture Notes in Computer Science, Vol. 11569).

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

TY - GEN

T1 - Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making

AU - Cleland, Brian

AU - Wallace, Jonathan

AU - Bond, Raymond

AU - Muuraiskangas, Salla

AU - Pajula, Juha

AU - Epelde, Gorka

AU - Arrúe, Mónica

AU - Álvarez, Roberto

AU - Black, Michaela

AU - Mulvenna, Maurice D.

AU - Rankin, Deborah

AU - Carlin, Paul

PY - 2019

Y1 - 2019

N2 - The increasingly important role of big data in organisational decision-making brings with it significant challenges in terms of designing usable software interfaces. Specifically, such interfaces must allow users to explore, analyse, and visualise complex data from heterogeneous sources and derive insights to support management decisions. This paper describes a usability evaluation of the MIDAS Project, a big data platform for health policy-making, developed by an EU-funded Horizon 2020 project involving a number of international partners and pilot sites. We describe how a combination of heuristic and formative user-centred evaluation methods were employed, and give a summary of the key findings. We discuss key insights from the evaluation, including the importance of having diverse users, the role played by users’ prior expectations, and the logistical challenge of coordinating user testing across multiple sites. Finally, we explore the relative value of each of the evaluation methods, and outline how our approach to usability testing will evolve for future iterations of the MIDAS platform.

AB - The increasingly important role of big data in organisational decision-making brings with it significant challenges in terms of designing usable software interfaces. Specifically, such interfaces must allow users to explore, analyse, and visualise complex data from heterogeneous sources and derive insights to support management decisions. This paper describes a usability evaluation of the MIDAS Project, a big data platform for health policy-making, developed by an EU-funded Horizon 2020 project involving a number of international partners and pilot sites. We describe how a combination of heuristic and formative user-centred evaluation methods were employed, and give a summary of the key findings. We discuss key insights from the evaluation, including the importance of having diverse users, the role played by users’ prior expectations, and the logistical challenge of coordinating user testing across multiple sites. Finally, we explore the relative value of each of the evaluation methods, and outline how our approach to usability testing will evolve for future iterations of the MIDAS platform.

KW - Big data

KW - Evaluation

KW - Health

KW - Policy-making

KW - Usability

KW - User-centred

UR - http://www.scopus.com/inward/record.url?scp=85069809567&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-22660-2_13

DO - 10.1007/978-3-030-22660-2_13

M3 - Conference article in proceedings

AN - SCOPUS:85069809567

SN - 978-3-030-22659-6

T3 - Lecture Notes in Computer Science

SP - 194

EP - 207

BT - Human Interface and the Management of Information

A2 - Yamamoto, Sakae

A2 - Mori, Hirohiko

PB - Springer

T2 - Thematic Area on Human Interface and the Management of Information, HIMI 2019

Y2 - 26 July 2019 through 31 July 2019

ER -

Cleland B, Wallace J, Bond R, Muuraiskangas S , Pajula J, Epelde G et al. Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. In Yamamoto S, Mori H, editors, Human Interface and the Management of Information: Visual Information and Knowledge Management, HCII 2019. Springer. 2019. p. 194-207. (Lecture Notes in Computer Science, Vol. 11569). https://doi.org/10.1007/978-3-030-22660-2_13

Access to Document

10.1007/978-3-030-22660-2_13

Link to publication in Scopus