Evaluating the iterative development of VR/AR human factors tools for manual work

P.M. Liston (Corresponding Author), A. Kay, S. Cromie, C. Leva, M. D'Cruz, H. Patel, Alyson Langley, Sarah Sharples, Susanna Aromaa

Research output: Contribution to journalArticleScientificpeer-review

Abstract

This paper outlines the approach taken to iteratively evaluate a set of VR/AR (virtual reality / augmented reality) applications for five different manual-work applications – terrestrial spacecraft assembly, assembly-line design, remote maintenance of trains, maintenance of nuclear reactors, and large-machine assembly process design – and examines the evaluation data for evidence of the effectiveness of the evaluation framework as well as the benefits to the development process of feedback from iterative evaluation. ManuVAR is an EU-funded research project that is working to develop an innovative technology platform and a framework to support high-value, high-knowledge manual work throughout the product lifecycle. The results of this study demonstrate the iterative improvements reached throughout the design cycles, observable through the trending of the quantitative results from three successive trials of the applications and the investigation of the qualitative interview findings. The paper discusses the limitations of evaluation in complex, multi-disciplinary development projects and finds evidence of the effectiveness of the use of the particular set of complementary evaluation methods incorporating a common inquiry structure used for the evaluation – particularly in facilitating triangulation of the data.
Original languageEnglish
Pages (from-to)2208-2215
Number of pages8
JournalWork
Volume41
Issue numberSupplement 1
DOIs
Publication statusPublished - 2012
MoE publication typeA1 Journal article-refereed
Event18th World Congress on Ergonomics, IEA 2012: Designing a sustainable future - Recife, Brazil
Duration: 12 Feb 201216 Feb 2012

Fingerprint

Spacecraft
Maintenance
Nuclear Reactors
Interviews
Technology
Research

Keywords

  • Augmented reality
  • evaluation
  • interative development
  • manual work
  • virtual reality

Cite this

Liston, P. M., Kay, A., Cromie, S., Leva, C., D'Cruz, M., Patel, H., ... Aromaa, S. (2012). Evaluating the iterative development of VR/AR human factors tools for manual work. Work, 41(Supplement 1), 2208-2215. https://doi.org/10.3233/WOR-2012-0443-2208
Liston, P.M. ; Kay, A. ; Cromie, S. ; Leva, C. ; D'Cruz, M. ; Patel, H. ; Langley, Alyson ; Sharples, Sarah ; Aromaa, Susanna. / Evaluating the iterative development of VR/AR human factors tools for manual work. In: Work. 2012 ; Vol. 41, No. Supplement 1. pp. 2208-2215.
@article{428095099ec34d1787ad4ea70dfb358a,
title = "Evaluating the iterative development of VR/AR human factors tools for manual work",
abstract = "This paper outlines the approach taken to iteratively evaluate a set of VR/AR (virtual reality / augmented reality) applications for five different manual-work applications – terrestrial spacecraft assembly, assembly-line design, remote maintenance of trains, maintenance of nuclear reactors, and large-machine assembly process design – and examines the evaluation data for evidence of the effectiveness of the evaluation framework as well as the benefits to the development process of feedback from iterative evaluation. ManuVAR is an EU-funded research project that is working to develop an innovative technology platform and a framework to support high-value, high-knowledge manual work throughout the product lifecycle. The results of this study demonstrate the iterative improvements reached throughout the design cycles, observable through the trending of the quantitative results from three successive trials of the applications and the investigation of the qualitative interview findings. The paper discusses the limitations of evaluation in complex, multi-disciplinary development projects and finds evidence of the effectiveness of the use of the particular set of complementary evaluation methods incorporating a common inquiry structure used for the evaluation – particularly in facilitating triangulation of the data.",
keywords = "Augmented reality, evaluation, interative development, manual work, virtual reality",
author = "P.M. Liston and A. Kay and S. Cromie and C. Leva and M. D'Cruz and H. Patel and Alyson Langley and Sarah Sharples and Susanna Aromaa",
year = "2012",
doi = "10.3233/WOR-2012-0443-2208",
language = "English",
volume = "41",
pages = "2208--2215",
journal = "Work",
issn = "1051-9815",
publisher = "IOS Press",
number = "Supplement 1",

}

Liston, PM, Kay, A, Cromie, S, Leva, C, D'Cruz, M, Patel, H, Langley, A, Sharples, S & Aromaa, S 2012, 'Evaluating the iterative development of VR/AR human factors tools for manual work', Work, vol. 41, no. Supplement 1, pp. 2208-2215. https://doi.org/10.3233/WOR-2012-0443-2208

Evaluating the iterative development of VR/AR human factors tools for manual work. / Liston, P.M. (Corresponding Author); Kay, A.; Cromie, S.; Leva, C.; D'Cruz, M.; Patel, H.; Langley, Alyson; Sharples, Sarah; Aromaa, Susanna.

In: Work, Vol. 41, No. Supplement 1, 2012, p. 2208-2215.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Evaluating the iterative development of VR/AR human factors tools for manual work

AU - Liston, P.M.

AU - Kay, A.

AU - Cromie, S.

AU - Leva, C.

AU - D'Cruz, M.

AU - Patel, H.

AU - Langley, Alyson

AU - Sharples, Sarah

AU - Aromaa, Susanna

PY - 2012

Y1 - 2012

N2 - This paper outlines the approach taken to iteratively evaluate a set of VR/AR (virtual reality / augmented reality) applications for five different manual-work applications – terrestrial spacecraft assembly, assembly-line design, remote maintenance of trains, maintenance of nuclear reactors, and large-machine assembly process design – and examines the evaluation data for evidence of the effectiveness of the evaluation framework as well as the benefits to the development process of feedback from iterative evaluation. ManuVAR is an EU-funded research project that is working to develop an innovative technology platform and a framework to support high-value, high-knowledge manual work throughout the product lifecycle. The results of this study demonstrate the iterative improvements reached throughout the design cycles, observable through the trending of the quantitative results from three successive trials of the applications and the investigation of the qualitative interview findings. The paper discusses the limitations of evaluation in complex, multi-disciplinary development projects and finds evidence of the effectiveness of the use of the particular set of complementary evaluation methods incorporating a common inquiry structure used for the evaluation – particularly in facilitating triangulation of the data.

AB - This paper outlines the approach taken to iteratively evaluate a set of VR/AR (virtual reality / augmented reality) applications for five different manual-work applications – terrestrial spacecraft assembly, assembly-line design, remote maintenance of trains, maintenance of nuclear reactors, and large-machine assembly process design – and examines the evaluation data for evidence of the effectiveness of the evaluation framework as well as the benefits to the development process of feedback from iterative evaluation. ManuVAR is an EU-funded research project that is working to develop an innovative technology platform and a framework to support high-value, high-knowledge manual work throughout the product lifecycle. The results of this study demonstrate the iterative improvements reached throughout the design cycles, observable through the trending of the quantitative results from three successive trials of the applications and the investigation of the qualitative interview findings. The paper discusses the limitations of evaluation in complex, multi-disciplinary development projects and finds evidence of the effectiveness of the use of the particular set of complementary evaluation methods incorporating a common inquiry structure used for the evaluation – particularly in facilitating triangulation of the data.

KW - Augmented reality

KW - evaluation

KW - interative development

KW - manual work

KW - virtual reality

U2 - 10.3233/WOR-2012-0443-2208

DO - 10.3233/WOR-2012-0443-2208

M3 - Article

VL - 41

SP - 2208

EP - 2215

JO - Work

JF - Work

SN - 1051-9815

IS - Supplement 1

ER -

Liston PM, Kay A, Cromie S, Leva C, D'Cruz M, Patel H et al. Evaluating the iterative development of VR/AR human factors tools for manual work. Work. 2012;41(Supplement 1):2208-2215. https://doi.org/10.3233/WOR-2012-0443-2208