Usability evaluation of complex systems. A literature review

Leena Norros, Paula Savioja

Research output: Book/ReportReportProfessional

Abstract

In this literature study the task of usability evaluation is approached through recent publications and known practises. The scope of the reviewed literature and the overall problematic of evaluating complex systems are first defined. Then existing evaluation methods and tools and a set of design guidelines and standards is introduced. In the review the distinction between the evaluation of the design process and evaluation of the outcome of the design process is made. Also the existing criteria for usability is provided. These criteria can be used as measures in the evaluation procedures described in the previous chapter. Then, the problem of validity in the evaluation and validation procedures of complex cognitive systems is shortly discusses. The final chapter covers the conclusions of the literature review. There is a need for deepening the relationship between usage and design. Usage must be the driver also in the design of process technology, plant’s safety, and instrumentation and control as well as that of the design of man-machine interface. The collaborative activity is called activity-oriented design. In order to enable activity-oriented design we need to create design methods that drive the design activity into this direction. Criteria for evaluating what is good design are not available in present standards. Criteria for good tools and practices must consider human in a favourable role in the various tasks of operating an industrial plant as opposed to the view of human as a source of error. This is the way to create an optimal system, which takes advantage of the unique capabilities of both the human operators and the automation systems.
Original languageEnglish
Place of PublicationHelsinki
PublisherRadiation and Nuclear Safety Authority STUK
Number of pages44
Publication statusPublished - 2004
MoE publication typeNot Eligible

Publication series

NameSTUK-YTO-TR
PublisherRadiation and Nuclear Safety Authority
No.204
ISSN (Print)0785-9325

Fingerprint

Large scale systems
Cognitive systems
Optimal systems
Industrial plants
Automation

Cite this

Norros, L., & Savioja, P. (2004). Usability evaluation of complex systems. A literature review. Helsinki: Radiation and Nuclear Safety Authority STUK. STUK-YTO-TR, No. 204
Norros, Leena ; Savioja, Paula. / Usability evaluation of complex systems. A literature review. Helsinki : Radiation and Nuclear Safety Authority STUK, 2004. 44 p. (STUK-YTO-TR; No. 204).
@book{acbe26dc630c4d098c62bd8544d237cf,
title = "Usability evaluation of complex systems. A literature review",
abstract = "In this literature study the task of usability evaluation is approached through recent publications and known practises. The scope of the reviewed literature and the overall problematic of evaluating complex systems are first defined. Then existing evaluation methods and tools and a set of design guidelines and standards is introduced. In the review the distinction between the evaluation of the design process and evaluation of the outcome of the design process is made. Also the existing criteria for usability is provided. These criteria can be used as measures in the evaluation procedures described in the previous chapter. Then, the problem of validity in the evaluation and validation procedures of complex cognitive systems is shortly discusses. The final chapter covers the conclusions of the literature review. There is a need for deepening the relationship between usage and design. Usage must be the driver also in the design of process technology, plant’s safety, and instrumentation and control as well as that of the design of man-machine interface. The collaborative activity is called activity-oriented design. In order to enable activity-oriented design we need to create design methods that drive the design activity into this direction. Criteria for evaluating what is good design are not available in present standards. Criteria for good tools and practices must consider human in a favourable role in the various tasks of operating an industrial plant as opposed to the view of human as a source of error. This is the way to create an optimal system, which takes advantage of the unique capabilities of both the human operators and the automation systems.",
author = "Leena Norros and Paula Savioja",
year = "2004",
language = "English",
series = "STUK-YTO-TR",
publisher = "Radiation and Nuclear Safety Authority STUK",
number = "204",
address = "Finland",

}

Norros, L & Savioja, P 2004, Usability evaluation of complex systems. A literature review. STUK-YTO-TR, no. 204, Radiation and Nuclear Safety Authority STUK, Helsinki.

Usability evaluation of complex systems. A literature review. / Norros, Leena; Savioja, Paula.

Helsinki : Radiation and Nuclear Safety Authority STUK, 2004. 44 p. (STUK-YTO-TR; No. 204).

Research output: Book/ReportReportProfessional

TY - BOOK

T1 - Usability evaluation of complex systems. A literature review

AU - Norros, Leena

AU - Savioja, Paula

PY - 2004

Y1 - 2004

N2 - In this literature study the task of usability evaluation is approached through recent publications and known practises. The scope of the reviewed literature and the overall problematic of evaluating complex systems are first defined. Then existing evaluation methods and tools and a set of design guidelines and standards is introduced. In the review the distinction between the evaluation of the design process and evaluation of the outcome of the design process is made. Also the existing criteria for usability is provided. These criteria can be used as measures in the evaluation procedures described in the previous chapter. Then, the problem of validity in the evaluation and validation procedures of complex cognitive systems is shortly discusses. The final chapter covers the conclusions of the literature review. There is a need for deepening the relationship between usage and design. Usage must be the driver also in the design of process technology, plant’s safety, and instrumentation and control as well as that of the design of man-machine interface. The collaborative activity is called activity-oriented design. In order to enable activity-oriented design we need to create design methods that drive the design activity into this direction. Criteria for evaluating what is good design are not available in present standards. Criteria for good tools and practices must consider human in a favourable role in the various tasks of operating an industrial plant as opposed to the view of human as a source of error. This is the way to create an optimal system, which takes advantage of the unique capabilities of both the human operators and the automation systems.

AB - In this literature study the task of usability evaluation is approached through recent publications and known practises. The scope of the reviewed literature and the overall problematic of evaluating complex systems are first defined. Then existing evaluation methods and tools and a set of design guidelines and standards is introduced. In the review the distinction between the evaluation of the design process and evaluation of the outcome of the design process is made. Also the existing criteria for usability is provided. These criteria can be used as measures in the evaluation procedures described in the previous chapter. Then, the problem of validity in the evaluation and validation procedures of complex cognitive systems is shortly discusses. The final chapter covers the conclusions of the literature review. There is a need for deepening the relationship between usage and design. Usage must be the driver also in the design of process technology, plant’s safety, and instrumentation and control as well as that of the design of man-machine interface. The collaborative activity is called activity-oriented design. In order to enable activity-oriented design we need to create design methods that drive the design activity into this direction. Criteria for evaluating what is good design are not available in present standards. Criteria for good tools and practices must consider human in a favourable role in the various tasks of operating an industrial plant as opposed to the view of human as a source of error. This is the way to create an optimal system, which takes advantage of the unique capabilities of both the human operators and the automation systems.

M3 - Report

T3 - STUK-YTO-TR

BT - Usability evaluation of complex systems. A literature review

PB - Radiation and Nuclear Safety Authority STUK

CY - Helsinki

ER -

Norros L, Savioja P. Usability evaluation of complex systems. A literature review. Helsinki: Radiation and Nuclear Safety Authority STUK, 2004. 44 p. (STUK-YTO-TR; No. 204).