Predicting operator's cognitive and motion skills from joystick inputs

Mikko Laurikkala, Satoshi Suzuki, Matti Vilkko

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

1 Citation (Scopus)

Abstract

The skill level of a human operator is crucial in operating a complicated process. In this paper, we pay particular attention to operating a forest harvester. A simple computer game simulates the operation of a harvester as well as collects input data from the player and output data from the simulation model. First, we study the nature of the input and output data and illustrate them using PCA. Then, we proceed to using only input data and train a neural network model from operator inputs to skill level. Results show that the skill can be predicted reasonably well. The model itself is static, but dynamics are captured using specific indicators. Using bare input data simplifies data collection and makes the prediction faster. We do not have to use data that depend on the machine or environment, and the skill level can be predicted soon after the operator grabs the controls. The next phase will be using the skill information for operation support.

Original languageEnglish
Title of host publicationProceedings of the IECON 2016 - 42nd Annual Conference of the Industrial Electronics Society
PublisherInstitute of Electrical and Electronic Engineers IEEE
Pages5935-5940
ISBN (Electronic)978-1-5090-3474-1
ISBN (Print)978-1-5090-3475-8
DOIs
Publication statusPublished - 21 Dec 2016
MoE publication typeA4 Article in a conference publication
Event42nd Conference of the Industrial Electronics Society, IECON 2016 - Florence, Italy
Duration: 24 Oct 201627 Oct 2016

Conference

Conference42nd Conference of the Industrial Electronics Society, IECON 2016
CountryItaly
CityFlorence
Period24/10/1627/10/16

Fingerprint

Harvesters
Computer games
Neural networks

Cite this

Laurikkala, M., Suzuki, S., & Vilkko, M. (2016). Predicting operator's cognitive and motion skills from joystick inputs. In Proceedings of the IECON 2016 - 42nd Annual Conference of the Industrial Electronics Society (pp. 5935-5940). [7792994] Institute of Electrical and Electronic Engineers IEEE. https://doi.org/10.1109/IECON.2016.7792994
Laurikkala, Mikko ; Suzuki, Satoshi ; Vilkko, Matti. / Predicting operator's cognitive and motion skills from joystick inputs. Proceedings of the IECON 2016 - 42nd Annual Conference of the Industrial Electronics Society. Institute of Electrical and Electronic Engineers IEEE, 2016. pp. 5935-5940
@inproceedings{950a6f013f71446f8229374276d5da89,
title = "Predicting operator's cognitive and motion skills from joystick inputs",
abstract = "The skill level of a human operator is crucial in operating a complicated process. In this paper, we pay particular attention to operating a forest harvester. A simple computer game simulates the operation of a harvester as well as collects input data from the player and output data from the simulation model. First, we study the nature of the input and output data and illustrate them using PCA. Then, we proceed to using only input data and train a neural network model from operator inputs to skill level. Results show that the skill can be predicted reasonably well. The model itself is static, but dynamics are captured using specific indicators. Using bare input data simplifies data collection and makes the prediction faster. We do not have to use data that depend on the machine or environment, and the skill level can be predicted soon after the operator grabs the controls. The next phase will be using the skill information for operation support.",
author = "Mikko Laurikkala and Satoshi Suzuki and Matti Vilkko",
year = "2016",
month = "12",
day = "21",
doi = "10.1109/IECON.2016.7792994",
language = "English",
isbn = "978-1-5090-3475-8",
pages = "5935--5940",
booktitle = "Proceedings of the IECON 2016 - 42nd Annual Conference of the Industrial Electronics Society",
publisher = "Institute of Electrical and Electronic Engineers IEEE",
address = "United States",

}

Laurikkala, M, Suzuki, S & Vilkko, M 2016, Predicting operator's cognitive and motion skills from joystick inputs. in Proceedings of the IECON 2016 - 42nd Annual Conference of the Industrial Electronics Society., 7792994, Institute of Electrical and Electronic Engineers IEEE, pp. 5935-5940, 42nd Conference of the Industrial Electronics Society, IECON 2016, Florence, Italy, 24/10/16. https://doi.org/10.1109/IECON.2016.7792994

Predicting operator's cognitive and motion skills from joystick inputs. / Laurikkala, Mikko; Suzuki, Satoshi; Vilkko, Matti.

Proceedings of the IECON 2016 - 42nd Annual Conference of the Industrial Electronics Society. Institute of Electrical and Electronic Engineers IEEE, 2016. p. 5935-5940 7792994.

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

TY - GEN

T1 - Predicting operator's cognitive and motion skills from joystick inputs

AU - Laurikkala, Mikko

AU - Suzuki, Satoshi

AU - Vilkko, Matti

PY - 2016/12/21

Y1 - 2016/12/21

N2 - The skill level of a human operator is crucial in operating a complicated process. In this paper, we pay particular attention to operating a forest harvester. A simple computer game simulates the operation of a harvester as well as collects input data from the player and output data from the simulation model. First, we study the nature of the input and output data and illustrate them using PCA. Then, we proceed to using only input data and train a neural network model from operator inputs to skill level. Results show that the skill can be predicted reasonably well. The model itself is static, but dynamics are captured using specific indicators. Using bare input data simplifies data collection and makes the prediction faster. We do not have to use data that depend on the machine or environment, and the skill level can be predicted soon after the operator grabs the controls. The next phase will be using the skill information for operation support.

AB - The skill level of a human operator is crucial in operating a complicated process. In this paper, we pay particular attention to operating a forest harvester. A simple computer game simulates the operation of a harvester as well as collects input data from the player and output data from the simulation model. First, we study the nature of the input and output data and illustrate them using PCA. Then, we proceed to using only input data and train a neural network model from operator inputs to skill level. Results show that the skill can be predicted reasonably well. The model itself is static, but dynamics are captured using specific indicators. Using bare input data simplifies data collection and makes the prediction faster. We do not have to use data that depend on the machine or environment, and the skill level can be predicted soon after the operator grabs the controls. The next phase will be using the skill information for operation support.

UR - http://www.scopus.com/inward/record.url?scp=85010028328&partnerID=8YFLogxK

U2 - 10.1109/IECON.2016.7792994

DO - 10.1109/IECON.2016.7792994

M3 - Conference article in proceedings

SN - 978-1-5090-3475-8

SP - 5935

EP - 5940

BT - Proceedings of the IECON 2016 - 42nd Annual Conference of the Industrial Electronics Society

PB - Institute of Electrical and Electronic Engineers IEEE

ER -

Laurikkala M, Suzuki S, Vilkko M. Predicting operator's cognitive and motion skills from joystick inputs. In Proceedings of the IECON 2016 - 42nd Annual Conference of the Industrial Electronics Society. Institute of Electrical and Electronic Engineers IEEE. 2016. p. 5935-5940. 7792994 https://doi.org/10.1109/IECON.2016.7792994