This paper describes multimodal interaction techniques used in a virtual environment training prototype for astronaut assembly sequence training. Astronaut training takes place on Earth, which makes the simulation of zero gravity conditions necessary. Performing assembly tasks on orbit differs dramatically from ground operation in terms of object handling as well as user movement. The use of virtual environment techniques in astronaut training offers potentially significant cost savings and quicker access to the training situation compared to methods like parabolic flights. The usefulness of such a training application depends largely on the high enough resemblance of the operation to the real situation. In this respect the selected combination of interaction techniques plays a vital role. This paper presents a possible interaction technique battery for astronaut training that utilises two-handed interaction, speech and gesture recognition in a physically simulated virtual environment. User feedback is provided via head tracked stereo graphics and audio cues.
|Title of host publication||Human - Computer Interaction|
|Subtitle of host publication||Theory and Practice (Part I)|
|Editors||Julie Jacko, Constantine Stephanidis|
|Publisher||Lawrence Erlbaum Associates|
|Publication status||Published - 2003|
|MoE publication type||A4 Article in a conference publication|
|Event||2nd International Conference on Universal Access in Human-Computer Interaction - Crete, Greece|
Duration: 22 Jun 2003 → 27 Jun 2003
|Conference||2nd International Conference on Universal Access in Human-Computer Interaction|
|Period||22/06/03 → 27/06/03|
- interaction techniques
- multi-modal interaction
- virtual environments
Rönkkö, J., Launonen, R., Laukkanen, S., & Gaia, E. (2003). Multimodal interaction techniques for astronaut training in virtual environments. In J. Jacko, & C. Stephanidis (Eds.), Human - Computer Interaction: Theory and Practice (Part I) (Vol. 1, pp. 1238-1242). Lawrence Erlbaum Associates.