Multimodal User Interface for Augmented Assembly

Sanni Siltanen, Mika Hakkarainen, Otto Korkalo, Tapio Salonen, Juha Sääski, Charles Woodward, Theofanis Kannetis, Manolis Perakakis, Alexandros Potamianos

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

8 Citations (Scopus)

Abstract

In this paper, a multimodal system for augmented reality aided assembly work is designed and implemented. The multimodal interface allows for speech and gestural input. The system emulates a simplified assembly task in a factory. A 3D puzzle is used to study how to implement the augmented assembly system to a real setting in a factory. The system is used as a demonstrator and as a test-bed to evaluate different input modalities for augmented assembly setups. Preliminary system evaluation results are presented, the user experience is discussed, and some directions for future work are given.
Original languageEnglish
Title of host publicationProceedings
Subtitle of host publicationIEEE 9th Workshop on Multimedia Signal Processing, MMSP 2007
Place of PublicationPiscataway, NJ, USA
PublisherIEEE Institute of Electrical and Electronic Engineers
Pages78-81
ISBN (Print)978-1-4244-1273-0, 978-1-4244-1274-7
DOIs
Publication statusPublished - 2007
MoE publication typeA4 Article in a conference publication
EventIEEE 9th Workshop on Multimedia Signal Processing, MMSP 2007 - Crete, Greece
Duration: 1 Oct 20073 Oct 2007

Conference

ConferenceIEEE 9th Workshop on Multimedia Signal Processing, MMSP 2007
Abbreviated titleMMSP 2007
CountryGreece
CityCrete
Period1/10/073/10/07

Fingerprint

User interfaces
Industrial plants
Augmented reality

Cite this

Siltanen, S., Hakkarainen, M., Korkalo, O., Salonen, T., Sääski, J., Woodward, C., ... Potamianos, A. (2007). Multimodal User Interface for Augmented Assembly. In Proceedings: IEEE 9th Workshop on Multimedia Signal Processing, MMSP 2007 (pp. 78-81). Piscataway, NJ, USA: IEEE Institute of Electrical and Electronic Engineers . https://doi.org/10.1109/MMSP.2007.4412822
Siltanen, Sanni ; Hakkarainen, Mika ; Korkalo, Otto ; Salonen, Tapio ; Sääski, Juha ; Woodward, Charles ; Kannetis, Theofanis ; Perakakis, Manolis ; Potamianos, Alexandros. / Multimodal User Interface for Augmented Assembly. Proceedings: IEEE 9th Workshop on Multimedia Signal Processing, MMSP 2007 . Piscataway, NJ, USA : IEEE Institute of Electrical and Electronic Engineers , 2007. pp. 78-81
@inproceedings{b025ea1adb454815ba862f02c10f23e7,
title = "Multimodal User Interface for Augmented Assembly",
abstract = "In this paper, a multimodal system for augmented reality aided assembly work is designed and implemented. The multimodal interface allows for speech and gestural input. The system emulates a simplified assembly task in a factory. A 3D puzzle is used to study how to implement the augmented assembly system to a real setting in a factory. The system is used as a demonstrator and as a test-bed to evaluate different input modalities for augmented assembly setups. Preliminary system evaluation results are presented, the user experience is discussed, and some directions for future work are given.",
author = "Sanni Siltanen and Mika Hakkarainen and Otto Korkalo and Tapio Salonen and Juha S{\"a}{\"a}ski and Charles Woodward and Theofanis Kannetis and Manolis Perakakis and Alexandros Potamianos",
year = "2007",
doi = "10.1109/MMSP.2007.4412822",
language = "English",
isbn = "978-1-4244-1273-0",
pages = "78--81",
booktitle = "Proceedings",
publisher = "IEEE Institute of Electrical and Electronic Engineers",
address = "United States",

}

Siltanen, S, Hakkarainen, M, Korkalo, O, Salonen, T, Sääski, J, Woodward, C, Kannetis, T, Perakakis, M & Potamianos, A 2007, Multimodal User Interface for Augmented Assembly. in Proceedings: IEEE 9th Workshop on Multimedia Signal Processing, MMSP 2007 . IEEE Institute of Electrical and Electronic Engineers , Piscataway, NJ, USA, pp. 78-81, IEEE 9th Workshop on Multimedia Signal Processing, MMSP 2007, Crete, Greece, 1/10/07. https://doi.org/10.1109/MMSP.2007.4412822

Multimodal User Interface for Augmented Assembly. / Siltanen, Sanni; Hakkarainen, Mika; Korkalo, Otto; Salonen, Tapio; Sääski, Juha; Woodward, Charles; Kannetis, Theofanis; Perakakis, Manolis; Potamianos, Alexandros.

Proceedings: IEEE 9th Workshop on Multimedia Signal Processing, MMSP 2007 . Piscataway, NJ, USA : IEEE Institute of Electrical and Electronic Engineers , 2007. p. 78-81.

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

TY - GEN

T1 - Multimodal User Interface for Augmented Assembly

AU - Siltanen, Sanni

AU - Hakkarainen, Mika

AU - Korkalo, Otto

AU - Salonen, Tapio

AU - Sääski, Juha

AU - Woodward, Charles

AU - Kannetis, Theofanis

AU - Perakakis, Manolis

AU - Potamianos, Alexandros

PY - 2007

Y1 - 2007

N2 - In this paper, a multimodal system for augmented reality aided assembly work is designed and implemented. The multimodal interface allows for speech and gestural input. The system emulates a simplified assembly task in a factory. A 3D puzzle is used to study how to implement the augmented assembly system to a real setting in a factory. The system is used as a demonstrator and as a test-bed to evaluate different input modalities for augmented assembly setups. Preliminary system evaluation results are presented, the user experience is discussed, and some directions for future work are given.

AB - In this paper, a multimodal system for augmented reality aided assembly work is designed and implemented. The multimodal interface allows for speech and gestural input. The system emulates a simplified assembly task in a factory. A 3D puzzle is used to study how to implement the augmented assembly system to a real setting in a factory. The system is used as a demonstrator and as a test-bed to evaluate different input modalities for augmented assembly setups. Preliminary system evaluation results are presented, the user experience is discussed, and some directions for future work are given.

U2 - 10.1109/MMSP.2007.4412822

DO - 10.1109/MMSP.2007.4412822

M3 - Conference article in proceedings

SN - 978-1-4244-1273-0

SN - 978-1-4244-1274-7

SP - 78

EP - 81

BT - Proceedings

PB - IEEE Institute of Electrical and Electronic Engineers

CY - Piscataway, NJ, USA

ER -

Siltanen S, Hakkarainen M, Korkalo O, Salonen T, Sääski J, Woodward C et al. Multimodal User Interface for Augmented Assembly. In Proceedings: IEEE 9th Workshop on Multimedia Signal Processing, MMSP 2007 . Piscataway, NJ, USA: IEEE Institute of Electrical and Electronic Engineers . 2007. p. 78-81 https://doi.org/10.1109/MMSP.2007.4412822