An architecture for remote guidance service

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

Abstract

Modern maintenance service requires better support for maintenance teams when local maintenance personnel do not have knowledge to manage complicated maintenance tasks, but needs to be guided by a remote expert. In this paper, a software architecture for a service enabling a remote expert to guide a maintenance person via video connection is proposed. The service allows maintenance technicians to send video stream from site to remote support center, where an expert can give feedback and instructions by adding virtual objects (e.g. pointers or 3D models of the object maintained) to the video stream. The maintenance technician can see the virtual objects in the live video stream on her mobile terminal. In the proposed service, a maintenance person has a mobile terminal equipped with screen and camera (such as smartphone or tablet, in a future Augmented Reality headset), capable for sending and receiving video stream. Remote expert has a standard computer with a modern browser. Both users are connected to an application server, running a WebRTC capable media server, such as open source Kurento platform. Augmenting the virtual objects into video stream is implemented on the media server. The manipulated stream is then rerouted to the users. Previous architectures are based on either proprietary technologies (e.g. Microsoft HoloLens or native mobile terminal apps) or restricted by capabilities of the mobile terminals (e.g. browser based Augmented Reality applications). Proposed architecture allows use of the best available video manipulation technologies even if they are not implemented in the mobile terminal used.
Original languageEnglish
Title of host publicationTransdisciplinary Lifecycle Analysis of Systems
PublisherIOS Press
Pages288-297
ISBN (Electronic)978-1-61499-544-9
ISBN (Print)978-1-61499-543-2
DOIs
Publication statusPublished - 2015
MoE publication typeA4 Article in a conference publication
Event22nd ISPE Inc. International Conference on Concurrent Engineering - Delft, Netherlands
Duration: 20 Jul 201523 Jul 2015
Conference number: 22

Publication series

SeriesAdvances in Transdisciplinary Engineering
VolumeVolume 2

Conference

Conference22nd ISPE Inc. International Conference on Concurrent Engineering
CountryNetherlands
CityDelft
Period20/07/1523/07/15

Fingerprint

Servers
Augmented reality
Smartphones
Software architecture
Application programs
Cameras
Personnel
Feedback

Keywords

  • remote guidance
  • collaborative augmented reality

Cite this

Siltanen, P., Valli, S., Ylikerälä, M., & Honkamaa, P. (2015). An architecture for remote guidance service. In Transdisciplinary Lifecycle Analysis of Systems (pp. 288-297). IOS Press. Advances in Transdisciplinary Engineering, Vol.. Volume 2 https://doi.org/10.3233/978-1-61499-544-9-288
Siltanen, Pekka ; Valli, Seppo ; Ylikerälä, Markus ; Honkamaa, Petri. / An architecture for remote guidance service. Transdisciplinary Lifecycle Analysis of Systems. IOS Press, 2015. pp. 288-297 (Advances in Transdisciplinary Engineering, Vol. Volume 2).
@inproceedings{6b8a14cf8c6449b0981ab305dd813b2d,
title = "An architecture for remote guidance service",
abstract = "Modern maintenance service requires better support for maintenance teams when local maintenance personnel do not have knowledge to manage complicated maintenance tasks, but needs to be guided by a remote expert. In this paper, a software architecture for a service enabling a remote expert to guide a maintenance person via video connection is proposed. The service allows maintenance technicians to send video stream from site to remote support center, where an expert can give feedback and instructions by adding virtual objects (e.g. pointers or 3D models of the object maintained) to the video stream. The maintenance technician can see the virtual objects in the live video stream on her mobile terminal. In the proposed service, a maintenance person has a mobile terminal equipped with screen and camera (such as smartphone or tablet, in a future Augmented Reality headset), capable for sending and receiving video stream. Remote expert has a standard computer with a modern browser. Both users are connected to an application server, running a WebRTC capable media server, such as open source Kurento platform. Augmenting the virtual objects into video stream is implemented on the media server. The manipulated stream is then rerouted to the users. Previous architectures are based on either proprietary technologies (e.g. Microsoft HoloLens or native mobile terminal apps) or restricted by capabilities of the mobile terminals (e.g. browser based Augmented Reality applications). Proposed architecture allows use of the best available video manipulation technologies even if they are not implemented in the mobile terminal used.",
keywords = "remote guidance, collaborative augmented reality",
author = "Pekka Siltanen and Seppo Valli and Markus Yliker{\"a}l{\"a} and Petri Honkamaa",
note = "Project : 100908",
year = "2015",
doi = "10.3233/978-1-61499-544-9-288",
language = "English",
isbn = "978-1-61499-543-2",
series = "Advances in Transdisciplinary Engineering",
publisher = "IOS Press",
pages = "288--297",
booktitle = "Transdisciplinary Lifecycle Analysis of Systems",
address = "Netherlands",

}

Siltanen, P, Valli, S, Ylikerälä, M & Honkamaa, P 2015, An architecture for remote guidance service. in Transdisciplinary Lifecycle Analysis of Systems. IOS Press, Advances in Transdisciplinary Engineering, vol. Volume 2, pp. 288-297, 22nd ISPE Inc. International Conference on Concurrent Engineering, Delft, Netherlands, 20/07/15. https://doi.org/10.3233/978-1-61499-544-9-288

An architecture for remote guidance service. / Siltanen, Pekka; Valli, Seppo; Ylikerälä, Markus; Honkamaa, Petri.

Transdisciplinary Lifecycle Analysis of Systems. IOS Press, 2015. p. 288-297 (Advances in Transdisciplinary Engineering, Vol. Volume 2).

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

TY - GEN

T1 - An architecture for remote guidance service

AU - Siltanen, Pekka

AU - Valli, Seppo

AU - Ylikerälä, Markus

AU - Honkamaa, Petri

N1 - Project : 100908

PY - 2015

Y1 - 2015

N2 - Modern maintenance service requires better support for maintenance teams when local maintenance personnel do not have knowledge to manage complicated maintenance tasks, but needs to be guided by a remote expert. In this paper, a software architecture for a service enabling a remote expert to guide a maintenance person via video connection is proposed. The service allows maintenance technicians to send video stream from site to remote support center, where an expert can give feedback and instructions by adding virtual objects (e.g. pointers or 3D models of the object maintained) to the video stream. The maintenance technician can see the virtual objects in the live video stream on her mobile terminal. In the proposed service, a maintenance person has a mobile terminal equipped with screen and camera (such as smartphone or tablet, in a future Augmented Reality headset), capable for sending and receiving video stream. Remote expert has a standard computer with a modern browser. Both users are connected to an application server, running a WebRTC capable media server, such as open source Kurento platform. Augmenting the virtual objects into video stream is implemented on the media server. The manipulated stream is then rerouted to the users. Previous architectures are based on either proprietary technologies (e.g. Microsoft HoloLens or native mobile terminal apps) or restricted by capabilities of the mobile terminals (e.g. browser based Augmented Reality applications). Proposed architecture allows use of the best available video manipulation technologies even if they are not implemented in the mobile terminal used.

AB - Modern maintenance service requires better support for maintenance teams when local maintenance personnel do not have knowledge to manage complicated maintenance tasks, but needs to be guided by a remote expert. In this paper, a software architecture for a service enabling a remote expert to guide a maintenance person via video connection is proposed. The service allows maintenance technicians to send video stream from site to remote support center, where an expert can give feedback and instructions by adding virtual objects (e.g. pointers or 3D models of the object maintained) to the video stream. The maintenance technician can see the virtual objects in the live video stream on her mobile terminal. In the proposed service, a maintenance person has a mobile terminal equipped with screen and camera (such as smartphone or tablet, in a future Augmented Reality headset), capable for sending and receiving video stream. Remote expert has a standard computer with a modern browser. Both users are connected to an application server, running a WebRTC capable media server, such as open source Kurento platform. Augmenting the virtual objects into video stream is implemented on the media server. The manipulated stream is then rerouted to the users. Previous architectures are based on either proprietary technologies (e.g. Microsoft HoloLens or native mobile terminal apps) or restricted by capabilities of the mobile terminals (e.g. browser based Augmented Reality applications). Proposed architecture allows use of the best available video manipulation technologies even if they are not implemented in the mobile terminal used.

KW - remote guidance

KW - collaborative augmented reality

U2 - 10.3233/978-1-61499-544-9-288

DO - 10.3233/978-1-61499-544-9-288

M3 - Conference article in proceedings

SN - 978-1-61499-543-2

T3 - Advances in Transdisciplinary Engineering

SP - 288

EP - 297

BT - Transdisciplinary Lifecycle Analysis of Systems

PB - IOS Press

ER -

Siltanen P, Valli S, Ylikerälä M, Honkamaa P. An architecture for remote guidance service. In Transdisciplinary Lifecycle Analysis of Systems. IOS Press. 2015. p. 288-297. (Advances in Transdisciplinary Engineering, Vol. Volume 2). https://doi.org/10.3233/978-1-61499-544-9-288