An architecture for remote guidance service

    Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

    Abstract

    Modern maintenance service requires better support for maintenance teams when local maintenance personnel do not have knowledge to manage complicated maintenance tasks, but needs to be guided by a remote expert. In this paper, a software architecture for a service enabling a remote expert to guide a maintenance person via video connection is proposed. The service allows maintenance technicians to send video stream from site to remote support center, where an expert can give feedback and instructions by adding virtual objects (e.g. pointers or 3D models of the object maintained) to the video stream. The maintenance technician can see the virtual objects in the live video stream on her mobile terminal. In the proposed service, a maintenance person has a mobile terminal equipped with screen and camera (such as smartphone or tablet, in a future Augmented Reality headset), capable for sending and receiving video stream. Remote expert has a standard computer with a modern browser. Both users are connected to an application server, running a WebRTC capable media server, such as open source Kurento platform. Augmenting the virtual objects into video stream is implemented on the media server. The manipulated stream is then rerouted to the users. Previous architectures are based on either proprietary technologies (e.g. Microsoft HoloLens or native mobile terminal apps) or restricted by capabilities of the mobile terminals (e.g. browser based Augmented Reality applications). Proposed architecture allows use of the best available video manipulation technologies even if they are not implemented in the mobile terminal used.
    Original languageEnglish
    Title of host publicationTransdisciplinary Lifecycle Analysis of Systems
    PublisherIOS Press
    Pages288-297
    ISBN (Electronic)978-1-61499-544-9
    ISBN (Print)978-1-61499-543-2
    DOIs
    Publication statusPublished - 2015
    MoE publication typeA4 Article in a conference publication
    Event22nd ISPE Inc. International Conference on Concurrent Engineering - Delft, Netherlands
    Duration: 20 Jul 201523 Jul 2015
    Conference number: 22

    Publication series

    SeriesAdvances in Transdisciplinary Engineering
    VolumeVolume 2

    Conference

    Conference22nd ISPE Inc. International Conference on Concurrent Engineering
    CountryNetherlands
    CityDelft
    Period20/07/1523/07/15

    Fingerprint

    Servers
    Augmented reality
    Smartphones
    Software architecture
    Application programs
    Cameras
    Personnel
    Feedback

    Keywords

    • remote guidance
    • collaborative augmented reality

    Cite this

    Siltanen, P., Valli, S., Ylikerälä, M., & Honkamaa, P. (2015). An architecture for remote guidance service. In Transdisciplinary Lifecycle Analysis of Systems (pp. 288-297). IOS Press. Advances in Transdisciplinary Engineering, Vol.. Volume 2 https://doi.org/10.3233/978-1-61499-544-9-288
    Siltanen, Pekka ; Valli, Seppo ; Ylikerälä, Markus ; Honkamaa, Petri. / An architecture for remote guidance service. Transdisciplinary Lifecycle Analysis of Systems. IOS Press, 2015. pp. 288-297 (Advances in Transdisciplinary Engineering, Vol. Volume 2).
    @inproceedings{6b8a14cf8c6449b0981ab305dd813b2d,
    title = "An architecture for remote guidance service",
    abstract = "Modern maintenance service requires better support for maintenance teams when local maintenance personnel do not have knowledge to manage complicated maintenance tasks, but needs to be guided by a remote expert. In this paper, a software architecture for a service enabling a remote expert to guide a maintenance person via video connection is proposed. The service allows maintenance technicians to send video stream from site to remote support center, where an expert can give feedback and instructions by adding virtual objects (e.g. pointers or 3D models of the object maintained) to the video stream. The maintenance technician can see the virtual objects in the live video stream on her mobile terminal. In the proposed service, a maintenance person has a mobile terminal equipped with screen and camera (such as smartphone or tablet, in a future Augmented Reality headset), capable for sending and receiving video stream. Remote expert has a standard computer with a modern browser. Both users are connected to an application server, running a WebRTC capable media server, such as open source Kurento platform. Augmenting the virtual objects into video stream is implemented on the media server. The manipulated stream is then rerouted to the users. Previous architectures are based on either proprietary technologies (e.g. Microsoft HoloLens or native mobile terminal apps) or restricted by capabilities of the mobile terminals (e.g. browser based Augmented Reality applications). Proposed architecture allows use of the best available video manipulation technologies even if they are not implemented in the mobile terminal used.",
    keywords = "remote guidance, collaborative augmented reality",
    author = "Pekka Siltanen and Seppo Valli and Markus Yliker{\"a}l{\"a} and Petri Honkamaa",
    note = "Project : 100908",
    year = "2015",
    doi = "10.3233/978-1-61499-544-9-288",
    language = "English",
    isbn = "978-1-61499-543-2",
    series = "Advances in Transdisciplinary Engineering",
    publisher = "IOS Press",
    pages = "288--297",
    booktitle = "Transdisciplinary Lifecycle Analysis of Systems",
    address = "Netherlands",

    }

    Siltanen, P, Valli, S, Ylikerälä, M & Honkamaa, P 2015, An architecture for remote guidance service. in Transdisciplinary Lifecycle Analysis of Systems. IOS Press, Advances in Transdisciplinary Engineering, vol. Volume 2, pp. 288-297, 22nd ISPE Inc. International Conference on Concurrent Engineering, Delft, Netherlands, 20/07/15. https://doi.org/10.3233/978-1-61499-544-9-288

    An architecture for remote guidance service. / Siltanen, Pekka; Valli, Seppo; Ylikerälä, Markus; Honkamaa, Petri.

    Transdisciplinary Lifecycle Analysis of Systems. IOS Press, 2015. p. 288-297 (Advances in Transdisciplinary Engineering, Vol. Volume 2).

    Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

    TY - GEN

    T1 - An architecture for remote guidance service

    AU - Siltanen, Pekka

    AU - Valli, Seppo

    AU - Ylikerälä, Markus

    AU - Honkamaa, Petri

    N1 - Project : 100908

    PY - 2015

    Y1 - 2015

    N2 - Modern maintenance service requires better support for maintenance teams when local maintenance personnel do not have knowledge to manage complicated maintenance tasks, but needs to be guided by a remote expert. In this paper, a software architecture for a service enabling a remote expert to guide a maintenance person via video connection is proposed. The service allows maintenance technicians to send video stream from site to remote support center, where an expert can give feedback and instructions by adding virtual objects (e.g. pointers or 3D models of the object maintained) to the video stream. The maintenance technician can see the virtual objects in the live video stream on her mobile terminal. In the proposed service, a maintenance person has a mobile terminal equipped with screen and camera (such as smartphone or tablet, in a future Augmented Reality headset), capable for sending and receiving video stream. Remote expert has a standard computer with a modern browser. Both users are connected to an application server, running a WebRTC capable media server, such as open source Kurento platform. Augmenting the virtual objects into video stream is implemented on the media server. The manipulated stream is then rerouted to the users. Previous architectures are based on either proprietary technologies (e.g. Microsoft HoloLens or native mobile terminal apps) or restricted by capabilities of the mobile terminals (e.g. browser based Augmented Reality applications). Proposed architecture allows use of the best available video manipulation technologies even if they are not implemented in the mobile terminal used.

    AB - Modern maintenance service requires better support for maintenance teams when local maintenance personnel do not have knowledge to manage complicated maintenance tasks, but needs to be guided by a remote expert. In this paper, a software architecture for a service enabling a remote expert to guide a maintenance person via video connection is proposed. The service allows maintenance technicians to send video stream from site to remote support center, where an expert can give feedback and instructions by adding virtual objects (e.g. pointers or 3D models of the object maintained) to the video stream. The maintenance technician can see the virtual objects in the live video stream on her mobile terminal. In the proposed service, a maintenance person has a mobile terminal equipped with screen and camera (such as smartphone or tablet, in a future Augmented Reality headset), capable for sending and receiving video stream. Remote expert has a standard computer with a modern browser. Both users are connected to an application server, running a WebRTC capable media server, such as open source Kurento platform. Augmenting the virtual objects into video stream is implemented on the media server. The manipulated stream is then rerouted to the users. Previous architectures are based on either proprietary technologies (e.g. Microsoft HoloLens or native mobile terminal apps) or restricted by capabilities of the mobile terminals (e.g. browser based Augmented Reality applications). Proposed architecture allows use of the best available video manipulation technologies even if they are not implemented in the mobile terminal used.

    KW - remote guidance

    KW - collaborative augmented reality

    U2 - 10.3233/978-1-61499-544-9-288

    DO - 10.3233/978-1-61499-544-9-288

    M3 - Conference article in proceedings

    SN - 978-1-61499-543-2

    T3 - Advances in Transdisciplinary Engineering

    SP - 288

    EP - 297

    BT - Transdisciplinary Lifecycle Analysis of Systems

    PB - IOS Press

    ER -

    Siltanen P, Valli S, Ylikerälä M, Honkamaa P. An architecture for remote guidance service. In Transdisciplinary Lifecycle Analysis of Systems. IOS Press. 2015. p. 288-297. (Advances in Transdisciplinary Engineering, Vol. Volume 2). https://doi.org/10.3233/978-1-61499-544-9-288