Construction and evaluation of multi-touch screens using multiple cameras located on the side of the display

    Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

    3 Citations (Scopus)

    Abstract

    We applied a computer vision based method and developed multi-touch technology to be adopted in various display types. In the selected design, multiple cameras are placed on the side of the display with their optical axis parallel to the screen. The display edges opposite the cameras are illuminated and fingers are detected since they block the light in the camera images. The approach is scalable and can be used in a wide variety of displays. Due to self-occlusion of the touchpoints, it is challenging to relate camera measurements to tracked points. In this paper, we present our approach for tracking and managing multiple touchpoints in such camera set-ups. We describe the mathematical background for modeling and calibrating the cameras, the design of the extended Kalman filter for point tracking, and the logic for adding, updating and removing the touchpoints. We analyze the potential accuracy and robustness of the system using several simulations and present two different real-life implementations of the approach.
    Original languageEnglish
    Title of host publication5th ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010
    Subtitle of host publicationSaarbrücken, Germany, 7-10 Nov. 2010
    PublisherAssociation for Computing Machinery ACM
    Pages83-90
    ISBN (Print)978-1-4503-0399-6
    DOIs
    Publication statusPublished - 2010
    MoE publication typeA4 Article in a conference publication

    Fingerprint

    Touch screens
    Cameras
    Display devices
    Extended Kalman filters
    Computer vision

    Keywords

    • Multi-touch, tracking
    • vision-based tracking
    • human computer interaction

    Cite this

    Korkalo, O., & Honkamaa, P. (2010). Construction and evaluation of multi-touch screens using multiple cameras located on the side of the display. In 5th ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010: Saarbrücken, Germany, 7-10 Nov. 2010 (pp. 83-90). Association for Computing Machinery ACM. https://doi.org/10.1145/1936652.1936667
    Korkalo, Otto ; Honkamaa, Petri. / Construction and evaluation of multi-touch screens using multiple cameras located on the side of the display. 5th ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010: Saarbrücken, Germany, 7-10 Nov. 2010. Association for Computing Machinery ACM, 2010. pp. 83-90
    @inproceedings{413b3db3cc1843d085e36dfd3645967e,
    title = "Construction and evaluation of multi-touch screens using multiple cameras located on the side of the display",
    abstract = "We applied a computer vision based method and developed multi-touch technology to be adopted in various display types. In the selected design, multiple cameras are placed on the side of the display with their optical axis parallel to the screen. The display edges opposite the cameras are illuminated and fingers are detected since they block the light in the camera images. The approach is scalable and can be used in a wide variety of displays. Due to self-occlusion of the touchpoints, it is challenging to relate camera measurements to tracked points. In this paper, we present our approach for tracking and managing multiple touchpoints in such camera set-ups. We describe the mathematical background for modeling and calibrating the cameras, the design of the extended Kalman filter for point tracking, and the logic for adding, updating and removing the touchpoints. We analyze the potential accuracy and robustness of the system using several simulations and present two different real-life implementations of the approach.",
    keywords = "Multi-touch, tracking, vision-based tracking, human computer interaction",
    author = "Otto Korkalo and Petri Honkamaa",
    note = "Project code: 34855",
    year = "2010",
    doi = "10.1145/1936652.1936667",
    language = "English",
    isbn = "978-1-4503-0399-6",
    pages = "83--90",
    booktitle = "5th ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010",
    publisher = "Association for Computing Machinery ACM",
    address = "United States",

    }

    Korkalo, O & Honkamaa, P 2010, Construction and evaluation of multi-touch screens using multiple cameras located on the side of the display. in 5th ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010: Saarbrücken, Germany, 7-10 Nov. 2010. Association for Computing Machinery ACM, pp. 83-90. https://doi.org/10.1145/1936652.1936667

    Construction and evaluation of multi-touch screens using multiple cameras located on the side of the display. / Korkalo, Otto; Honkamaa, Petri.

    5th ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010: Saarbrücken, Germany, 7-10 Nov. 2010. Association for Computing Machinery ACM, 2010. p. 83-90.

    Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

    TY - GEN

    T1 - Construction and evaluation of multi-touch screens using multiple cameras located on the side of the display

    AU - Korkalo, Otto

    AU - Honkamaa, Petri

    N1 - Project code: 34855

    PY - 2010

    Y1 - 2010

    N2 - We applied a computer vision based method and developed multi-touch technology to be adopted in various display types. In the selected design, multiple cameras are placed on the side of the display with their optical axis parallel to the screen. The display edges opposite the cameras are illuminated and fingers are detected since they block the light in the camera images. The approach is scalable and can be used in a wide variety of displays. Due to self-occlusion of the touchpoints, it is challenging to relate camera measurements to tracked points. In this paper, we present our approach for tracking and managing multiple touchpoints in such camera set-ups. We describe the mathematical background for modeling and calibrating the cameras, the design of the extended Kalman filter for point tracking, and the logic for adding, updating and removing the touchpoints. We analyze the potential accuracy and robustness of the system using several simulations and present two different real-life implementations of the approach.

    AB - We applied a computer vision based method and developed multi-touch technology to be adopted in various display types. In the selected design, multiple cameras are placed on the side of the display with their optical axis parallel to the screen. The display edges opposite the cameras are illuminated and fingers are detected since they block the light in the camera images. The approach is scalable and can be used in a wide variety of displays. Due to self-occlusion of the touchpoints, it is challenging to relate camera measurements to tracked points. In this paper, we present our approach for tracking and managing multiple touchpoints in such camera set-ups. We describe the mathematical background for modeling and calibrating the cameras, the design of the extended Kalman filter for point tracking, and the logic for adding, updating and removing the touchpoints. We analyze the potential accuracy and robustness of the system using several simulations and present two different real-life implementations of the approach.

    KW - Multi-touch, tracking

    KW - vision-based tracking

    KW - human computer interaction

    U2 - 10.1145/1936652.1936667

    DO - 10.1145/1936652.1936667

    M3 - Conference article in proceedings

    SN - 978-1-4503-0399-6

    SP - 83

    EP - 90

    BT - 5th ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010

    PB - Association for Computing Machinery ACM

    ER -

    Korkalo O, Honkamaa P. Construction and evaluation of multi-touch screens using multiple cameras located on the side of the display. In 5th ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010: Saarbrücken, Germany, 7-10 Nov. 2010. Association for Computing Machinery ACM. 2010. p. 83-90 https://doi.org/10.1145/1936652.1936667