Construction and evaluation of multi-touch screens using multiple cameras located on the side of the display

Otto Korkalo, Petri Honkamaa

    Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

    3 Citations (Scopus)


    We applied a computer vision based method and developed multi-touch technology to be adopted in various display types. In the selected design, multiple cameras are placed on the side of the display with their optical axis parallel to the screen. The display edges opposite the cameras are illuminated and fingers are detected since they block the light in the camera images. The approach is scalable and can be used in a wide variety of displays. Due to self-occlusion of the touchpoints, it is challenging to relate camera measurements to tracked points. In this paper, we present our approach for tracking and managing multiple touchpoints in such camera set-ups. We describe the mathematical background for modeling and calibrating the cameras, the design of the extended Kalman filter for point tracking, and the logic for adding, updating and removing the touchpoints. We analyze the potential accuracy and robustness of the system using several simulations and present two different real-life implementations of the approach.
    Original languageEnglish
    Title of host publication5th ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010
    Subtitle of host publicationSaarbrücken, Germany, 7-10 Nov. 2010
    PublisherAssociation for Computing Machinery ACM
    ISBN (Print)978-1-4503-0399-6
    Publication statusPublished - 2010
    MoE publication typeA4 Article in a conference publication


    • Multi-touch, tracking
    • vision-based tracking
    • human computer interaction


    Dive into the research topics of 'Construction and evaluation of multi-touch screens using multiple cameras located on the side of the display'. Together they form a unique fingerprint.

    Cite this