Construction and evaluation of multi-touch screens using multiple cameras located on the side of the display

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

3 Citations (Scopus)

Abstract

We applied a computer vision based method and developed multi-touch technology to be adopted in various display types. In the selected design, multiple cameras are placed on the side of the display with their optical axis parallel to the screen. The display edges opposite the cameras are illuminated and fingers are detected since they block the light in the camera images. The approach is scalable and can be used in a wide variety of displays. Due to self-occlusion of the touchpoints, it is challenging to relate camera measurements to tracked points. In this paper, we present our approach for tracking and managing multiple touchpoints in such camera set-ups. We describe the mathematical background for modeling and calibrating the cameras, the design of the extended Kalman filter for point tracking, and the logic for adding, updating and removing the touchpoints. We analyze the potential accuracy and robustness of the system using several simulations and present two different real-life implementations of the approach.
Original languageEnglish
Title of host publication5th ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010
Subtitle of host publicationSaarbrücken, Germany, 7-10 Nov. 2010
PublisherAssociation for Computing Machinery ACM
Pages83-90
ISBN (Print)978-1-4503-0399-6
DOIs
Publication statusPublished - 2010
MoE publication typeA4 Article in a conference publication

Fingerprint

Touch screens
Cameras
Display devices
Extended Kalman filters
Computer vision

Keywords

  • Multi-touch, tracking
  • vision-based tracking
  • human computer interaction

Cite this

Korkalo, O., & Honkamaa, P. (2010). Construction and evaluation of multi-touch screens using multiple cameras located on the side of the display. In 5th ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010: Saarbrücken, Germany, 7-10 Nov. 2010 (pp. 83-90). Association for Computing Machinery ACM. https://doi.org/10.1145/1936652.1936667
Korkalo, Otto ; Honkamaa, Petri. / Construction and evaluation of multi-touch screens using multiple cameras located on the side of the display. 5th ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010: Saarbrücken, Germany, 7-10 Nov. 2010. Association for Computing Machinery ACM, 2010. pp. 83-90
@inproceedings{413b3db3cc1843d085e36dfd3645967e,
title = "Construction and evaluation of multi-touch screens using multiple cameras located on the side of the display",
abstract = "We applied a computer vision based method and developed multi-touch technology to be adopted in various display types. In the selected design, multiple cameras are placed on the side of the display with their optical axis parallel to the screen. The display edges opposite the cameras are illuminated and fingers are detected since they block the light in the camera images. The approach is scalable and can be used in a wide variety of displays. Due to self-occlusion of the touchpoints, it is challenging to relate camera measurements to tracked points. In this paper, we present our approach for tracking and managing multiple touchpoints in such camera set-ups. We describe the mathematical background for modeling and calibrating the cameras, the design of the extended Kalman filter for point tracking, and the logic for adding, updating and removing the touchpoints. We analyze the potential accuracy and robustness of the system using several simulations and present two different real-life implementations of the approach.",
keywords = "Multi-touch, tracking, vision-based tracking, human computer interaction",
author = "Otto Korkalo and Petri Honkamaa",
note = "Project code: 34855",
year = "2010",
doi = "10.1145/1936652.1936667",
language = "English",
isbn = "978-1-4503-0399-6",
pages = "83--90",
booktitle = "5th ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010",
publisher = "Association for Computing Machinery ACM",
address = "United States",

}

Korkalo, O & Honkamaa, P 2010, Construction and evaluation of multi-touch screens using multiple cameras located on the side of the display. in 5th ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010: Saarbrücken, Germany, 7-10 Nov. 2010. Association for Computing Machinery ACM, pp. 83-90. https://doi.org/10.1145/1936652.1936667

Construction and evaluation of multi-touch screens using multiple cameras located on the side of the display. / Korkalo, Otto; Honkamaa, Petri.

5th ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010: Saarbrücken, Germany, 7-10 Nov. 2010. Association for Computing Machinery ACM, 2010. p. 83-90.

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

TY - GEN

T1 - Construction and evaluation of multi-touch screens using multiple cameras located on the side of the display

AU - Korkalo, Otto

AU - Honkamaa, Petri

N1 - Project code: 34855

PY - 2010

Y1 - 2010

N2 - We applied a computer vision based method and developed multi-touch technology to be adopted in various display types. In the selected design, multiple cameras are placed on the side of the display with their optical axis parallel to the screen. The display edges opposite the cameras are illuminated and fingers are detected since they block the light in the camera images. The approach is scalable and can be used in a wide variety of displays. Due to self-occlusion of the touchpoints, it is challenging to relate camera measurements to tracked points. In this paper, we present our approach for tracking and managing multiple touchpoints in such camera set-ups. We describe the mathematical background for modeling and calibrating the cameras, the design of the extended Kalman filter for point tracking, and the logic for adding, updating and removing the touchpoints. We analyze the potential accuracy and robustness of the system using several simulations and present two different real-life implementations of the approach.

AB - We applied a computer vision based method and developed multi-touch technology to be adopted in various display types. In the selected design, multiple cameras are placed on the side of the display with their optical axis parallel to the screen. The display edges opposite the cameras are illuminated and fingers are detected since they block the light in the camera images. The approach is scalable and can be used in a wide variety of displays. Due to self-occlusion of the touchpoints, it is challenging to relate camera measurements to tracked points. In this paper, we present our approach for tracking and managing multiple touchpoints in such camera set-ups. We describe the mathematical background for modeling and calibrating the cameras, the design of the extended Kalman filter for point tracking, and the logic for adding, updating and removing the touchpoints. We analyze the potential accuracy and robustness of the system using several simulations and present two different real-life implementations of the approach.

KW - Multi-touch, tracking

KW - vision-based tracking

KW - human computer interaction

U2 - 10.1145/1936652.1936667

DO - 10.1145/1936652.1936667

M3 - Conference article in proceedings

SN - 978-1-4503-0399-6

SP - 83

EP - 90

BT - 5th ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010

PB - Association for Computing Machinery ACM

ER -

Korkalo O, Honkamaa P. Construction and evaluation of multi-touch screens using multiple cameras located on the side of the display. In 5th ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010: Saarbrücken, Germany, 7-10 Nov. 2010. Association for Computing Machinery ACM. 2010. p. 83-90 https://doi.org/10.1145/1936652.1936667