Fueling AI with public displays?

A feasibility study of collecting biometrically tagged consensual data on a university campus

Simo Hosio, Andy Alorwu, Niels van Berkel, Miguel Bordallo López, Mahalakshmy Seetharaman, Jonas Oppenlaender, Jorge Goncalves

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

Abstract

Interactive public displays have matured into highly capable two-way interfaces. They can be used for efficiently delivering information to people as well as for collecting insights from their users. While displays have been used for harvesting opinions and other content from users, surprisingly little work has looked into exploiting such screens for the consensual collection of tagged data that might be useful beyond one application. We present a field study where we collected biometrically tagged data using public kiosk-sized interactive screens. During 61 days of deployment time, we collected 199 selfie videos, cost-efficiently and with consent to leverage the videos in any non-profit research. 78 of the videos also had metadata attached to them. Overall, our studies indicate that people are willing to donate even highly sensitive data about themselves in public but that, at the same time, the participants had specific ethical and privacy concerns over the future of their data. Our study paves the way forward toward a future where volunteers can ethically help advance innovations in computer vision research across a variety of exciting application domains, such as health monitoring and care.
Original languageEnglish
Title of host publicationProceedings of the 8th ACM International Symposium on Pervasive Displays
EditorsJessica Cauchard, Vito Gentile, Mohamed Khamis, Salvatore Sorce
PublisherAssociation for Computing Machinery ACM
Number of pages7
ISBN (Print)978-1-4503-6751-6
DOIs
Publication statusPublished - 2019
MoE publication typeA4 Article in a conference publication
Event8th ACM International Symposium on Pervasive Displays, PerDis'19 - Palermo, Italy
Duration: 12 Jun 201914 Jun 2019

Conference

Conference8th ACM International Symposium on Pervasive Displays, PerDis'19
Abbreviated titlePerDis 2019
CountryItaly
CityPalermo
Period12/06/1914/06/19

Fingerprint

Fueling
Display devices
Metadata
Computer vision
Innovation
Health
Monitoring
Costs

Keywords

  • Computer vision
  • Ethics
  • Field study
  • Public displays

Cite this

Hosio, S., Alorwu, A., van Berkel, N., López, M. B., Seetharaman, M., Oppenlaender, J., & Goncalves, J. (2019). Fueling AI with public displays? A feasibility study of collecting biometrically tagged consensual data on a university campus. In J. Cauchard, V. Gentile, M. Khamis, & S. Sorce (Eds.), Proceedings of the 8th ACM International Symposium on Pervasive Displays [14] Association for Computing Machinery ACM. https://doi.org/10.1145/3321335.3324943
Hosio, Simo ; Alorwu, Andy ; van Berkel, Niels ; López, Miguel Bordallo ; Seetharaman, Mahalakshmy ; Oppenlaender, Jonas ; Goncalves, Jorge. / Fueling AI with public displays? A feasibility study of collecting biometrically tagged consensual data on a university campus. Proceedings of the 8th ACM International Symposium on Pervasive Displays. editor / Jessica Cauchard ; Vito Gentile ; Mohamed Khamis ; Salvatore Sorce. Association for Computing Machinery ACM, 2019.
@inproceedings{0594f960db1544da8695c274f754a110,
title = "Fueling AI with public displays?: A feasibility study of collecting biometrically tagged consensual data on a university campus",
abstract = "Interactive public displays have matured into highly capable two-way interfaces. They can be used for efficiently delivering information to people as well as for collecting insights from their users. While displays have been used for harvesting opinions and other content from users, surprisingly little work has looked into exploiting such screens for the consensual collection of tagged data that might be useful beyond one application. We present a field study where we collected biometrically tagged data using public kiosk-sized interactive screens. During 61 days of deployment time, we collected 199 selfie videos, cost-efficiently and with consent to leverage the videos in any non-profit research. 78 of the videos also had metadata attached to them. Overall, our studies indicate that people are willing to donate even highly sensitive data about themselves in public but that, at the same time, the participants had specific ethical and privacy concerns over the future of their data. Our study paves the way forward toward a future where volunteers can ethically help advance innovations in computer vision research across a variety of exciting application domains, such as health monitoring and care.",
keywords = "Computer vision, Ethics, Field study, Public displays",
author = "Simo Hosio and Andy Alorwu and {van Berkel}, Niels and L{\'o}pez, {Miguel Bordallo} and Mahalakshmy Seetharaman and Jonas Oppenlaender and Jorge Goncalves",
year = "2019",
doi = "10.1145/3321335.3324943",
language = "English",
isbn = "978-1-4503-6751-6",
editor = "Jessica Cauchard and Vito Gentile and Mohamed Khamis and Salvatore Sorce",
booktitle = "Proceedings of the 8th ACM International Symposium on Pervasive Displays",
publisher = "Association for Computing Machinery ACM",
address = "United States",

}

Hosio, S, Alorwu, A, van Berkel, N, López, MB, Seetharaman, M, Oppenlaender, J & Goncalves, J 2019, Fueling AI with public displays? A feasibility study of collecting biometrically tagged consensual data on a university campus. in J Cauchard, V Gentile, M Khamis & S Sorce (eds), Proceedings of the 8th ACM International Symposium on Pervasive Displays., 14, Association for Computing Machinery ACM, 8th ACM International Symposium on Pervasive Displays, PerDis'19, Palermo, Italy, 12/06/19. https://doi.org/10.1145/3321335.3324943

Fueling AI with public displays? A feasibility study of collecting biometrically tagged consensual data on a university campus. / Hosio, Simo; Alorwu, Andy; van Berkel, Niels; López, Miguel Bordallo; Seetharaman, Mahalakshmy; Oppenlaender, Jonas; Goncalves, Jorge.

Proceedings of the 8th ACM International Symposium on Pervasive Displays. ed. / Jessica Cauchard; Vito Gentile; Mohamed Khamis; Salvatore Sorce. Association for Computing Machinery ACM, 2019. 14.

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

TY - GEN

T1 - Fueling AI with public displays?

T2 - A feasibility study of collecting biometrically tagged consensual data on a university campus

AU - Hosio, Simo

AU - Alorwu, Andy

AU - van Berkel, Niels

AU - López, Miguel Bordallo

AU - Seetharaman, Mahalakshmy

AU - Oppenlaender, Jonas

AU - Goncalves, Jorge

PY - 2019

Y1 - 2019

N2 - Interactive public displays have matured into highly capable two-way interfaces. They can be used for efficiently delivering information to people as well as for collecting insights from their users. While displays have been used for harvesting opinions and other content from users, surprisingly little work has looked into exploiting such screens for the consensual collection of tagged data that might be useful beyond one application. We present a field study where we collected biometrically tagged data using public kiosk-sized interactive screens. During 61 days of deployment time, we collected 199 selfie videos, cost-efficiently and with consent to leverage the videos in any non-profit research. 78 of the videos also had metadata attached to them. Overall, our studies indicate that people are willing to donate even highly sensitive data about themselves in public but that, at the same time, the participants had specific ethical and privacy concerns over the future of their data. Our study paves the way forward toward a future where volunteers can ethically help advance innovations in computer vision research across a variety of exciting application domains, such as health monitoring and care.

AB - Interactive public displays have matured into highly capable two-way interfaces. They can be used for efficiently delivering information to people as well as for collecting insights from their users. While displays have been used for harvesting opinions and other content from users, surprisingly little work has looked into exploiting such screens for the consensual collection of tagged data that might be useful beyond one application. We present a field study where we collected biometrically tagged data using public kiosk-sized interactive screens. During 61 days of deployment time, we collected 199 selfie videos, cost-efficiently and with consent to leverage the videos in any non-profit research. 78 of the videos also had metadata attached to them. Overall, our studies indicate that people are willing to donate even highly sensitive data about themselves in public but that, at the same time, the participants had specific ethical and privacy concerns over the future of their data. Our study paves the way forward toward a future where volunteers can ethically help advance innovations in computer vision research across a variety of exciting application domains, such as health monitoring and care.

KW - Computer vision

KW - Ethics

KW - Field study

KW - Public displays

UR - http://www.scopus.com/inward/record.url?scp=85070707040&partnerID=8YFLogxK

U2 - 10.1145/3321335.3324943

DO - 10.1145/3321335.3324943

M3 - Conference article in proceedings

SN - 978-1-4503-6751-6

BT - Proceedings of the 8th ACM International Symposium on Pervasive Displays

A2 - Cauchard, Jessica

A2 - Gentile, Vito

A2 - Khamis, Mohamed

A2 - Sorce, Salvatore

PB - Association for Computing Machinery ACM

ER -

Hosio S, Alorwu A, van Berkel N, López MB, Seetharaman M, Oppenlaender J et al. Fueling AI with public displays? A feasibility study of collecting biometrically tagged consensual data on a university campus. In Cauchard J, Gentile V, Khamis M, Sorce S, editors, Proceedings of the 8th ACM International Symposium on Pervasive Displays. Association for Computing Machinery ACM. 2019. 14 https://doi.org/10.1145/3321335.3324943