Augmenting automated kinship verification with targeted human input

Danula Hettiachchi, Simo Hosio, Vassilis Kostakos, Niels van Berkel, Miguel Bordallo López, Jorge Goncalves

Research output: Contribution to conferenceConference articleScientificpeer-review

Abstract

Kinship verification is the problem whereby a third party determines whether two people are related. Despite previous research in Psychology and Machine Vision, the factors affecting a person's verification ability are poorly understood. Through an online crowdsourcing study, we investigate the impact of gender, race and medium type (image vs video) on kinship verification - taking into account the demographics of both raters and ratees. A total of 325 workers completed over 50,000 kinship verification tasks consisting of pairs of faces shown in images and videos from three widely used datasets. Our results identify an own-race bias and a higher verification accuracy for same-gender image pairs than opposite-gender image pairs. Our results demonstrate that humans can still outperform current state-of-the-art automated unsupervised approaches. Furthermore, we show that humans perform better when presented with videos instead of still images. Our findings contribute to the design of future human-in-the-loop kinship verification tasks, including time-critical use cases such as identifying missing persons.

Original languageEnglish
Publication statusPublished - 2020
MoE publication typeNot Eligible
Event24th Pacific Asia Conference on Information Systems: Information Systems (IS) for the Future, PACIS 2020 - Dubai, United Arab Emirates
Duration: 20 Jun 202024 Jun 2020

Conference

Conference24th Pacific Asia Conference on Information Systems
CountryUnited Arab Emirates
CityDubai
Period20/06/2024/06/20

Keywords

  • Crowdsourcing
  • Kinship verification
  • Worker characteristics

Fingerprint Dive into the research topics of 'Augmenting automated kinship verification with targeted human input'. Together they form a unique fingerprint.

  • Cite this

    Hettiachchi, D., Hosio, S., Kostakos, V., van Berkel, N., López, M. B., & Goncalves, J. (2020). Augmenting automated kinship verification with targeted human input. Paper presented at 24th Pacific Asia Conference on Information Systems, Dubai, United Arab Emirates.