An emotionally responsive AR art installation

Stephen W. Gilroy, Marc Cavazza, Rémi Chaignon, Satu-Marja Mäkelä, Markus Niiranen, Elisabeth André, Thurid Vogt, Mark Billinghurst, Hartmut Seichter, Maurice Benayoun

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review


In this paper, we describe a novel method of combining emotional input and an Augmented Reality (AR) tracking/display system to produce dynamic interactive art that responds to the perceived emotional content of viewer reactions and interactions. As part of the CALLAS project, our aim is to explore multimodal interaction in an Arts and Entertainment context.
The approach we describe has been implemented as part of a prototype showcase in collaboration with a digital artist designed to demonstrate how affective input from the audience of an interactive art installation can be used to enhance and enrich the aesthetic experience of the artistic work.
We propose an affective model for combining emotionally-loaded participant input with aesthetic interpretations of interaction, together with a mapping which controls properties of dynamically generated digital art.
Original languageEnglish
Title of host publicationProceedings
Subtitle of host publicationSixth IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2007
PublisherIEEE Institute of Electrical and Electronic Engineers
ISBN (Print)978-1-4244-1749-0
Publication statusPublished - 2007
MoE publication typeA4 Article in a conference publication
Event6th IEEE and ACM Symposium on Mixed and Augmented Reality, ISMAR 2007 - Nara, Japan
Duration: 13 Nov 200716 Nov 2007


Conference6th IEEE and ACM Symposium on Mixed and Augmented Reality, ISMAR 2007
Abbreviated titleISMAR 2007

Fingerprint Dive into the research topics of 'An emotionally responsive AR art installation'. Together they form a unique fingerprint.

Cite this