An emotionally responsive AR art installation

Stephen W. Gilroy, Marc Cavazza, Rémi Chaignon, Satu-Marja Mäkelä, Markus Niiranen, Elisabeth André, Thurid Vogt, Mark Billinghurst, Hartmut Seichter, Maurice Benayoun

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

Abstract

In this paper, we describe a novel method of combining emotional input and an Augmented Reality (AR) tracking/display system to produce dynamic interactive art that responds to the perceived emotional content of viewer reactions and interactions. As part of the CALLAS project, our aim is to explore multimodal interaction in an Arts and Entertainment context.
The approach we describe has been implemented as part of a prototype showcase in collaboration with a digital artist designed to demonstrate how affective input from the audience of an interactive art installation can be used to enhance and enrich the aesthetic experience of the artistic work.
We propose an affective model for combining emotionally-loaded participant input with aesthetic interpretations of interaction, together with a mapping which controls properties of dynamically generated digital art.
Original languageEnglish
Title of host publicationProceedings
Subtitle of host publicationSixth IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2007
PublisherIEEE Institute of Electrical and Electronic Engineers
ISBN (Print)978-1-4244-1749-0
Publication statusPublished - 2007
MoE publication typeA4 Article in a conference publication
Event6th IEEE and ACM Symposium on Mixed and Augmented Reality, ISMAR 2007 - Nara, Japan
Duration: 13 Nov 200716 Nov 2007

Conference

Conference6th IEEE and ACM Symposium on Mixed and Augmented Reality, ISMAR 2007
Abbreviated titleISMAR 2007
CountryJapan
CityNara
Period13/11/0716/11/07

Fingerprint

Augmented reality
Display devices

Cite this

Gilroy, S. W., Cavazza, M., Chaignon, R., Mäkelä, S-M., Niiranen, M., André, E., ... Benayoun, M. (2007). An emotionally responsive AR art installation. In Proceedings: Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2007 IEEE Institute of Electrical and Electronic Engineers .
Gilroy, Stephen W. ; Cavazza, Marc ; Chaignon, Rémi ; Mäkelä, Satu-Marja ; Niiranen, Markus ; André, Elisabeth ; Vogt, Thurid ; Billinghurst, Mark ; Seichter, Hartmut ; Benayoun, Maurice. / An emotionally responsive AR art installation. Proceedings: Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2007. IEEE Institute of Electrical and Electronic Engineers , 2007.
@inproceedings{5b5e8aa428bb4911a98c34958cf100a9,
title = "An emotionally responsive AR art installation",
abstract = "In this paper, we describe a novel method of combining emotional input and an Augmented Reality (AR) tracking/display system to produce dynamic interactive art that responds to the perceived emotional content of viewer reactions and interactions. As part of the CALLAS project, our aim is to explore multimodal interaction in an Arts and Entertainment context. The approach we describe has been implemented as part of a prototype showcase in collaboration with a digital artist designed to demonstrate how affective input from the audience of an interactive art installation can be used to enhance and enrich the aesthetic experience of the artistic work. We propose an affective model for combining emotionally-loaded participant input with aesthetic interpretations of interaction, together with a mapping which controls properties of dynamically generated digital art.",
author = "Gilroy, {Stephen W.} and Marc Cavazza and R{\'e}mi Chaignon and Satu-Marja M{\"a}kel{\"a} and Markus Niiranen and Elisabeth Andr{\'e} and Thurid Vogt and Mark Billinghurst and Hartmut Seichter and Maurice Benayoun",
note = "Project code: 6736",
year = "2007",
language = "English",
isbn = "978-1-4244-1749-0",
booktitle = "Proceedings",
publisher = "IEEE Institute of Electrical and Electronic Engineers",
address = "United States",

}

Gilroy, SW, Cavazza, M, Chaignon, R, Mäkelä, S-M, Niiranen, M, André, E, Vogt, T, Billinghurst, M, Seichter, H & Benayoun, M 2007, An emotionally responsive AR art installation. in Proceedings: Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2007. IEEE Institute of Electrical and Electronic Engineers , 6th IEEE and ACM Symposium on Mixed and Augmented Reality, ISMAR 2007, Nara, Japan, 13/11/07.

An emotionally responsive AR art installation. / Gilroy, Stephen W.; Cavazza, Marc; Chaignon, Rémi; Mäkelä, Satu-Marja; Niiranen, Markus; André, Elisabeth; Vogt, Thurid; Billinghurst, Mark; Seichter, Hartmut; Benayoun, Maurice.

Proceedings: Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2007. IEEE Institute of Electrical and Electronic Engineers , 2007.

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

TY - GEN

T1 - An emotionally responsive AR art installation

AU - Gilroy, Stephen W.

AU - Cavazza, Marc

AU - Chaignon, Rémi

AU - Mäkelä, Satu-Marja

AU - Niiranen, Markus

AU - André, Elisabeth

AU - Vogt, Thurid

AU - Billinghurst, Mark

AU - Seichter, Hartmut

AU - Benayoun, Maurice

N1 - Project code: 6736

PY - 2007

Y1 - 2007

N2 - In this paper, we describe a novel method of combining emotional input and an Augmented Reality (AR) tracking/display system to produce dynamic interactive art that responds to the perceived emotional content of viewer reactions and interactions. As part of the CALLAS project, our aim is to explore multimodal interaction in an Arts and Entertainment context. The approach we describe has been implemented as part of a prototype showcase in collaboration with a digital artist designed to demonstrate how affective input from the audience of an interactive art installation can be used to enhance and enrich the aesthetic experience of the artistic work. We propose an affective model for combining emotionally-loaded participant input with aesthetic interpretations of interaction, together with a mapping which controls properties of dynamically generated digital art.

AB - In this paper, we describe a novel method of combining emotional input and an Augmented Reality (AR) tracking/display system to produce dynamic interactive art that responds to the perceived emotional content of viewer reactions and interactions. As part of the CALLAS project, our aim is to explore multimodal interaction in an Arts and Entertainment context. The approach we describe has been implemented as part of a prototype showcase in collaboration with a digital artist designed to demonstrate how affective input from the audience of an interactive art installation can be used to enhance and enrich the aesthetic experience of the artistic work. We propose an affective model for combining emotionally-loaded participant input with aesthetic interpretations of interaction, together with a mapping which controls properties of dynamically generated digital art.

M3 - Conference article in proceedings

SN - 978-1-4244-1749-0

BT - Proceedings

PB - IEEE Institute of Electrical and Electronic Engineers

ER -

Gilroy SW, Cavazza M, Chaignon R, Mäkelä S-M, Niiranen M, André E et al. An emotionally responsive AR art installation. In Proceedings: Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2007. IEEE Institute of Electrical and Electronic Engineers . 2007