PAD-based multimodal affective fusion

S. W. Gilroy, M. Cavazza, Markus Niiranen, E. Andre, T. Vogt, J. Urbain, M. Benayoun, H. Seichter, M. Billinghurst

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

21 Citations (Scopus)

Abstract

The study of multimodality is comparatively less developed for affective interfaces than for their traditional counterparts. However, one condition for the successful development of affective interface technologies is the development of frameworks for the real-time multimodal fusion. In this paper, we describe an approach to multimodal affective fusion, which relies on a dimensional model, Pleasure-Arousal-Dominance (PAD) to support the fusion of affective modalities, each input modality being represented as a PAD vector. We describe how this model supports both affective content fusion and temporal fusion within a unified approach. We report results from early user studies which confirm the existence of a correlation between measured affective input and user temperament scores. (45 refs.)
Original languageEnglish
Title of host publicationProceedings of the 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009
Place of PublicationPiscataway, NJ, USA
PublisherIEEE Institute of Electrical and Electronic Engineers
Number of pages8
ISBN (Print)978-1-4244-4800-5, 978-1-4244-4799-2
Publication statusPublished - 2009
MoE publication typeA4 Article in a conference publication
Event3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009 - Amsterdam, Netherlands
Duration: 10 Sep 200912 Sep 2009

Conference

Conference3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009
Abbreviated titleACII 2009
CountryNetherlands
CityAmsterdam
Period10/09/0912/09/09

Fingerprint

Fusion reactions

Cite this

Gilroy, S. W., Cavazza, M., Niiranen, M., Andre, E., Vogt, T., Urbain, J., ... Billinghurst, M. (2009). PAD-based multimodal affective fusion. In Proceedings of the 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009 Piscataway, NJ, USA: IEEE Institute of Electrical and Electronic Engineers .
Gilroy, S. W. ; Cavazza, M. ; Niiranen, Markus ; Andre, E. ; Vogt, T. ; Urbain, J. ; Benayoun, M. ; Seichter, H. ; Billinghurst, M. / PAD-based multimodal affective fusion. Proceedings of the 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009. Piscataway, NJ, USA : IEEE Institute of Electrical and Electronic Engineers , 2009.
@inproceedings{73de173c360b4bd8b19a783a4fbeefee,
title = "PAD-based multimodal affective fusion",
abstract = "The study of multimodality is comparatively less developed for affective interfaces than for their traditional counterparts. However, one condition for the successful development of affective interface technologies is the development of frameworks for the real-time multimodal fusion. In this paper, we describe an approach to multimodal affective fusion, which relies on a dimensional model, Pleasure-Arousal-Dominance (PAD) to support the fusion of affective modalities, each input modality being represented as a PAD vector. We describe how this model supports both affective content fusion and temporal fusion within a unified approach. We report results from early user studies which confirm the existence of a correlation between measured affective input and user temperament scores. (45 refs.)",
author = "Gilroy, {S. W.} and M. Cavazza and Markus Niiranen and E. Andre and T. Vogt and J. Urbain and M. Benayoun and H. Seichter and M. Billinghurst",
year = "2009",
language = "English",
isbn = "978-1-4244-4800-5",
booktitle = "Proceedings of the 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009",
publisher = "IEEE Institute of Electrical and Electronic Engineers",
address = "United States",

}

Gilroy, SW, Cavazza, M, Niiranen, M, Andre, E, Vogt, T, Urbain, J, Benayoun, M, Seichter, H & Billinghurst, M 2009, PAD-based multimodal affective fusion. in Proceedings of the 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009. IEEE Institute of Electrical and Electronic Engineers , Piscataway, NJ, USA, 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009, Amsterdam, Netherlands, 10/09/09.

PAD-based multimodal affective fusion. / Gilroy, S. W.; Cavazza, M.; Niiranen, Markus; Andre, E.; Vogt, T.; Urbain, J.; Benayoun, M.; Seichter, H.; Billinghurst, M.

Proceedings of the 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009. Piscataway, NJ, USA : IEEE Institute of Electrical and Electronic Engineers , 2009.

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

TY - GEN

T1 - PAD-based multimodal affective fusion

AU - Gilroy, S. W.

AU - Cavazza, M.

AU - Niiranen, Markus

AU - Andre, E.

AU - Vogt, T.

AU - Urbain, J.

AU - Benayoun, M.

AU - Seichter, H.

AU - Billinghurst, M.

PY - 2009

Y1 - 2009

N2 - The study of multimodality is comparatively less developed for affective interfaces than for their traditional counterparts. However, one condition for the successful development of affective interface technologies is the development of frameworks for the real-time multimodal fusion. In this paper, we describe an approach to multimodal affective fusion, which relies on a dimensional model, Pleasure-Arousal-Dominance (PAD) to support the fusion of affective modalities, each input modality being represented as a PAD vector. We describe how this model supports both affective content fusion and temporal fusion within a unified approach. We report results from early user studies which confirm the existence of a correlation between measured affective input and user temperament scores. (45 refs.)

AB - The study of multimodality is comparatively less developed for affective interfaces than for their traditional counterparts. However, one condition for the successful development of affective interface technologies is the development of frameworks for the real-time multimodal fusion. In this paper, we describe an approach to multimodal affective fusion, which relies on a dimensional model, Pleasure-Arousal-Dominance (PAD) to support the fusion of affective modalities, each input modality being represented as a PAD vector. We describe how this model supports both affective content fusion and temporal fusion within a unified approach. We report results from early user studies which confirm the existence of a correlation between measured affective input and user temperament scores. (45 refs.)

M3 - Conference article in proceedings

SN - 978-1-4244-4800-5

SN - 978-1-4244-4799-2

BT - Proceedings of the 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009

PB - IEEE Institute of Electrical and Electronic Engineers

CY - Piscataway, NJ, USA

ER -

Gilroy SW, Cavazza M, Niiranen M, Andre E, Vogt T, Urbain J et al. PAD-based multimodal affective fusion. In Proceedings of the 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009. Piscataway, NJ, USA: IEEE Institute of Electrical and Electronic Engineers . 2009