Requirements and software framework for adaptive multimodal affect recognition

Elena Vildjiounaite; Vesa Kyllönen; Olli Vuorinen; Satu-Marja Mäkelä; Tommi Keränen; Markus Niiranen; Jouni Knuutinen; Johannes Peltola

doi:10.1109/ACII.2009.5349393

Requirements and software framework for adaptive multimodal affect recognition

Elena Vildjiounaite, Vesa Kyllönen, Olli Vuorinen, Satu-Marja Mäkelä, Tommi Keränen, Markus Niiranen, Jouni Knuutinen, Johannes Peltola

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

1 Citation (Scopus)

Abstract

This work presents a software framework for real time multimodal affect recognition. The framework supports categorical emotional models and simultaneous classification of emotional states along different dimensions. The framework also allows to incorporate diverse approaches to multimodal fusion, proposed by the current state of the art, as well as to adapt to context-dependency of expressing emotions and to different application requirements. The results of using the framework in audio-video based emotion recognition of an audience of different shows (this is a useful information because emotions of co-located people affect each other) confirm the capability of the framework to provide desired functionalities conveniently and demonstrate that use of contextual information increases recognition accuracy. (21 refs.)

Original language	English
Title of host publication	2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops
Place of Publication	Piscataway, NJ, USA
Publisher	IEEE Institute of Electrical and Electronic Engineers
ISBN (Electronic)	978-1-4244-4799-2
ISBN (Print)	978-1-4244-4800-5
DOIs	https://doi.org/10.1109/ACII.2009.5349393
Publication status	Published - 2009
MoE publication type	A4 Article in a conference publication
Event	3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009 - Amsterdam, Netherlands Duration: 10 Sept 2009 → 12 Sept 2009

Conference

Conference	3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009
Abbreviated title	ACII 2009
Country/Territory	Netherlands
City	Amsterdam
Period	10/09/09 → 12/09/09

Keywords

emotion recognition
labeling
mood

Access to Document

10.1109/ACII.2009.5349393

Cite this

Vildjiounaite, E., Kyllönen, V., Vuorinen, O., Mäkelä, S.-M., Keränen, T., Niiranen, M., Knuutinen, J., & Peltola, J. (2009). Requirements and software framework for adaptive multimodal affect recognition. In 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops IEEE Institute of Electrical and Electronic Engineers. https://doi.org/10.1109/ACII.2009.5349393

@inproceedings{5714b4eff7274ae3bfbd6968e366b8f3,

title = "Requirements and software framework for adaptive multimodal affect recognition",

abstract = "This work presents a software framework for real time multimodal affect recognition. The framework supports categorical emotional models and simultaneous classification of emotional states along different dimensions. The framework also allows to incorporate diverse approaches to multimodal fusion, proposed by the current state of the art, as well as to adapt to context-dependency of expressing emotions and to different application requirements. The results of using the framework in audio-video based emotion recognition of an audience of different shows (this is a useful information because emotions of co-located people affect each other) confirm the capability of the framework to provide desired functionalities conveniently and demonstrate that use of contextual information increases recognition accuracy. (21 refs.)",

keywords = "emotion recognition, labeling, mood",

author = "Elena Vildjiounaite and Vesa Kyll{\"o}nen and Olli Vuorinen and Satu-Marja M{\"a}kel{\"a} and Tommi Ker{\"a}nen and Markus Niiranen and Jouni Knuutinen and Johannes Peltola",

year = "2009",

doi = "10.1109/ACII.2009.5349393",

language = "English",

isbn = "978-1-4244-4800-5",

booktitle = "2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops",

publisher = "IEEE Institute of Electrical and Electronic Engineers",

address = "United States",

note = "3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009, ACII 2009 ; Conference date: 10-09-2009 Through 12-09-2009",

}

Vildjiounaite, E , Kyllönen, V, Vuorinen, O, Mäkelä, S-M, Keränen, T, Niiranen, M, Knuutinen, J & Peltola, J 2009, Requirements and software framework for adaptive multimodal affect recognition. in 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops. IEEE Institute of Electrical and Electronic Engineers, Piscataway, NJ, USA, 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009, Amsterdam, Netherlands, 10/09/09. https://doi.org/10.1109/ACII.2009.5349393

Requirements and software framework for adaptive multimodal affect recognition. / Vildjiounaite, Elena ; Kyllönen, Vesa; Vuorinen, Olli et al.
2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops. Piscataway, NJ, USA: IEEE Institute of Electrical and Electronic Engineers, 2009.

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

TY - GEN

T1 - Requirements and software framework for adaptive multimodal affect recognition

AU - Vildjiounaite, Elena

AU - Kyllönen, Vesa

AU - Vuorinen, Olli

AU - Mäkelä, Satu-Marja

AU - Keränen, Tommi

AU - Niiranen, Markus

AU - Knuutinen, Jouni

AU - Peltola, Johannes

PY - 2009

Y1 - 2009

N2 - This work presents a software framework for real time multimodal affect recognition. The framework supports categorical emotional models and simultaneous classification of emotional states along different dimensions. The framework also allows to incorporate diverse approaches to multimodal fusion, proposed by the current state of the art, as well as to adapt to context-dependency of expressing emotions and to different application requirements. The results of using the framework in audio-video based emotion recognition of an audience of different shows (this is a useful information because emotions of co-located people affect each other) confirm the capability of the framework to provide desired functionalities conveniently and demonstrate that use of contextual information increases recognition accuracy. (21 refs.)

AB - This work presents a software framework for real time multimodal affect recognition. The framework supports categorical emotional models and simultaneous classification of emotional states along different dimensions. The framework also allows to incorporate diverse approaches to multimodal fusion, proposed by the current state of the art, as well as to adapt to context-dependency of expressing emotions and to different application requirements. The results of using the framework in audio-video based emotion recognition of an audience of different shows (this is a useful information because emotions of co-located people affect each other) confirm the capability of the framework to provide desired functionalities conveniently and demonstrate that use of contextual information increases recognition accuracy. (21 refs.)

KW - emotion recognition

KW - labeling

KW - mood

U2 - 10.1109/ACII.2009.5349393

DO - 10.1109/ACII.2009.5349393

M3 - Conference article in proceedings

SN - 978-1-4244-4800-5

BT - 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops

PB - IEEE Institute of Electrical and Electronic Engineers

CY - Piscataway, NJ, USA

T2 - 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009

Y2 - 10 September 2009 through 12 September 2009

ER -

Vildjiounaite E , Kyllönen V, Vuorinen O, Mäkelä SM, Keränen T, Niiranen M et al. Requirements and software framework for adaptive multimodal affect recognition. In 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops. Piscataway, NJ, USA: IEEE Institute of Electrical and Electronic Engineers. 2009 doi: 10.1109/ACII.2009.5349393

Requirements and software framework for adaptive multimodal affect recognition

Abstract

Conference

Keywords

Access to Document

Fingerprint

Cite this