Requirements and software framework for adaptive multimodal affect recognition

Elena Vildjiounaite, Vesa Kyllönen, Olli Vuorinen, Satu-Marja Mäkelä, Tommi Keränen, Markus Niiranen, Jouni Knuutinen, Johannes Peltola

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

1 Citation (Scopus)

Abstract

This work presents a software framework for real time multimodal affect recognition. The framework supports categorical emotional models and simultaneous classification of emotional states along different dimensions. The framework also allows to incorporate diverse approaches to multimodal fusion, proposed by the current state of the art, as well as to adapt to context-dependency of expressing emotions and to different application requirements. The results of using the framework in audio-video based emotion recognition of an audience of different shows (this is a useful information because emotions of co-located people affect each other) confirm the capability of the framework to provide desired functionalities conveniently and demonstrate that use of contextual information increases recognition accuracy. (21 refs.)
Original languageEnglish
Title of host publication2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops
Place of PublicationPiscataway, NJ, USA
PublisherIEEE Institute of Electrical and Electronic Engineers
ISBN (Electronic)978-1-4244-4799-2
ISBN (Print)978-1-4244-4800-5
DOIs
Publication statusPublished - 2009
MoE publication typeA4 Article in a conference publication
Event3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009 - Amsterdam, Netherlands
Duration: 10 Sep 200912 Sep 2009

Conference

Conference3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009
Abbreviated titleACII 2009
CountryNetherlands
CityAmsterdam
Period10/09/0912/09/09

    Fingerprint

Keywords

  • emotion recognition
  • labeling
  • mood

Cite this

Vildjiounaite, E., Kyllönen, V., Vuorinen, O., Mäkelä, S-M., Keränen, T., Niiranen, M., Knuutinen, J., & Peltola, J. (2009). Requirements and software framework for adaptive multimodal affect recognition. In 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops IEEE Institute of Electrical and Electronic Engineers . https://doi.org/10.1109/ACII.2009.5349393