A behavior and emotion recognition framework for emotion-aware services in physical spaces

Emotions have a major role in our lives affecting on not only our experiences but also on our performance in different contexts. However, the physical environments often fail to read, interpret, and respond to the emotions of people present. The purpose of this study is to present a framework describing the needed technology modules and their relations to the surrounding environment in the context of adaptive spaces. The framework enables enhancement of physical spaces with emotionally aware, intelligent, and integrated services. For example, improving the experience of using a space or a service, detecting increased risk events, supporting vigilance, productivity, and well-being. The framework is built on studies focusing on two contexts with distinct characteristics: office and public transport vehicle. It aims to model the relationship and interaction between the human(s) and the environment facilitating the creation of adaptive services. The proposed framework consists of four main sections: measurement, modeling, actionable insight, and services. Finally, as the measurement of human behavior and emotional state often requires usage of sensitive personal data, issues related to the ethics of these solutions are discussed.