Towards Semantic Multimodal Emotion Recognition for Enhancing Assistive Services in Ubiquitous Robotics

International audience In this paper, the problem of endowing ubiquitous robots withcognitive capabilities for recognizing emotions, sentiments,affects and moods of humans, in their context, is studied. Ahybrid approach based on multilayer perceptron (MLP) neural network and n-ary ontologies for emotion-aware roboticsystems is proposed. In particular, an algorithm based on thehybrid-level fusion, an expressive emotional knowledge representation and reasoning model are introduced to recognizecomplex and non-observable emotional context of the user.Empirical experiments on real-world dataset corroborate itseffectiveness.