Emotion Recognition from Body Gestures

In the last decade, there has been a growing interest in emotion analysis research, which has been applied in several areas of computer science. Many authors have contributed to the development of emotion recognition algorithms, considering textual or non verbal data as input, such as facial expressions, gestures or, in the case of multi-modal emotion recognition, a combination of them.

The goal of this project is to describe a method for detecting emotions from gestures using the skeletal data obtained from Kinect-like devices as input, as well as a textual description of their meaning. The rationale here is to exploit the existing correlation between body movements and spoken user sentence(s), using it to reveal user’s emotions from gestures.

Partners: ICAR 

Publications

• V. Gentile, F. Milazzo, S. Sorce, A. Gentile, A. Augello, and G. Pilato, “Body Gestures and Spoken Sentences: A Novel Approach for Revealing User’s Emotions,” in 2017 IEEE 11th International Conference on Semantic Computing (ICSC), 2017, pp. 69-72.
  [Bibtex]

  @inproceedings{Gentile2017ICSC,
  author = {Vito Gentile and Fabrizio Milazzo and Salvatore Sorce and Antonio Gentile and Agnese Augello and Giovanni Pilato},
  booktitle = {{2017 IEEE 11th International Conference on Semantic Computing (ICSC)}},
  title = {{Body Gestures and Spoken Sentences: A Novel Approach for Revealing User's Emotions}},
  year = {2017},
  pages = {69-72},
  keywords = {Emotion Recognition;Gesture Recognition;Sentiment Analysis},
  doi = {10.1109/ICSC.2017.14},
  month = {Jan},
  url = {http://ieeexplore.ieee.org/document/7889507/}
  }

• F. Milazzo, A. Augello, G. Pilato, V. Gentile, A. Gentile, and S. Sorce, “Exploiting Correlation between Body Gestures and Spoken Sentences for Real-time Emotion Recognition,” in Proceedings of CHItaly ’17, Cagliari, Italy, September 18–20, New York, NY, USA, 2017.
  [Bibtex]

  @inproceedings{Milazzo2017CHItaly,
  author = {Fabrizio Milazzo and Agnese Augello and Giovanni Pilato and Vito Gentile and Antonio Gentile and Salvatore Sorce},
  title = {{Exploiting Correlation between Body Gestures and Spoken Sentences for Real-time Emotion Recognition}},
  booktitle = {{Proceedings of CHItaly ’17, Cagliari, Italy, September 18–20}},
  series = {{CHI-ITALY '17}},
  year = 2017,
  isbn = {},
  location = {Cagliari, IT},
  pages = {},
  numpages = {6},
  url = {https://doi.org/10.1145/3125571.3125590},
  doi = {10.1145/3125571.3125590},
  publisher = {{ACM}},
  address = {New York, NY, USA},
  keywords = {Emotion Recognition, Dynamic Time Warping, K-nearest neighbor.},
  }