IDEAS Lab

Emotion Recognition

affect2mm

Overview

This area focused primarily on developing techniques for emotion recognition from multiple modalities such as face, speech, and body expressions. This leads to a variety of applications including fake media detection, understanding cognitive engagement, and building socially-aware robots for navigation and interaction with humans.

Publications

Estimating Emotion Contagion on Social Media via Localized Diffusion in Dynamic Graphs
Trisha Mittal, Puneet Mathur, Rohan Chandra, Apurva Bhatt, Vikram Gupta, Debdoot Mukherjee, Aniket Bera, Dinesh Manocha
arXiv  ·  01 Jan 2022
Affective ComputingEmotion Recognition
Learning Unseen Emotions from Gestures via Semantically-Conditioned Zero-Shot Perception with Adversarial Autoencoders
Abhishek Banerjee, Uttaran Bhattacharya, Aniket Bera
Proceedings of the AAAI Conference on Artificial Intelligence  ·  28 Jun 2022
Affective ComputingEmotion Recognition
Affect2MM: Affective Analysis of Multimedia Content Using Emotion Causality
Trisha Mittal, Puneet Mathur, Aniket Bera, Dinesh Manocha
2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)  ·  01 Jun 2021
Affective ComputingEmotion Recognition
Multimodal and Context-Aware Emotion Perception Model With Multiplicative Fusion
Trisha Mittal, Aniket Bera, Dinesh Manocha
IEEE MultiMedia  ·  01 Apr 2021
Affective ComputingEmotion Recognition
MET: Multimodal Perception of Engagement for Telehealth
Pooja Guhan, Naman Awasthi, and Kathryn McDonald, Kristin Bussell, Dinesh Manocha, Gloria Reeves, Aniket Bera
arXiv  ·  01 Jan 2020
Mental HealthAffective ComputingEmotion Recognition
EmotiCon: Context-Aware Multimodal Emotion Recognition Using Frege’s Principle
Trisha Mittal, Pooja Guhan, Uttaran Bhattacharya, Rohan Chandra, Aniket Bera, Dinesh Manocha
2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)  ·  01 Jun 2020
Affective ComputingEmotion Recognition
Emotions Don't Lie
Trisha Mittal, Uttaran Bhattacharya, Rohan Chandra, Aniket Bera, Dinesh Manocha
Proceedings of the 28th ACM International Conference on Multimedia  ·  12 Oct 2020
Affective ComputingEmotion Recognition
M3ER: Multiplicative Multimodal Emotion Recognition using Facial, Textual, and Speech Cues
Trisha Mittal, Uttaran Bhattacharya, Rohan Chandra, Aniket Bera, Dinesh Manocha
Proceedings of the AAAI Conference on Artificial Intelligence  ·  03 Apr 2020
Affective ComputingEmotion Recognition
STEP: Spatial Temporal Graph Convolutional Networks for Emotion Perception from Gaits
Uttaran Bhattacharya, Trisha Mittal, Rohan Chandra, Tanmay Randhavane, Aniket Bera, Dinesh Manocha
Proceedings of the AAAI Conference on Artificial Intelligence  ·  03 Apr 2020
Affective ComputingEmotion Recognition
Take an Emotion Walk: Perceiving Emotions from Gaits Using Hierarchical Attention Pooling and Affective Mapping
Uttaran Bhattacharya, Christian Roncal, Trisha Mittal, Rohan Chandra, Kyra Kapsaskis, Kurt Gray, Aniket Bera, Dinesh Manocha
Computer Vision – ECCV 2020  ·  01 Jan 2020
Affective ComputingEmotion Recognition
Identifying Emotions from Walking using Affective and Deep Features
Tanmay Randhavane, Uttaran Bhattacharya, Kyra Kapsaskis, Kurt Gray, Aniket Bera, Dinesh Manocha
arXiv  ·  01 Jan 2019
Affective ComputingEmotion Recognition
The Liar's Walk: Detecting Deception with Gait and Gesture
Tanmay Randhavane, Uttaran Bhattacharya, Kyra Kapsaskis, Kurt Gray, Aniket Bera, Dinesh Manocha
arXiv  ·  01 Jan 2019
Affective ComputingEmotion Recognition
MixedPeds: Pedestrian Detection in Unannotated Videos using Synthetically Generated Human-agents for Training
Ernest C. Cheung, Tsan Kwong Wong, Aniket Bera, Dinesh Manocha
arXiv  ·  01 Jan 2017
Affective ComputingEmotion Recognition
AdaPT: Real-time adaptive pedestrian tracking for crowded scenes
Aniket Bera, Nico Galoppo, Dillon Sharlet, Adam Lake, Dinesh Manocha
2014 IEEE International Conference on Robotics and Automation (ICRA)  ·  01 May 2014
Human-Crowd InteractionMotion and Path PlanningCrowd SimulationAffective ComputingEmotion Recognition