publications

2024

1. Multimodal Emotion Recognition Harnessing the Complementarity of Speech, Language, and Vision

   Thomas Thebaud , Anna Favaro , Yaohan Guan , and 5 more authors

   In Proceedings of the 26th International Conference on Multimodal Interaction , 2024

   Abs

   In the realm of audiovisual emotion recognition, a significant challenge lies in developing neural network architectures capable of effectively harnessing and integrating multimodal information. This study introduces an advanced methodology for the Empathic Virtual Agent Challenge (EVAC), utilizing state-of-the-art speech, language, and image models. Specifically, we leverage cutting-edge pre-trained models, including multilingual variants fine-tuned in French for each modality, and integrate them using late fusion techniques. Through extensive experimentation and validation, we demonstrate the efficacy of our approach in achieving competitive results on the challenge dataset. Our findings highlight that multimodal approaches outperform unimodal methods across Core Affect Presence and Intensity and Appraisal Dimensions tasks, underscoring the effectiveness of integrating diverse modalities. This underscores the importance of leveraging multiple sources of information to capture nuanced emotional states more accurately and robustly in real-world applications.

2023

1. 

   SEMI-FND: stacked ensemble based multimodal inferencing framework for faster fake news detection

   Prabhav Singh, Ridam Srivastava , K.P.S. Rana , and 1 more author

   Expert systems with applications, Jan 2023

   HTML

2022

1. 

   A topic modeled unsupervised approach to single document extractive text summarization

   Ridam Srivastava , Prabhav Singh, K.P.S. Rana , and 1 more author

   Knowledge-Based Systems, Jun 2022

   HTML

2021

1. 

   A multimodal hierarchical approach to speech emotion recognition from audio and text

   Prabhav Singh, Ridam Srivastava , K.P.S. Rana , and 1 more author

   Knowledge-Based Systems, Oct 2021

   HTML