Speaker: Ziwei (Sara) Gong – ARNI Language and Vision Working Group
April 27 @ 3:00 pm - 4:00 pm
Title: Decoding Human Emotions: From Psychological Theories to Multimodal NLP Models
Abstract: Understanding and modeling human emotions is essential for natural language processing (NLP) applications, from conversational AI to mental health assessment. This talk explores the intersection of emotion theory, dataset development, and multimodal machine learning, highlighting key challenges and innovations in emotion recognition. We discuss the alignment of psychological emotion frameworks with computational models, strategies for improving multimodal emotion recognition, and advances in self-supervised learning for low-resource languages. Additionally, we examine how multimodal signals enhance model performance and interpretability.