Multimodal AI

A Platform for Interactive AI Character Experiences featured image

A Platform for Interactive AI Character Experiences

A full-pipeline platform for interactive AI character experiences, demonstrated through Digital Einstein and deployed at scientific conferences, technology events, and public …

avatar
Dr. Rafael Wampfler

On Multimodal Emotion Recognition for Human-Chatbot Interaction in the Wild

Systematic study of multimodal emotion recognition in natural human-chatbot interactions, evaluating text, acoustic, and behavioral signal fusion strategies. ICMI 2024.

n.-kovacevic

Multimodal Dialog Act Classification for Conversations With Digital Characters

A multimodal dialog act classifier integrating text and acoustic features for real-time classification in conversations with digital characters. CUI 2024.

p.-witzig
Dialog Act Classification featured image

Dialog Act Classification

Multimodal dialog act classification for conversations with digital characters — interpreting the communicative intent of user utterances to drive appropriate agent responses in …

Digital Einstein featured image

Digital Einstein

An embodied conversational AI agent bringing Albert Einstein back to life through multimodal interaction — combining speech synthesis, facial animation, and cognitive reasoning. …

Affective Computing & Emotion Recognition featured image

Affective Computing & Emotion Recognition

Multimodal deep learning systems for affective state prediction from smartphone sensors, biometric data, egocentric vision, and physiological signals — enabling real-world …