Dr. Rafael Wampfler

Dr. Rafael Wampfler

Senior Researcher & Lecturer

I am a Senior Researcher & Lecturer at the Computer Graphics Laboratory of ETH Zurich, and a Research Consultant at Disney Research. I lead the Digital Character AI team at CGL and, as PI of an SNF Ambizione grant, a line of generative models that produce expressive 3D facial animation from speech and text under explicit control of emotion and expression. My research interests include conversational digital characters, generative animation, affective computing, human-computer interaction, and applied machine learning.

My vision is to create intelligent digital humans that can naturally communicate, understand, and support people across domains such as education and mental health. My research focuses on multimodal artificial intelligence for interactive digital humans, developing models that combine large language models, affective computing, and data-driven animation to create embodied conversational agents endowed with autonomous agency, consistent values, and beliefs.

My work bridges machine learning, human–computer interaction, and computer graphics to enable AI systems such as Digital Einstein and interactive patient avatars for psychotherapy training and health education.

EmoSpaceTime: Decoupling Emotion and Content through Contrastive Learning for Expressive 3D Speech Animation featured image

EmoSpaceTime: Decoupling Emotion and Content through Contrastive Learning for Expressive 3D Speech Animation

EmoSpaceTime decouples emotion and content in 3D speech animation through contrastive learning, enabling fine-grained control over emotional expressivity independent of spoken …

P. Witzig
•

On Multimodal Emotion Recognition for Human-Chatbot Interaction in the Wild

Systematic study of multimodal emotion recognition in natural human-chatbot interactions, evaluating text, acoustic, and behavioral signal fusion strategies. ICMI 2024.

N. Kovačević
•

Multimodal Dialog Act Classification for Digital Character Conversations

A multimodal dialog act classifier integrating text and acoustic features for real-time classification in conversations with digital characters. CUI 2024.

P. Witzig
•

Chatbots With Attitude: Enhancing Chatbot Interactions Through Dynamic Personality Infusion

Dynamic personality infusion for chatbots — modulating expressed Big Five personality traits at inference time to improve user engagement and interaction quality. CUI 2024.

N. Kovačević
•
The Personality Dimensions GPT-3 Expresses During Human-Chatbot Interactions featured image

The Personality Dimensions GPT-3 Expresses During Human-Chatbot Interactions

A large-scale empirical characterization of the personality dimensions GPT-3 expresses during human-chatbot interaction, using Big Five psychometrics. Published in ACM IMWUT 2024.

N. Kovačević
•

Personality Trait Recognition Based on Smartphone Typing Characteristics in the Wild

Personality trait recognition from everyday smartphone typing dynamics in naturalistic conditions, using deep learning on keystroke patterns. IEEE Transactions on Affective …

N. Kovačević
•
Affective State Prediction from Smartphone Touch and Sensor Data in the Wild featured image

Affective State Prediction from Smartphone Touch and Sensor Data in the Wild

Multimodal affective state prediction from smartphone touch and sensor data in naturalistic conditions, using deep learning fusion. CHI 2022.

avatar
Rafael Wampfler
•

Image Reconstruction of Tablet Front Camera Recordings in Educational Settings

Image reconstruction from tablet front camera recordings for engagement analysis in educational settings. EDM 2020.

avatar
Rafael Wampfler
•

Glyph-Based Visualization of Affective States

Glyph-based visualization technique for representing multimodal affective state data, designed for intuitive perception and scalable display. EuroVis 2020.

N. Kovačević
•

Affective State Prediction Based on Semi-Supervised Learning from Smartphone Touch Data

Semi-supervised learning for affective state prediction from smartphone touch data, leveraging abundant unlabeled naturalistic data. CHI 2020.

avatar
Rafael Wampfler
•