Dr. Rafael Wampfler

Dr. Rafael Wampfler

Senior Researcher & Lecturer

I am a Senior Researcher & Lecturer at the Computer Graphics Laboratory of ETH Zurich, and a Research Consultant at Disney Research. I lead the Digital Character AI team at CGL and, as PI of an SNF Ambizione grant, a line of generative models that produce expressive 3D facial animation from speech and text under explicit control of emotion and expression. My research interests include conversational digital characters, generative animation, affective computing, human-computer interaction, and applied machine learning.

My vision is to create intelligent digital humans that can naturally communicate, understand, and support people across domains such as education and mental health. My research focuses on multimodal artificial intelligence for interactive digital humans, developing models that combine large language models, affective computing, and data-driven animation to create embodied conversational agents endowed with autonomous agency, consistent values, and beliefs.

My work bridges machine learning, human–computer interaction, and computer graphics to enable AI systems such as Digital Einstein and interactive patient avatars for psychotherapy training and health education.

Toward Accessible Psychotherapy Training Using AI-Driven Interactive Patient Avatars featured image

Toward Accessible Psychotherapy Training Using AI-Driven Interactive Patient Avatars

An AI-driven simulated patient system for ACT psychotherapy training, combining clinically grounded virtual patients with real-time turn-by-turn ACT fidelity feedback. Expert …

P. Riachi
•

Mind Companion: An Embodied Conversational Agent for Process-Based Psychotherapy

Mind Companion is an LLM-based embodied conversational agent for process-based psychotherapy, integrating real-time psychological analysis, RAG from therapeutic literature, and …

S. Kamber
•

Talking to Your Data: Exploring Embodied Conversation as an Interface for Personal Health Reflection

A system enabling users to "talk to their health data" through an embodied conversational agent using a dual-agent architecture, compared against traditional dashboards in a pilot …

N. Kovačević
•
PhonemeNet: A Transformer Pipeline for Text-Driven Facial Animation featured image

PhonemeNet: A Transformer Pipeline for Text-Driven Facial Animation

A transformer pipeline for text-driven facial animation exploiting phoneme-level speech structure, achieving real-time performance and best-in-class lip synchronization accuracy. …

P. Witzig
•
egoEMOTION: Egocentric Vision and Physiological Signals for Emotion and Personality Recognition in Real-World Tasks featured image

egoEMOTION: Egocentric Vision and Physiological Signals for Emotion and Personality Recognition in Real-World Tasks

A new multimodal dataset and architecture combining egocentric vision and physiological signals for in-the-wild emotion and personality recognition, presented at NeurIPS 2025 …

M. Jammot
•

Steering Narrative Agents through a Dynamic Cognitive Framework for Guided Emergent Storytelling

A dynamic cognitive framework for narrative agents in interactive storytelling, combining BDI representations with LLM generation to balance story coherence with player agency. …

C. Yang
•
BEE: Belief-Value-Aligned, Explainable, and Extensible Cognitive Framework for Conversational Agents featured image

BEE: Belief-Value-Aligned, Explainable, and Extensible Cognitive Framework for Conversational Agents

BEE is a modular cognitive framework for conversational agents featuring belief management, value alignment, transparent reasoning, and extensibility. Best Paper Honorable Mention …

C. Yang
•

A Joint Personality-Emotion Framework for Personality-Consistent Conversational Agents

A joint framework modeling personality and emotion for personality-consistent conversational agents, using contrastive learning to decouple emotion from semantic content. IVA 2025. …

N. Kovačević
•
A Platform for Interactive AI Character Experiences featured image

A Platform for Interactive AI Character Experiences

A full-pipeline platform for interactive AI character experiences, demonstrated through Digital Einstein and deployed at scientific conferences, technology events, and public …

avatar
Rafael Wampfler
•

Immersive Conversations with Digital Einstein: Linking a Physical System and AI

SIGGRAPH Asia 2024 Emerging Technologies demonstration describing the physical installation and AI integration of Digital Einstein at the Tokyo venue.

avatar
Rafael Wampfler
•