Dr. Rafael Wampfler

Dr. Rafael Wampfler

Senior Researcher & Lecturer

Computer Graphics Laboratory, ETH Zurich

Professional Summary

I am a Senior Researcher & Lecturer at the Computer Graphics Laboratory of ETH Zurich, and a Research Consultant at Disney Research. I lead the Digital Character AI team at CGL and, as PI of an SNF Ambizione grant, a line of generative models that produce expressive 3D facial animation from speech and text under explicit control of emotion and expression. My research interests include conversational digital characters, generative animation, affective computing, human-computer interaction, and applied machine learning.

My vision is to create intelligent digital humans that can naturally communicate, understand, and support people across domains such as education and mental health. My research focuses on multimodal artificial intelligence for interactive digital humans, developing models that combine large language models, affective computing, and data-driven animation to create embodied conversational agents endowed with autonomous agency, consistent values, and beliefs.

My work bridges machine learning, human–computer interaction, and computer graphics to enable AI systems such as Digital Einstein and interactive patient avatars for psychotherapy training and health education.

Education

Dr. sc. (PhD) in Computer Science

ETH Zurich

Master's Degree in Computer Science

ETH Zurich

Bachelor's Degree in Computer Science

ETH Zurich

Interests

Generative Animation Synthesis Embodied Conversational Agents Cognitive & Narrative Character Models Multimodal Perception & Affective Computing LLM-Driven Dialogue & Storytelling AI for Digital Health
My Research

My research addresses a fundamental challenge at the intersection of deep learning and human-centric AI: how can we build machine learning systems that not only perform with high accuracy but also meaningfully understand, adapt to, and collaborate with humans?

I work across three interconnected areas: multimodal deep learning for affective and behavioral understanding, leveraging smartphone sensors, egocentric vision, and physiological signals; agentic AI and cognitive architectures for conversational agents, enabling consistent personality, beliefs, and emotional states; and scalable generative models for embodied expression, developing efficient transformer pipelines for text-driven and speech-driven facial animation.

A flagship application is Digital Einstein, an embodied conversational agent that has reached thousands of visitors globally at events including SIGGRAPH, GITEX Global, and the World Economic Forum. My system also powers collaborative applied research in digital health — including a Virtual Psychotherapist for mental health support and RehaBot for patient health education.

Please reach out to collaborate.

Research Projects
Digital Einstein featured image

Digital Einstein

An embodied conversational AI agent bringing Albert Einstein back to life through multimodal interaction — combining speech synthesis, facial animation, and cognitive reasoning. …

Affective Computing & Emotion Recognition featured image

Affective Computing & Emotion Recognition

Multimodal deep learning systems for affective state prediction from smartphone sensors, biometric data, egocentric vision, and physiological signals — enabling real-world …

Personality & Cognitive Architectures for Conversational Agents featured image

Personality & Cognitive Architectures for Conversational Agents

Deep learning-based cognitive frameworks that enable conversational agents to maintain consistent personality, beliefs, values, and emotional states across extended interactions — …

Facial Animation Synthesis featured image

Facial Animation Synthesis

Efficient transformer-based pipelines for text-driven and speech-driven 3D facial animation — achieving real-time performance through phoneme-level speech modeling and contrastive …

Dialog Act Classification featured image

Dialog Act Classification

Multimodal dialog act classification for conversations with digital characters — interpreting the communicative intent of user utterances to drive appropriate agent responses in …

Virtual Psychotherapist featured image

Virtual Psychotherapist

Embodied conversational agents for mental health support, developed in partnership with Prof. Andrew Gloster (University of Lucerne). The project comprises a patient-facing …

RehaBot featured image

RehaBot

An embodied AI avatar representing a medical professional, capable of conducting patient interactions, health assessments, and health education in rehabilitation and home-care …

MIND — Cognitive Health Monitoring featured image

MIND — Cognitive Health Monitoring

A mobile AI platform for early detection of cognitive impairment in aging populations, integrating Large Geospatial Models for movement analysis, LLMs for conversational cognitive …

Funding
My research is supported by competitive grants from national and international funding agencies. Current projects include work on cognitive health monitoring funded by the National Research Foundation Singapore (NRF CREATE – Future Health Technologies 2), animation synthesis funded by an SNF Ambizione grant, and applied digital health projects in collaboration with Swiss universities and hospitals. Past funding includes project partnerships with the Hasler Foundation and the University of Basel.
Selected Talks
  • Sep 2026 — Digital Einstein: Bringing Einstein Back to Life, Public talk, NZZ Festival Lounge, Zurich Film Festival, Zurich
  • May 2026 — The Rise of AI Avatars: Potential for Teaching & Education, Keynote, EduAI Summit 2026, St. Gallen
  • Jan 2026 — AI Literacy and the Future of Work, Panel discussion, World Economic Forum, Davos
  • Nov 2025 — Beyond Avatars, Panel discussion, Berlin Science Week, Berlin
  • Oct 2025 — The Creation of Believable Digital Characters, Keynote, InVirtuo 4.0 Network Workshop, Bonn
  • Oct 2025 — A Platform for Interactive AI Character Experiences, Invited talk, GITEX Global, Dubai
  • Aug 2025 — Digital Einstein at SIGGRAPH, Vancouver
  • Oct 2024 — The Creation of Believable Digital Characters, Keynote, GITEX Global, Dubai
People
I supervise a team of PhD students and research assistants. I currently supervise two PhD students, with a third starting in November 2026, and have supervised two PhDs to completion (2025 and 2026). PhD projects span user interface optimisation, believable narrative agents, and data-driven animation synthesis for conversational characters. I have supervised 36 Bachelor's theses, 15 Master's theses, and 9 semester projects, as well as four student research assistants working on the Digital Einstein platform.
Teaching
CourseRoleInstitutionYears
Artificial Intelligence for Digital CharactersCourse creator & lecturerETH Zurich2024 – present
Seminar on Digital HumansCourse creator & lecturerETH Zurich2022 – present
Visual ComputingHead teaching assistantETH Zurich, D-INFK2022 – 2024
Parallel ProgrammingHead teaching assistantETH Zurich, D-INFK2021 – 2023
Informatik ITeaching assistantETH Zurich, D-BAUG and D-MAVT2017 – 2021
Featured Publications
Toward Accessible Psychotherapy Training Using AI-Driven Interactive Patient Avatars featured image

Toward Accessible Psychotherapy Training Using AI-Driven Interactive Patient Avatars

An AI-driven simulated patient system for ACT psychotherapy training, combining clinically grounded virtual patients with real-time turn-by-turn ACT fidelity feedback. Expert …

P. Riachi
•
PhonemeNet: A Transformer Pipeline for Text-Driven Facial Animation featured image

PhonemeNet: A Transformer Pipeline for Text-Driven Facial Animation

A transformer pipeline for text-driven facial animation exploiting phoneme-level speech structure, achieving real-time performance and best-in-class lip synchronization accuracy. …

P. Witzig
•
egoEMOTION: Egocentric Vision and Physiological Signals for Emotion and Personality Recognition in Real-World Tasks featured image

egoEMOTION: Egocentric Vision and Physiological Signals for Emotion and Personality Recognition in Real-World Tasks

A new multimodal dataset and architecture combining egocentric vision and physiological signals for in-the-wild emotion and personality recognition, presented at NeurIPS 2025 …

M. Jammot
•
BEE: Belief-Value-Aligned, Explainable, and Extensible Cognitive Framework for Conversational Agents featured image

BEE: Belief-Value-Aligned, Explainable, and Extensible Cognitive Framework for Conversational Agents

BEE is a modular cognitive framework for conversational agents featuring belief management, value alignment, transparent reasoning, and extensibility. Best Paper Honorable Mention …

C. Yang
•
A Platform for Interactive AI Character Experiences featured image

A Platform for Interactive AI Character Experiences

A full-pipeline platform for interactive AI character experiences, demonstrated through Digital Einstein and deployed at scientific conferences, technology events, and public …

avatar
Rafael Wampfler
•
EmoSpaceTime: Decoupling Emotion and Content through Contrastive Learning for Expressive 3D Speech Animation featured image

EmoSpaceTime: Decoupling Emotion and Content through Contrastive Learning for Expressive 3D Speech Animation

EmoSpaceTime decouples emotion and content in 3D speech animation through contrastive learning, enabling fine-grained control over emotional expressivity independent of spoken …

P. Witzig
•
The Personality Dimensions GPT-3 Expresses During Human-Chatbot Interactions featured image

The Personality Dimensions GPT-3 Expresses During Human-Chatbot Interactions

A large-scale empirical characterization of the personality dimensions GPT-3 expresses during human-chatbot interaction, using Big Five psychometrics. Published in ACM IMWUT 2024.

N. Kovačević
•
Affective State Prediction from Smartphone Touch and Sensor Data in the Wild featured image

Affective State Prediction from Smartphone Touch and Sensor Data in the Wild

Multimodal affective state prediction from smartphone touch and sensor data in naturalistic conditions, using deep learning fusion. CHI 2022.

avatar
Rafael Wampfler
•
All Publications