Explore the Full Program of SIGGRAPH Asia 2025!
Close

Presentation

Ultra-Accurate 4D Facial Capture with Stereo HMC
DescriptionLearn how our stereo HMC-based facial capture method delivers quality comparable to seated 4D capture stages. We train a personalized neural network that tracks subtle performance nuances without markers, under changing lighting conditions and camera angles. The method requires only FACS-based facial scans of the actor and a 20-minute training sequence in the HMC. We will also present our approach to building rigs that can reproduce and edit an actor’s 4D performance sequence with minimal loss, using a learned deformation layer.