Performance capture is about bringing digital characters to life by capturing the geometry and motion of real human performances.
Our research covers the full pipeline for data-driven modeling and animation of virtual avatars, which includes real-time markerless acquisition, tracking in non-rigid partial data, deformable shape completion, motion-retargeting, and automatic character rigging.
Publications

Online Generative Model Personalization for Hand Tracking
A. Tkach; A. Tagliasacchi; E. Remelli; M. Pauly; A. Fitzgibbon
2017. 10th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia, Bangkok, THAILAND, NOV 27-30, 2017. p. 243. DOI : 10.1145/3130800.3130830.

Low-Dimensionality Calibration through Local Anisotropic Scaling for Robust Hand Model Personalization
E. Remelli; A. Tkach; A. Tagliasacchi; M. Pauly
2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy, Octobre 22-29, 2017.

Sphere-Meshes for Real-Time Hand Modeling and Tracking
A. Tkach; M. Pauly; A. Tagliasacchi
2016. ACM SIGGRAPH Asia Conference. p. 222. DOI : 10.1145/2980179.2980226.
Temporally Consistent Motion Segmentation From RGB-D Video
P. Bertholet; A. Ichim; M. Zwicker
COMPUTER GRAPHICS FORUM. 2018. Vol. 37, num. 6, p. 118-134. DOI : 10.1111/cgf.13316.
Physics-based Reconstruction and Animation of Humans
A. E. Ichim / M. Pauly (Dir.)
Lausanne, EPFL, 2017.

Dynamic 3D Avatar Creation from Hand-held Video Input
A. E. Ichim; S. Bouaziz; M. Pauly
2015. SIGGRAPH 2015, Los Angeles, California, USA, August 9-13, 2015. DOI : 10.1145/2766974.

Realtime Performance-Based Facial Animation
T. Weise; S. Bouaziz; H. Li; M. Pauly
Acm Transactions On Graphics. 2011. Vol. 30, num. 4, p. 77. DOI : 10.1145/1964921.1964972.

Face/off: Live facial puppetry
T. Weise; H. Li; L. Van Gool; M. Pauly
2009. Computer Animation, Conference Proceedings, New Orleans, LA, United states, p. 7-16. DOI : 10.1145/1599470.1599472.
Online modeling for real-time facial animation
S. Bouaziz; M. Pauly
US2023024768; US11348299; EP3518184; US2020160582; US10586372; AU2014277220; CN110310349; EP3518184; CN105900144; US2019156549; EP3005302; US10192343; US2017301125; US9734617; US2016350958; CN105900144; US9378576; AU2014277220; EP3005302; US2014362091; WO2014195018.
2016.

Online Modeling For Realtime Facial Animation
S. Bouaziz; Y. Wang; M. Pauly
Acm Transactions On Graphics. 2013. Vol. 32, num. 4, p. 40. DOI : 10.1145/2461912.2461976.

Temporally Coherent Completion of Dynamic Shapes
H. Li; L. Luo; D. Vlasic; P. Peers; J. Popovic et al.
Acm Transactions On Graphics. 2012. Vol. 31, num. 1, p. 2. DOI : 10.1145/2077341.2077343.

Global correspondence optimization for non-rigid registration of depth scans
H. Li; R. W. Sumner; M. Pauly
Computer Graphics Forum. 2008. Vol. 27, num. 5, p. 1421-1430. DOI : 10.1111/j.1467-8659.2008.01282.x.
Robust single-view geometry and motion reconstruction
H. Li; B. Adams; L. J. Guibas; M. Pauly
2009. ACM Transactions on Graphics, Yokohama, Japan, p. 175:1-175:10. DOI : 10.1145/1661412.1618521.