Human Modeling

Performance capture is about bringing digital characters to life by capturing the geometry and motion of real human performances.
Our research covers the full pipeline for data-driven modeling and animation of virtual avatars, which includes real-time markerless acquisition, tracking in non-rigid partial data, deformable shape completion, motion-retargeting, and automatic character rigging.

Publications

Real-Time Generative Hand Modeling and Tracking

A. Tkach / M. Pauly; A. Tagliasacchi (Dir.)  

Lausanne, EPFL, 2018. 

publication thumbnail

Online Generative Model Personalization for Hand Tracking

A. Tkach; A. Tagliasacchi; E. Remelli; M. Pauly; A. Fitzgibbon 

2017. 10th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia, Bangkok, THAILAND, NOV 27-30, 2017. p. 243. DOI : 10.1145/3130800.3130830.

publication thumbnail

Low-Dimensionality Calibration through Local Anisotropic Scaling for Robust Hand Model Personalization

E. Remelli; A. Tkach; A. Tagliasacchi; M. Pauly 

2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy, Octobre 22-29, 2017.

publication thumbnail

Sphere-Meshes for Real-Time Hand Modeling and Tracking

A. Tkach; M. Pauly; A. Tagliasacchi 

2016. ACM SIGGRAPH Asia Conference. p. 222. DOI : 10.1145/2980179.2980226.

publication thumbnail

Robust Articulated-ICP for Real-Time Hand Tracking

A. Tagliasacchi; M. Schroeder; A. Tkach; S. Bouaziz; M. Botsch et al. 

Computer Graphics Forum. 2015. Vol. 34, num. 5, p. 101-114. DOI : 10.1111/cgf.12700.

Temporally Consistent Motion Segmentation From RGB-D Video

P. Bertholet; A. Ichim; M. Zwicker 

COMPUTER GRAPHICS FORUM. 2018. Vol. 37, num. 6, p. 118-134. DOI : 10.1111/cgf.13316.

publication thumbnail

Reconstructing Personalized Anatomical Models for Physics-based Body Animation

P. Kadlecek; A-E. Ichim; T. Liu; J. Krivanek; L. Kavan 

2016. ACM SIGGRAPH Asia Conference. p. 213. DOI : 10.1145/2980179.2982438.

Physics-based Reconstruction and Animation of Humans

A. E. Ichim / M. Pauly (Dir.)  

Lausanne, EPFL, 2017. 

publication thumbnail

Dynamic 3D Avatar Creation from Hand-held Video Input

A. E. Ichim; S. Bouaziz; M. Pauly 

2015. SIGGRAPH 2015, Los Angeles, California, USA, August 9-13, 2015. DOI : 10.1145/2766974.

publication thumbnail

Phace: Physics-based Face Modeling and Animation

A. E. Ichim; P. Kadlecek; L. Kavan; M. Pauly 

Acm Transactions On Graphics. 2017. Vol. 36, num. 4, p. 153. DOI : 10.1145/3072959.3073664.

publication thumbnail

Realtime Performance-Based Facial Animation

T. Weise; S. Bouaziz; H. Li; M. Pauly 

Acm Transactions On Graphics. 2011. Vol. 30, num. 4, p. 77. DOI : 10.1145/1964921.1964972.

publication thumbnail

Example-Based Facial Rigging

H. Li; T. Weise; M. Pauly 

2010.  p. 32. DOI : 10.1145/1833349.1778769.

publication thumbnail

Face/off: Live facial puppetry

T. Weise; H. Li; L. Van Gool; M. Pauly 

2009. Computer Animation, Conference Proceedings, New Orleans, LA, United states, p. 7-16. DOI : 10.1145/1599470.1599472.

Semi-Supervised Facial Animation Retargeting

S. Bouaziz; M. Pauly 

2014

Realtime Face Tracking and Animation

S. Bouaziz / M. Pauly (Dir.)  

Lausanne, EPFL, 2015. 

Online modeling for real-time facial animation

S. Bouaziz; M. Pauly 

CN110310349; US2023024768; US11348299; EP3518184; US2020160582; US10586372; AU2014277220; CN110310349; EP3518184; CN105900144; US2019156549; EP3005302; US10192343; US2017301125; US9734617; US2016350958; CN105900144; US9378576; AU2014277220; EP3005302; US2014362091; WO2014195018.

2016.

publication thumbnail

Online Modeling For Realtime Facial Animation

S. Bouaziz; Y. Wang; M. Pauly 

Acm Transactions On Graphics. 2013. Vol. 32, num. 4, p. 40. DOI : 10.1145/2461912.2461976.

publication thumbnail

Temporally Coherent Completion of Dynamic Shapes

H. Li; L. Luo; D. Vlasic; P. Peers; J. Popovic et al. 

Acm Transactions On Graphics. 2012. Vol. 31, num. 1, p. 2. DOI : 10.1145/2077341.2077343.

publication thumbnail

Global correspondence optimization for non-rigid registration of depth scans

H. Li; R. W. Sumner; M. Pauly 

Computer Graphics Forum. 2008. Vol. 27, num. 5, p. 1421-1430. DOI : 10.1111/j.1467-8659.2008.01282.x.

Robust single-view geometry and motion reconstruction

H. Li; B. Adams; L. J. Guibas; M. Pauly 

2009. ACM Transactions on Graphics, Yokohama, Japan, p. 175:1-175:10. DOI : 10.1145/1661412.1618521.