Facial Performance Capture by Embedded Photo Reflective Sensors on A Smart Eyewear
Nao Asano, Katsutoshi Masai, Yuta Sugiura, Maki Sugimoto
(This work is to be presented at ICAT-EGVE 2017)
Facial performance capture is used for animation production that projects a performer’s facial expression to a computer graphics model. Retro-reflective markers and cameras are widely used for the performance capture. To capture expressions, we need to place markers on the performer’s face and calibrate the intrinsic and extrinsic parameters of cameras in advance. However, the measurable space is limited to the calibrated area. In this paper, we propose a system to capture facial performance using a smart eyewear with photo reflective sensors and machine learning technique.
Paper and Video
A pre-print of the publication: PDF.
Demonstration of our method:
Nao Asano, Katsutoshi Masai, Yuta Sugiura, Maki Sugimoto, Facial Performance Capture by Embedded Photo Reflective Sensors on A Smart Eyewear, ICAT 2017. (Accepted).