Facial Performance Capture by Embedded Photo Reflective Sensors on A Smart Eyewear
Nao Asano, Katsutoshi Masai, Yuta Sugiura, Maki Sugimoto
(This work is to be presented at ICAT-EGVE 2017)
Abstract
Facial performance capture is used for animation production that projects a performer’s facial expression to a computer graphics model. Retro-reflective markers and cameras are widely used for the performance capture. To capture expressions, we need to place markers on the performer’s face and calibrate the intrinsic and extrinsic parameters of cameras in advance. However, the measurable space is limited to the calibrated area. In this paper, we propose a system to capture facial performance using a smart eyewear with photo reflective sensors and machine learning technique.
Paper and Video
A pre-print of the publication: PDF.
Demonstration of our method:
Publications
浅野直生，正井克俊，杉浦裕太，杉本麻樹，反射型光センサを用いた眼鏡型ウェアラブルデバイスによる顔表情パフォーマンスキャプチャ，第22回日本バーチャルリアリティ学会大会論文集，2017．
Nao Asano, Katsutoshi Masai, Yuta Sugiura, Maki Sugimoto, Facial Performance Capture by Embedded Photo Reflective Sensors on A Smart Eyewear, ICAT 2017. (Accepted).