基于样例的面部表情基生成
|
摘要
针对现有blendshape表情基的生成多依赖手工建模和微调的问题,提出一种基于样例的表情基自动生成方法。以一组通用的面部模型为先验模型,实现每个blendshape的表情语义逐步求精。通过该方法生成的blendshape表情基能够将通用模型的表情语义和表情动态映射到目标模型上,从而实现模型在应用上的可扩展性,使用户能够按照自身需求逐步计算出更为丰富的面部表情模型。实验结果表明,在梯度空间建立形变约束,并将其转化为一个关于blendshape的优化问题,能更加有效地控制blendshape表情基的变化趋势,并且计算时间更短,真实感更强。
To solve the problem of blendshapes generation mostly depending on manual modeling and fine-tuning,this paper proposes an automatic generation method about example-based expression blendshapes. Using a set of generic face models as the prior,it makes each generated blendshapes approach to its real semantics. Expression blendshapes generated by this method can map semantics and expression dynamics from the generic model to the target model. The method achieves model's scalability in application and enables users to gradually calculate more expression models according to their own needs. Experimental results show that the method,constructing a gradient space to optimize blendshapes,outperforms the state-of-the-art methods both in speed and reality.
To solve the problem of blendshapes generation mostly depending on manual modeling and fine-tuning,this paper proposes an automatic generation method about example-based expression blendshapes. Using a set of generic face models as the prior,it makes each generated blendshapes approach to its real semantics. Expression blendshapes generated by this method can map semantics and expression dynamics from the generic model to the target model. The method achieves model's scalability in application and enables users to gradually calculate more expression models according to their own needs. Experimental results show that the method,constructing a gradient space to optimize blendshapes,outperforms the state-of-the-art methods both in speed and reality.
引文
[1]Lewis J P,Mooser J,Deng Zhigang,et al.Reducing Blendshape Interference by Selected Motion Attenuation[C]//Proceedings of Symposium on Interactive3D Graphics and Games.Washington D.C.,USA:[s.n.],2005:25-29.
[2]Blanz V,Vetter T.A Morphable Model for the Synthesis of3d Faces[C]//Proceedings of the26th Annual Conference on Computer Graphics and Interactive Techniques.New York,USA:ACM Press,1999:187-194.
[3]Blanz V,Basso C,Poggio T,et al.Reanimating Faces in Images and Video[J].Computer Graphics Forum,2003,22(3):641-650.
[4]Vlasic D,Brand M,Pfister H,et al.Face Transfer with Multilinear Models[J].ACM Transactions on Graphics,2005,24(3):426-433.
[5]Weise T,Gool L V,Venue M P,et al.Face/off:Live Facial Puppetry[C]//Proceedings of Symposium on Computer Animation.[S.l.]:ACM Press,2009:7-16.
[6]Song Mingli,Zhao Dong,Theobalt C,et al.A Generic Framework for Efficient2-D and3-D Facial Expression Analogy[J].IEEE Transactions on Multimedia,2007,9(7):1384-1395.
[7]黄晓钦,林裕旭,宋明黎,等.非线性联合学习的三维人脸表情合成方法[J].计算机辅助设计与图形学学报,2011,23(2):363-370.
[8]Sumner R W,Popovic'J.Deformation Transfer for Triangle Meshes[J].ACM Transactions on Graphics,2004,23(3):399-405.
[9]Liu Xuecheng,Mao Tianlu,Xia Shihong,et al.Facial Animation by Optimized Blendshapes from Motion Capture Data[J].Computer Animation and Virtual Worlds,2008,19(3-4):235-245.
[10]Coleman T F,Li Yuying.An Interior Trust Region Approach for Nonlinear Minimization Subject to Bounds[J].SIAM Journal on Optimization,1996,6(2):418-445.
[11]Li Hao,Adams B,Guibas L J,et al.Robust Single-view Geometry and Motion Reconstruction[J].ACM Transactions on Graphics,2009,28(5).
[12]马昌凤.最优化方法及其Matlab程序设计[M].北京:科学出版社,2010:166-178.
[2]Blanz V,Vetter T.A Morphable Model for the Synthesis of3d Faces[C]//Proceedings of the26th Annual Conference on Computer Graphics and Interactive Techniques.New York,USA:ACM Press,1999:187-194.
[3]Blanz V,Basso C,Poggio T,et al.Reanimating Faces in Images and Video[J].Computer Graphics Forum,2003,22(3):641-650.
[4]Vlasic D,Brand M,Pfister H,et al.Face Transfer with Multilinear Models[J].ACM Transactions on Graphics,2005,24(3):426-433.
[5]Weise T,Gool L V,Venue M P,et al.Face/off:Live Facial Puppetry[C]//Proceedings of Symposium on Computer Animation.[S.l.]:ACM Press,2009:7-16.
[6]Song Mingli,Zhao Dong,Theobalt C,et al.A Generic Framework for Efficient2-D and3-D Facial Expression Analogy[J].IEEE Transactions on Multimedia,2007,9(7):1384-1395.
[7]黄晓钦,林裕旭,宋明黎,等.非线性联合学习的三维人脸表情合成方法[J].计算机辅助设计与图形学学报,2011,23(2):363-370.
[8]Sumner R W,Popovic'J.Deformation Transfer for Triangle Meshes[J].ACM Transactions on Graphics,2004,23(3):399-405.
[9]Liu Xuecheng,Mao Tianlu,Xia Shihong,et al.Facial Animation by Optimized Blendshapes from Motion Capture Data[J].Computer Animation and Virtual Worlds,2008,19(3-4):235-245.
[10]Coleman T F,Li Yuying.An Interior Trust Region Approach for Nonlinear Minimization Subject to Bounds[J].SIAM Journal on Optimization,1996,6(2):418-445.
[11]Li Hao,Adams B,Guibas L J,et al.Robust Single-view Geometry and Motion Reconstruction[J].ACM Transactions on Graphics,2009,28(5).
[12]马昌凤.最优化方法及其Matlab程序设计[M].北京:科学出版社,2010:166-178.