人脸肤色检测与编辑
|
摘要
可靠而准确的提取脸部皮肤是皮肤检测中关键而又紧迫的问题,为了解决这一问题,提出一种结合人脸对齐技术和高斯混合模型GMM(Gaussian mixture Model)来实现人脸皮肤检测。利用SCUT-FBP5500人脸数据库,利用SOM(Self-organizing Maps)与Kmeans结合的聚类方法对其中9对人脸脸型特征进行聚类处理,利用ResNet50进行人脸颜值打分预测,利用基于Lab空间的颜色移植算法对人脸肤色进行迁移编辑操作,事实证明方法是有一定效果的。
The reliable and accurate extraction of facial skin is a key and urgent problem for skin detection. This paper proposes a face alignment and GMM(Gaussian mixture model) to achieve face skin detection. We use the SCUT-FBP5500 face database, combined with SOM(self-organizing Maps) and K-means clustering method to cluster 9 pairs of facial features, and then use ResNet50 to predict face score. The color migration algorithm based on Lab space is used to migrate and edit the face color.The facts prove that the method has certain effect.
The reliable and accurate extraction of facial skin is a key and urgent problem for skin detection. This paper proposes a face alignment and GMM(Gaussian mixture model) to achieve face skin detection. We use the SCUT-FBP5500 face database, combined with SOM(self-organizing Maps) and K-means clustering method to cluster 9 pairs of facial features, and then use ResNet50 to predict face score. The color migration algorithm based on Lab space is used to migrate and edit the face color.The facts prove that the method has certain effect.
引文
[1]Hu W,Wu O,Chen Z,et al.Recognition of Pornographic Web Pages by Classifying Texts and Images[J].IEEE Transactions on Pattern Analysis and Machine Intelligence(S0162-8828),2007,29(6):1019-1034.
[2]Kakumanu P,Makrogiannis S,Bourbakis N.A survey of skin-color modeling and detection methods[J].Pattern Recognition(S0031-3203),2007,40(3):1106-1122.
[3]Lee J S,Kuo Y M,Chung P C,et al.Naked image detection based on adaptive and extensible skin color model[J].Pattern Recognition(S0031-3203),2007,40(8):2261-2270.
[4]Devi M S,Bajaj P R.Driver Fatigue Detection Based on Eye Tracking[C]//International Conference on Emerging Trends in Engineering and Technology.Nagpur,Maharashtra,India:IEEE,2008:S453-S463.
[5]Chai D,Phung S L,Bouzerdoum A.Skin color detection for face localization in human-machine communications[C]//Signal Processing and ITS Applications,Sixth International,Symposium on.IEEE.Kuala Lumpur,Malaysia,2001:343-346.
[6]Jaimes A,Sebe N.Multimodal human computer interaction:a survey[C]//International Conference on Computer Vision in Human-Computer Interaction.Beijing,China:Springer-Verlag,2005:1-15.
[7]Herland M,Khoshgoftaar T M,Wald R.Survey of Clinical Data Mining Applications on Big Data in Health Informatics[C]//International Conference on Machine Learning and Applications.Copenhagen,Denmark:IEEE,2014:465-472.
[8]Mahmoodi M R,Sayedi S M.A Comprehensive Survey on Human Skin Detection[J].International Journal of Image Graphics&Signal Processing(S2074-9074),2016,8(5):1-35.
[9]Jones M J,Rehg J M.Statistical color models with application to skin detection[M].New York:Kluwer Academic Publishers,2002.
[10]Khan R,Hanbury A,Ttinger J,et al.Color based skin classification[J].Pattern Recognition Letters(S0167-8655),2012,33(2):157-163.
[11]Chaves-González J M,Vega-Rodríguez M A,Gómez-Pulido J A,et al.Detecting skin in face recognition systems:A colour spaces study[J].Digital Signal Processing(S1051-2004),2010,20(3):806-823.
[12]Muhammad B,Abu-Bakar S A R.A hybrid skin color detection using HSV and YCgCr color space for face detection[C]//IEEE International Conference on Signal and Image Processing Applications.Kuala Lumpur:IEEE,2016:95-98.
[13]Villagra A,Leguizamón G,Alba E.Active components of metaheuristics in cellular genetic algorithms[J].Soft Computing(S1432-7643),2015,19(5):1-15.
[14]Osman M Z,Maarof M A,Rohani M F.Towards Integrating Statistical Color Features for Human Skin Detection[C]//International Conference on Engineering and Applied Sciences.Hong Kong,China:IEEE,2016.
[15]Al-Mohair H K,Mohamad Saleh J,Suandi S A.Hybrid Human Skin Detection Using Neural Network and Kmeans Clustering Technique[J].Applied Soft Computing(S1568-4946),2015,33(C):337-347.
[16]Kawulok M,Kawulok J,Nalepa J.Spatial-based skin detection using discriminative skin-presence features[J].Pattern Recognition Letters(S0167-8655),2014,41(C):3-13.
[17]Lin L,Goodrich M A.Hierarchical Heuristic Search Using a Gaussian Mixture Model for UAV Coverage Planning[J].IEEE Transactions on Systems,Man,and Cybernetics(S0018-9472),2014,44(12):2532-2544.
[18]Zhu Q,Cheng K T,Wu C T.A unified adaptive approach to accurate skin detection[C]//International Conference on Image Processing.Singapore,Singapore:IEEE,2004,2:1189-1192.
[19]Bhoyar K K,Kakde O G.Skin Color Detection Model Using Neural Networks and its Performance Evaluation[J].Journal of Computer Science(S1549-3636),2010,6(9):955-960.
[20]Khan R,Hanbury A,Stoettinger J.Skin detection:Arandom forest approach[C]//IEEE International Conference on Image Processing.Hong Kong,China:IEEE,2010:4613-4616.
[21]Reinhard E,Ashikhmin M,Gooch B,et al.Color Transfer between Images[J].IEEE Computer Graphics&Applications(S0272-1716),2002,21(5):34-41.
[22]Welsh T,Ashikhmin M,Mueller K.Transferring color to greyscale images[J].Acm Trans Graphics(S0730-0301),2002,21(3):277-280.
[23]Widrow B,Rumelhart D E,Lehr M A.Neural networks:applications in industry,business and science[J].Communications of the Acm(S0001-0782),1994,37(3):93-105.
[24]Chang C H,Xu P,Xiao R,et al.New adaptive color quantization method based on self-organizing maps[J].IEEE Transactions on Neural Networks(S1045-9227),2005,16(1):237-249.
[25]Fayyad U M,Reina C A,Bradley P S.Initialization of Iterative Refinement Clustering Algorithms[C]//knowledge discovery and data mining.New York.KDD.1998:194-198.
[26]Zhang D,Chen F,Xu Y.Computer Models for Facial Beauty Analysis[M].Springer:Springer Publishing Company,Incorporated,2016.
[27]Liu Luoqi,Xu Hui,Liu Si,et al."Wow!you are so beautiful today!"[C]//ACM International Conference on Multimedia.New York:ACM,2013:437-438.
[28]Perronnin F,Marchesotti L,Murray N.AVA:Alarge-scale database for aesthetic visual analysis[C]//IEEE Conference on Computer Vision and Pattern Recognition.Providence,RI:IEEE Computer Society,2012:2408-2415.
[29]Liang L,Jin L,Li X.Facial Skin Beautification Using Adaptive Region-Aware Masks[J].IEEE Transactions on Cybernetics(S2168-2267),2017,44(12):2600-2612.
[30]Liang L,Jin L,Zhang X,et al.Multiple Facial Image Editing Using Edge-Aware PDE Learning[J].Computer Graphics Forum(S0167-7055),2015,34(7):203-212.
[31]Zhou E,Fan H,Cao Z,et al.Extensive Facial Landmark Localization with Coarse-to-Fine Convolutional Network Cascade[C]//IEEE International Conference on Computer Vision Workshops.Sydney,NSW:IEEEComputer Society,2013:386-391.
[32]Liang L,Lin L,Jin L,et al.SCUT-FBP5500:A diverse benchmark dataset for multi-paradigm facial beauty prediction[C]//2018 24th International Conference on Pattern Recognition(ICPR).Beijing,China:IEEE,2018:1598-1603.
[33]Xie D,Liang L,Jin L,et al.SCUT-FBP:A benchmark dataset for facial beauty perception[C]//2015 IEEEInternational Conference on Systems,Man,and=Cybernetics.Kowloon:IEEE,2015:1821-1826.
[2]Kakumanu P,Makrogiannis S,Bourbakis N.A survey of skin-color modeling and detection methods[J].Pattern Recognition(S0031-3203),2007,40(3):1106-1122.
[3]Lee J S,Kuo Y M,Chung P C,et al.Naked image detection based on adaptive and extensible skin color model[J].Pattern Recognition(S0031-3203),2007,40(8):2261-2270.
[4]Devi M S,Bajaj P R.Driver Fatigue Detection Based on Eye Tracking[C]//International Conference on Emerging Trends in Engineering and Technology.Nagpur,Maharashtra,India:IEEE,2008:S453-S463.
[5]Chai D,Phung S L,Bouzerdoum A.Skin color detection for face localization in human-machine communications[C]//Signal Processing and ITS Applications,Sixth International,Symposium on.IEEE.Kuala Lumpur,Malaysia,2001:343-346.
[6]Jaimes A,Sebe N.Multimodal human computer interaction:a survey[C]//International Conference on Computer Vision in Human-Computer Interaction.Beijing,China:Springer-Verlag,2005:1-15.
[7]Herland M,Khoshgoftaar T M,Wald R.Survey of Clinical Data Mining Applications on Big Data in Health Informatics[C]//International Conference on Machine Learning and Applications.Copenhagen,Denmark:IEEE,2014:465-472.
[8]Mahmoodi M R,Sayedi S M.A Comprehensive Survey on Human Skin Detection[J].International Journal of Image Graphics&Signal Processing(S2074-9074),2016,8(5):1-35.
[9]Jones M J,Rehg J M.Statistical color models with application to skin detection[M].New York:Kluwer Academic Publishers,2002.
[10]Khan R,Hanbury A,Ttinger J,et al.Color based skin classification[J].Pattern Recognition Letters(S0167-8655),2012,33(2):157-163.
[11]Chaves-González J M,Vega-Rodríguez M A,Gómez-Pulido J A,et al.Detecting skin in face recognition systems:A colour spaces study[J].Digital Signal Processing(S1051-2004),2010,20(3):806-823.
[12]Muhammad B,Abu-Bakar S A R.A hybrid skin color detection using HSV and YCgCr color space for face detection[C]//IEEE International Conference on Signal and Image Processing Applications.Kuala Lumpur:IEEE,2016:95-98.
[13]Villagra A,Leguizamón G,Alba E.Active components of metaheuristics in cellular genetic algorithms[J].Soft Computing(S1432-7643),2015,19(5):1-15.
[14]Osman M Z,Maarof M A,Rohani M F.Towards Integrating Statistical Color Features for Human Skin Detection[C]//International Conference on Engineering and Applied Sciences.Hong Kong,China:IEEE,2016.
[15]Al-Mohair H K,Mohamad Saleh J,Suandi S A.Hybrid Human Skin Detection Using Neural Network and Kmeans Clustering Technique[J].Applied Soft Computing(S1568-4946),2015,33(C):337-347.
[16]Kawulok M,Kawulok J,Nalepa J.Spatial-based skin detection using discriminative skin-presence features[J].Pattern Recognition Letters(S0167-8655),2014,41(C):3-13.
[17]Lin L,Goodrich M A.Hierarchical Heuristic Search Using a Gaussian Mixture Model for UAV Coverage Planning[J].IEEE Transactions on Systems,Man,and Cybernetics(S0018-9472),2014,44(12):2532-2544.
[18]Zhu Q,Cheng K T,Wu C T.A unified adaptive approach to accurate skin detection[C]//International Conference on Image Processing.Singapore,Singapore:IEEE,2004,2:1189-1192.
[19]Bhoyar K K,Kakde O G.Skin Color Detection Model Using Neural Networks and its Performance Evaluation[J].Journal of Computer Science(S1549-3636),2010,6(9):955-960.
[20]Khan R,Hanbury A,Stoettinger J.Skin detection:Arandom forest approach[C]//IEEE International Conference on Image Processing.Hong Kong,China:IEEE,2010:4613-4616.
[21]Reinhard E,Ashikhmin M,Gooch B,et al.Color Transfer between Images[J].IEEE Computer Graphics&Applications(S0272-1716),2002,21(5):34-41.
[22]Welsh T,Ashikhmin M,Mueller K.Transferring color to greyscale images[J].Acm Trans Graphics(S0730-0301),2002,21(3):277-280.
[23]Widrow B,Rumelhart D E,Lehr M A.Neural networks:applications in industry,business and science[J].Communications of the Acm(S0001-0782),1994,37(3):93-105.
[24]Chang C H,Xu P,Xiao R,et al.New adaptive color quantization method based on self-organizing maps[J].IEEE Transactions on Neural Networks(S1045-9227),2005,16(1):237-249.
[25]Fayyad U M,Reina C A,Bradley P S.Initialization of Iterative Refinement Clustering Algorithms[C]//knowledge discovery and data mining.New York.KDD.1998:194-198.
[26]Zhang D,Chen F,Xu Y.Computer Models for Facial Beauty Analysis[M].Springer:Springer Publishing Company,Incorporated,2016.
[27]Liu Luoqi,Xu Hui,Liu Si,et al."Wow!you are so beautiful today!"[C]//ACM International Conference on Multimedia.New York:ACM,2013:437-438.
[28]Perronnin F,Marchesotti L,Murray N.AVA:Alarge-scale database for aesthetic visual analysis[C]//IEEE Conference on Computer Vision and Pattern Recognition.Providence,RI:IEEE Computer Society,2012:2408-2415.
[29]Liang L,Jin L,Li X.Facial Skin Beautification Using Adaptive Region-Aware Masks[J].IEEE Transactions on Cybernetics(S2168-2267),2017,44(12):2600-2612.
[30]Liang L,Jin L,Zhang X,et al.Multiple Facial Image Editing Using Edge-Aware PDE Learning[J].Computer Graphics Forum(S0167-7055),2015,34(7):203-212.
[31]Zhou E,Fan H,Cao Z,et al.Extensive Facial Landmark Localization with Coarse-to-Fine Convolutional Network Cascade[C]//IEEE International Conference on Computer Vision Workshops.Sydney,NSW:IEEEComputer Society,2013:386-391.
[32]Liang L,Lin L,Jin L,et al.SCUT-FBP5500:A diverse benchmark dataset for multi-paradigm facial beauty prediction[C]//2018 24th International Conference on Pattern Recognition(ICPR).Beijing,China:IEEE,2018:1598-1603.
[33]Xie D,Liang L,Jin L,et al.SCUT-FBP:A benchmark dataset for facial beauty perception[C]//2015 IEEEInternational Conference on Systems,Man,and=Cybernetics.Kowloon:IEEE,2015:1821-1826.