基于LBP-MDCT和CNN的人脸活体检测算法

doi:10.3969/j.issn.0255-8297.2019.05.003

应用科学学报 ›› 2019, Vol. 37 ›› Issue (5): 609-617.doi: 10.3969/j.issn.0255-8297.2019.05.003

基于LBP-MDCT和CNN的人脸活体检测算法

刘伟, 章琬苓, 项世军

暨南大学信息科学技术学院, 广州 510632

收稿日期:2019-09-04 修回日期:2019-09-09 出版日期:2019-09-30 发布日期:2019-10-18
通信作者: 项世军,教授,研究方向:多媒体信息安全,E-mail:shijun_xiang@qq.com E-mail:shijun_xiang@qq.com
基金资助:
国家自然科学基金面上项目（No.61772234）；2018年广东大学生科技创新培育专项资金项目（No.pdjhb0061）资助

Face Anti-spoofing Based on LBP, Multilayer DCT and CNN

LIU Wei, ZHANG Wanling, XIANG Shijun

School of Information Science and Technology, Jinan University, Guangzhou 510632, China

Received:2019-09-04 Revised:2019-09-09 Online:2019-09-30 Published:2019-10-18

摘要/Abstract

摘要： 人脸活体检测技术作为人脸识别系统安全运行的重要保障，对保障网络空间安全意义重大．针对基于视频的人脸欺骗攻击，提出一种基于局部二值模式-多层离散余弦变换（local binary pattern and multilayer discrete cosine transform，LBP-MDCT）和卷积神经网络（convolutional neural network，CNN）融合的人脸活体检测算法．首先从检测视频中提取人脸图像；接着对人脸图像进行LBP和多层DCT变换以得到LBP-MDC T特征，将部分人脸图像输入CNN中以得到CNN特征；然后将两种特征分别输入到支持向量机（supportvector machine，SVM）中得到分类结果；最后将SVM的输出进行决策级融合以判定检测视频的合法性．在Replay-Attack和CASIA-FASD数据库上的实验结果表明，相对于现有算法，该算法的检测性能更加优越.

关键词: 人脸活体检测, 局部二值模式, 多层离散余弦变换, 卷积神经网络, 决策级融合

Abstract: In applications of cyberspace security, face liveness detection is significant for face recognition systems. In this paper, an innovative face anti-spoofing algorithm against video-based face spoofing attacks is proposed based on local binary patterns and multilayer discrete cosine transform (LBP-MDCT) and convolutional neural network (CNN). First, we first extract face images from a target video, generate LBP features for each extracted face image and perform multilayer DCT onto the features to obtain LBP-MDCT features. Second, we input part of face images into CNN to obtain CNN features. After that, the two types of features are respectively input into support vector machine (SVM) classifier. In the last stage, the SVM output is fused with a decision-level operation to determine whether the target video is a spoof attack or a valid access. Compared with existing algorithms, the experimental results on two benchmarking datasets (Replay-Attack dataset and CASIAFASD dataset) demonstrate the excellent effectiveness of the proposed method.

Key words: face anti-spoofing, local binary pattern (LBP), multilayer discrete Cosine transform (DCT), convolutional neural network (CNN), decision-level fusion

中图分类号:

TP391

刘伟, 章琬苓, 项世军. 基于LBP-MDCT和CNN的人脸活体检测算法[J]. 应用科学学报, 2019, 37(5): 609-617.

LIU Wei, ZHANG Wanling, XIANG Shijun. Face Anti-spoofing Based on LBP, Multilayer DCT and CNN[J]. Journal of Applied Sciences, 2019, 37(5): 609-617.

参考文献

[1] Souza L, Oliveira L, Pamplona M, et al. How far did we get in face spoofing detection?[J]. Engineering Applications of Artificial Intelligence, 2018, 72:368-381.
[2] Zhao W Y, Chellappa R, Phillips P J, et al. Face recognition:a literature survey[J]. ACM Computing Surveys, 2003, 35(4):399-458.
[3] Feng L T, Po L M, Li Y M, et al. Integration of image quality and motion cues for face anti-spoofing:a neural network approach[J]. Journal of Visual Communication and Image Representation, 2016, 38:451-460.
[4] Dora L, Agrawal S, Panda R, et al. An evolutionary single Gabor kernel based filter approach to face recognition[J]. Engineering Applications of Artificial Intelligence, 2017, 62:286-301.
[5] Hasan H, Abdul-Kareem S. Fingerprint image enhancement and recognition algorithms:a survey[J]. Neural Computing and Applications, 2013, 23(6):1605-1610.
[6] Marasco E, Ross A. A survey on antispoofing schemes for fingerprint recognition systems[J]. ACM Computing Surveys, 2014, 47(28):1-36.
[7] Choi D J, Park J S, Oh Y H. Unsupervised rapid speaker adaptation based on selective eigenvoice merging for user-specific voice interaction[J]. Engineering Applications of Artificial Intelligence, 2015, 40:95-102.
[8] De L, Pucher M, Yamagishi J, et al. Evaluation of speaker verification security and detection of HMM-based synthetic speech[J]. IEEE Transactions on Audio, Speech, and Language Processing, 2012, 20(8):2280-2290.
[9] Ma L, Tan T N, Wang Y L, et al. Personal identification based on iris texture analysis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2003, 25(12):1519-1533.
[10] Wang L, Tan T, Ning H, et al. Silhouette analysis-based gait recognition for human identification[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2003, 25(12):1505-1518.
[11] 杨健伟. 面向人脸识别的人脸活体检测方法研究[D]. 北京:北京邮电大学,2014.
[12] 孙霖. 人脸识别中的活体检测技术研究[D]. 浙江:浙江大学,2010
[13] Pinto A, Schwartz W R, Pedrini H, et al. Using visual rhythms for detecting video-based facial spoof attacks[J]. IEEE Transactions on Information Forensics and Security, 2015, 10(5):1025-1038
[14] 田野,项世军. 基于LBP和多层DCT的人脸活体检测算法[J]. 计算机研究与发展,2018, 55(3):643-650. Tian Y, Xiang S J. LBP and multilayer DCT based anti-spoofing countermeasure in face liveness detection[J]. Journal of Computer Research and Development, 2018, 55(3):643-650. (in Chinese)
[15] Yang J, Lei Z, Li S Z. Learn convolutional neural network for face anti-spoofing[DB/OL]. 2014[2014-08-24]. arXiv:1408.5601.
[16] Määttä J, Hadid A, Pietikäinen M. Face spoofing detection from single images using microtexture analysis[C]//International Joint Conference on Biometrics. IEEE, 2011:1-7.
[17] Chingovska I, Anjos A, Marcel S. On the effectiveness of local binary patterns in face anti-spoofing[C]//BIOSIG-Proceedings of the International Conference of Biometrics Special Interest Group. IEEE, 2012:1-7.
[18] Määttä J, Hadid A, PietikäInen M. Face spoofing detection from single images using texture and local shape analysis[J]. IET Biometrics, 2012, 1(1):3-10
[19] Yang J W, Lei Z, Liao S C, et al. Face liveness detection with component dependent descriptor[C]//2013 International Conference on Biometrics. IEEE, 2013:1-6.
[20] Zhang Z W, Yan J J, Liu S F, et al. A face antispoofing database with diverse attacks[C]//20125th IAPR International Conference on Biometrics. IEEE, 2012:26-31.
[21] Patel K, Han H, Jain A K. Secure face unlock:spoof detection on smartphones[J]. IEEE Transactions on Information Forensics and Security, 2016, 11(10):2268-2283.
[22] Boulkenafet Z, Komulainen J, Hadid A. Face antispoofing using speeded-up robust features and fisher vector encoding[J]. IEEE Signal Processing Letters, 2017, 24(1):141-145.
[23] Pereira T D F, André A, José M D M, et al. LBP-TOP based countermeasure against face spoofing attacks[C]//Asian Conference on Computer Vision. Springer, 2012:121-132.
[24] Tirunagari S, Poh N, Windridge D, et al. Detection of face spoofing using visual dynamics[J]. IEEE Transactions on Information Forensics and Security, 2015, 10(4):762-777.
[25] Xu Z Q, Li S, Deng W H. Learning temporal features using LSTM-CNN architecture for face anti-spoofing[C]//20153rd IAPR Asian Conference on Pattern Recognition. IEEE, 2015:141-145.
[26] Atoum Y, Liu Y, Jourabloo A, et al. Face anti-spoofing using patch and depth-based CNNs[C]//2017 IEEE International Joint Conference on Biometrics. IEEE, 2017:319-328.
[27] Asim M, Ming Z, Javed M Y. CNN based spatio-temporal feature extraction for face antispoofing[C]//20172nd International Conference on Image, Vision and Computing. IEEE, 2017:234-238.
[28] Zhang S F, Wang X B, Liu A J, et al. A dataset and benchmark for large-scale multi-modal face anti-spoofing[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019:919-928.
[29] Viola P, Jones M J. Robust real-time face detection[J]. International Journal of Computer Vision, 2004, 57(2):137-154
[30] Cortes C, Vapnik V. Support-vector networks[J]. Machine Learning, 1995, 20(3):273-297
[31] Yang J, Yang J Y, Zhang D, et al. Feature fusion:parallel strategy vs. serial strategy[J]. Pattern Recognition, 2003, 36(6):1369-1381.

基于LBP-MDCT和CNN的人脸活体检测算法

Face Anti-spoofing Based on LBP, Multilayer DCT and CNN

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 11

编辑推荐

Metrics

本文评价

[1]	王孟轩, 张胜, 王月, 雷霆, 杜渂. 改进的CRNN模型在警情文本分类中的研究与应用[J]. 应用科学学报, 2020, 38(3): 388-400.
[2]	马鑫, 吴云, 鹿泽光. 基于混合神经网络的协同过滤推荐模型[J]. 应用科学学报, 2020, 38(3): 478-487.
[3]	王灿军, 廖鑫, 陈嘉欣, 秦拯, 刘绪崇. 基于卷积神经网络的面部图像修饰检测[J]. 应用科学学报, 2019, 37(5): 618-630.
[4]	吴韵清, 吴鹏, 陈北京, 鞠兴旺, 高野. 基于残差全卷积网络的图像拼接定位算法[J]. 应用科学学报, 2019, 37(5): 651-662.
[5]	靳华中, 刘潇龙, 胡梓珂. 一种结合全局和局部特征的图像描述生成模型[J]. 应用科学学报, 2019, 37(4): 501-509.
[6]	赵云山, 段友祥. 基于Attention机制的卷积神经网络文本分类模型[J]. 应用科学学报, 2019, 37(4): 541-550.
[7]	曾润华, 张树群. 改进卷积神经网络的语音情感识别方法[J]. 应用科学学报, 2018, 36(5): 837-844.
[8]	杨滨, 张涛, 陈先意. 基于深度学习的图像局部模糊识别[J]. 应用科学学报, 2018, 36(2): 321-330.
[9]	史晓裕, 李斌, 谭舜泉. 深度学习空域隐写分析的预处理层[J]. 应用科学学报, 2018, 36(2): 309-320.
[10]	董伟, 王建军. 改进的卷积神经网络用于对比度增强取证[J]. 应用科学学报, 2017, 35(6): 745-753.
[11]	丁友东1，庞海波2,3，吴学纯2，魏小成2. 一种用于手势识别的局部均值模式纹理描述子[J]. 应用科学学报, 2013, 31(5): 526-532.