图像视频中ENF信号的分析及应用综述

doi:10.3969/j.issn.0255-8297.2019.05.001

Abstract

Abstract: Under the circumstance of alternate current (AC) electric field or around AC electrical equipment, multimedia recording equipment can capture the frequency fluctuation of electric networks simultaneously as it records video, image or audio programs. Electric network frequency (ENF) has the characteristics of real-time, continuity and consistency with surrounding electric networks, thus, the ENF information estimated from these multimedia files can be used for time stamping, information source detection, operation forensics, and media synchronization. In spite of different signal formats of ENF in audio, image and video programs, the detection and estimation methods of ENF are similar, and some processing methods are universal. Up to now, plenty of research works have been done on ENF in audio, but the works on ENF in image and video are far more behind. This paper presents a comprehensive review on the relevant researches, including characteristics, estimation and applications of ENF in images and videos. Firstly, the characteristics of ENF signal are explored by analyzing the processes of capturing images and videos. Then, the problems existing in the detection and estimation of ENF signal and corresponding solving approaches are summarized and analyzed. Finally, the applications of ENF in information forensics and the possible research directions in the future are discussed.

Key words: electric network frequency signal, video, signal estimation, information source detection, operation forensics, media synchronization, time stamp

CLC Number:

TP391.4

CUI Sanshuai, MAO Maoyu, LIN Xiaodan, KANG Xiangui. Survey on Analysis and Applications of Electric Network Frequency (ENF) Signals in Image and Video[J]. Journal of Applied Sciences, 2019, 37(5): 573-589.

References

[1] Koenig B E. Authentication of forensic audio recordings[J]. Journal of the Audio Engineering Society, 1990, 38(1/2):3-33.
[2] Grigoras C. Forensic analysis of the digital audio recordings-the electric network frequency criterion[J]. Forensic Science International, 2003, 136:368-369.
[3] Grigoras C. Digital audio recording analysis:the electric network frequency (ENF) criterion[J]. International Journal of Speech Language and the Law, 2005, 12(1):63-76.
[4] Grigoras C. Applications of ENF criterion in forensic audio, video, computer and telecommunication analysis[J]. Forensic Science International, 2007, 167(2/3):136-145.
[5] 曾春艳,王志锋,王静,等. 数字音频篡改被动检测研究综述[J]. 计算机工程与应用,2019, 55(2):1-11. Zeng C Y, Wang Z F, Wang J, et al. Survey of passive detection of digital audio tampering[J]. Computer Engineering and Applications, 2019, 55(2):1-11. (in Chinese).
[6] Hua G, Bi G, Thing V L L. On Practical issues of electric network frequency based audio forensics[J]. IEEE Access, 2017, 5:20640-20651.
[7] Garg R, Varna A L, Wu M. "Seeing" ENF:natural time stamp for digital video via optical sensing and signal processing[C]//Proceedings of the 19th ACM International Conference on Multimedia, 2011:23-32.
[8] Sigrist L, Egido I, Miguelez E L, et al. Sizing and controller setting of ultracapacitors for frequency stability enhancement of small isolated power systems[J]. IEEE Transactions on Power Systems, 2015, 30(4):2130-2138.
[9] 汤涌. 电力系统安全稳定综合防御体系框架[J]. 电网技术,2012, 36(8):1-5. Tang Y. Framework of comprehensive defense architecture for power system security and stability[J]. Power System Technology, 2012, 36(8):1-5. (in Chinese)
[10] 常烨骙,李卫东,巴宇,等. 基于运行安全的频率控制性能评价新方法[J]. 电工技术学报,2019, 34(6):1218-1229.Chang Y K, Li W D, Ba Y, et al. A new method for frequency control performance assessment on operation security[J]. Transactions of China Electrotechnical Society, 2019, 34(6):1218-1229. (in Chinese)
[11] 中华人民共和国国家质量监督检验检疫总局, 中国国家标准化管理委员会. GB/T 15945-2008:电能质量-电力系统频率偏差[S]. 北京:中国标准出版社.
[12] Viswanathan S, Li Y, Tan R. Natural time stamping using electrical power grid[C]//IEEE International Conference on Information Processing in Sensor Networks, 2017:269-270.
[13] Li Y, Tan R, Yau D K Y. Natural time stamping using power line electromagnetic radiation[C]//IEEE International Conference on Information Processing in Sensor Networks, 2017:55-66.
[14] Toadere F. Process simulation in digital camera system[J]. Proceedings of SPIE-The International Society for Optical Engineering, 2012, 8436:1-8.
[15] Chen J Q, Venkataraman K, Bakin D, et al. Digital camera imaging system simulation[J]. IEEE Transactions on Electron Devices, 2009, 56(11):2496-2505.
[16] 王世和,陈远金,刘彬. CCD与CMOS国内外技术发展综述[J]. 内燃机与配件, 2017(13):112-114. Wang S H, Chen Y J, Liu B. Summary of the development of CCD and CMOS technology at home and abroad[J]. Internal Combustion Engine & Parts, 2017(13):112-114. (in Chinese)
[17] 雷蕾,李红涛. 基于CCD与CMOS图像传感新技术的研究[J]. 科技创新导报,2010(14):4-5. Lei L, Li H T. Research on new technology of image sensing based on CCD and CMOS[J]. Science and Technology Innovation Herald, 2010(14):4-5. (in Chinese)
[18] Gu J, Hitomi Y, Mitsunaga T, et al. Coded rolling shutter photography:flexible space-time sampling[C]//Proceedings of IEEE International Conference on Computational Photography (ICCP), 2010:1-8.
[19] Hui S, Hajj-Ahmad A, Garg R, et al. Exploiting rolling shutter for ENF signal extraction from video[C]//Proceedings of IEEE International Conference on Image Processing (ICIP), 2014:5367-5371.
[20] Hui S, Hajj-Ahmad A, Wong C W, et al. ENF signal induced by power grid:a new modality for video synchronization[C]//Proceedings of the 2nd ACM International Workshop on Immersive Media Experiences, 2014:13-18.
[21] Garg R, Varna A L, Hajj-Ahmad A, et al. "Seeing" ENF:power-signature-based timestamp for digital multimedia via optical sensing and signal processing[J]. IEEE Transactions on Information Forensics and Security, 2013, 8(9):1417-1432.
[22] Schmidt R O. Multiple emitter location and signal parameter estimation[J]. IEEE Transactions on Antennas & Propagation, 1986, 34(3):276-280.
[23] Kailath T, Paulraj A, Roy R. ESPRIT-estimation of signal parameters via rotational invariance techniques[J]. IEEE Transactions on Acoustics Speech and Signal Processing, 1989, 37(7):984-995.
[24] Hajj-Ahmad A, Garg R, Wu M. Spectrum combining for ENF signal estimation[J]. IEEE Signal Processing Letters, 2013, 20(9):883-886.
[25] Su H, Hajj-Ahmad A, Wu M, et al. Exploring the use of ENF for multimedia synchronization[C]//Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2014:4613-4617.
[26] Hajj-Ahmad A, Berkovich A, Wu M. Exploiting power signatures for camera forensics[J]. IEEE Signal Processing Letters, 2016, 23(5):713-717.
[27] Vidyamol K, George E, Jo J P. Exploring electric network frequency for joint audio-visual synchronization and multimedia authentication[C]//Proceedings of International Conference on Intelligent Computing, Instrumentation and Control Technologies (ICICICT), 2017:240-246.
[28] Vatansever S, Dirik A E, Memon N. Detecting the presence of ENF signal in digital videos:a superpixel-based approach[J]. IEEE Signal Processing Letters, 2017, 24(10):1463-1467.
[29] Vatansever S, Dirik A E. The effect of light source on ENF based video forensics[J]. Journal of the University of Uluda, School of Engineeing, 2017, 22(1):53-64.
[30] Wong C W, Hajj-Ahmad A, Wu M. Invisible geo-location signature in a single image[C]//Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2018:1987-1991.
[31] Vatansever S, Dirik A E, Memon N. Analysis of rolling shutter effect on ENF-based video forensics[J]. IEEE Transactions on Information Forensics and Security, 2019, 14(9):2262-2275.
[32] Vatansever S, Dirik A E, Memon N. Factors affecting ENF based time-of-recording estimation for video[C]//Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2019:2497-2501.
[33] Choi J, Wong C. ENF signal extraction for rolling-shutter videos using periodic zero-padding[C]//IEEE International Conference on Acoustics, Speech and Signal Processing, 2019:2667-2671.
[34] Yao W, Zhao J, Till M J, et al. Source location identification of distribution-level electric network frequency signals at multiple geographic scales[J]. IEEE Access, 2017, 5:11166-11175.
[35] Hua G, Zhang Y, Goh J, Thing V L L. Audio authentication by exploring the absoluteerror-map of ENF signals[J]. IEEE Transactions on Information Forensics and Security, 2016, 11(5):1003-1016.

Survey on Analysis and Applications of Electric Network Frequency (ENF) Signals in Image and Video

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments

[1]	GAO Yifei, HU Yongjian, YU Zeqiong, LIN Yuyi, LIU Beibei. Evaluation and Comparison of Five Popular Fake Face Detection Networks [J]. Journal of Applied Sciences, 2019, 37(5): 590-608.
[2]	LI Songbin, YANG Jie, LIU Peng, WANG Lingrui. Steganalysis of Motion Vector-Based Steganography in H.264/AVC by Correlation Network Model [J]. Journal of Applied Sciences, 2019, 37(5): 663-672.
[3]	ZHANG Sen-yong, GAO Shu-li, CHEN Wei-gang. Implementation of Audio and Video Decoding and Synchronous Playback Based on Embedded Systems [J]. Journal of Applied Sciences, 2018, 36(3): 504-514.
[4]	LI Ji-cheng, HU Yong-jian, Al-Alas Mohammed, XIONG Yi-chun, WEN Dong-xia, REN Yuan-yuan, LIAO Guang-jun. Expansion of Video Forgery Detection Database and Validation of Its Effectiveness [J]. Journal of Applied Sciences, 2018, 36(2): 347-361.
[5]	YU Li-fang, ZHANG Zhen-zhen, YANG Xian, LI Zhao-hong. P Frame PU Partitioning Mode Based H.264 to HEVC Video Transcoding Detection [J]. Journal of Applied Sciences, 2018, 36(2): 278-286.
[6]	REN Shao-ying, YUAN Shi-jie, GAO Peng, LU Jian-feng, ZHANG Shan-qing, LI Li. Video Watermarking Robust Against Frame Operations Based on Hamming Code Correction [J]. Journal of Applied Sciences, 2016, 34(5): 585-597.
[7]	ZHANG Guo. Satellite Video Processing and Applications [J]. Journal of Applied Sciences, 2016, 34(4): 361-370.
[8]	WANG Yong-fang, WANG Yu-bing, SHI Ya-wen, LUO Li-dong, ZHANG Zhao-yang. Perceptually Adaptive Loop Filter Aimed at 3D-HEVC [J]. Journal of Applied Sciences, 2016, 34(2): 135-144.
[9]	HE Bei1, WANG Gui-jin1, SHEN Yong-ling2, LIAO Chao1, LIU Chun-hua2, LINXing-gan1. Real-Time Mosaicing for Aerial Videos Combined with Geographical Parameters [J]. Journal of Applied Sciences, 2012, 30(2): 151-157.
[10]	GAO Hao-lin, LI Bi-cheng, PENG Tian-qiang. Specific Person Detection in Video Stream Based on Robust Hash Signature [J]. Journal of Applied Sciences, 2011, 29(6): 619-625.
[11]	CHENG Ming-ming1, AN Ping1;2, WANG Ping1, ZHANG Zhao-yang1;2. Joint Calculation of Decoding Path for Random Access in Multi-view Video Coding [J]. Journal of Applied Sciences, 2011, 29(4): 405-409.
[12]	ZHANG Qiu-wen1, AN Ping1;2, ZHANG Yan1;3, ZHANG Zhao-yang1;2. Depth Map Coding Oriented to Virtual View Synthesis in FTV System [J]. Journal of Applied Sciences, 2011, 29(3): 299-307.
[13]	HAO Teng, YU Yi-biao. Robust Digital Watermarking for MPEG-4 Based on Low Density Parity Check Coding [J]. Journal of Applied Sciences, 2010, 28(3): 283-288.
[14]	GU Yi, HAN Jun. Video Restoration Using Exemplar-Based Inpainting [J]. Journal of Applied Sciences, 2010, 28(2): 163-169.
[15]	GUAN Ye-peng1;2. Three Dimension Localization of Non-wearable Pointing Arm [J]. Journal of Applied Sciences, 2009, 27(6): 580-585.