卫星视频处理与应用进展

doi:10.3969/j.issn.0255-8297.2016.04.001

摘要/Abstract

摘要：

视频卫星通过一定时间范围内对目标的连续成像，实现对热点区域和目标的动态实时监测，近年来已成为遥感卫星发展的一大热点.从视频卫星数据应用的角度出发，叙述视频卫星发展现状，分析卫星视频数据应用面临的主要挑战和成因.重点介绍卫星视频数据的几何辐射定标、视频稳像、超分辨率重建、运动目标检测与跟踪、三维重建等关键技术的现状和发展趋势.在此基础上总结卫星视频的主要应用领域，并对卫星视频数据处理与应用进行了展望.

关键词: 定标, 卫星视频, 三维重建, 稳像, 动目标检测

Abstract:

Video satellites acquire continuous images of targets in a certain time period to dynamically monitor areas of interest in real time. They have become a hot spot in remote sensing satellite development in recent years. In this paper, a survey is given on the development of video satellites and application perspectives of satellite video data. Major challenges facing satellite video are analyzed, focusing on geometric calibration, radiometric calibration, video stabilization, super resolution reconstruction, moving target detection and tracking, 3D reconstruction, and the development trend. Major application fields of satellite video and the future perspectives are discussed.

Key words: satellite video, calibration, stabilization, 3D reconstruction, moving target detection

中图分类号:

N911.73

张过. 卫星视频处理与应用进展[J]. 应用科学学报, 2016, 34(4): 361-370.

ZHANG Guo. Satellite Video Processing and Applications[J]. Journal of Applied Sciences, 2016, 34(4): 361-370.

参考文献

[1] 蒋永华. 国产线阵推扫光学卫星高频误差补偿方法研究[D]. 武汉:武汉大学, 2015.
[2] Valorge C, Meygret A, Lebegure L, Henry P, Bouillon A, Breton E, Gachet R, Leger D, Viallefont F. 40 years of experience with SPOT in-flight Calibration [C]//ISPRS International Workshop on Radiometric and Geometric Calibration, Gulfport, Mississippi, USA, 2003.
[3] Breton E, Bouillon A, Gachet R, Delussy F. Pre-fight and in-flight geometric calibration of SPOT5 HRG and HRS images [J]. International Archines of Photogrammetry Remote Sensing and Spatial Information Sciences, 2002, 34(1): 20-25.
[4] Bouillon A, Breton E, Delussy F, Gachet R. Spot5 HRG and HRS first in-flight geometric quality results[C]//International Symposium on Remote Sensing, International Society for Optics and Photonics, 2003: 212-223.
[5] Bouillon A, Breton E, Delussy F. Spot5 geometric image quality [C]//Proceedings of 2003 IEEE International Geoscience and Remote Sensing Symposium, Toulouse, France. 2003: 303-305.
[6] Dial G, Bowen H, Gerlach F, Grodecki J, Oleszczuk R. Ikonos satellite, imagery, and products [J]. Remote Sensing of Environment, 2003, 88(1): 23-36.
[7] Grodecki J, Lutes J. Ikonos geometric calibrations [C]//Proceedings of the ASPRS 2005 Annual Conference, Sowth Dakota, USA, 2005.
[8] Grodecki J, Dial G. Ikonos geometric accuracy validation [J]. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 2002, 34(1): 50-55.
[9] Grodecki J, Dial G. Ikonos geometric accuracy [C]//Proceedings of Joint Workshop of ISPRS Working Groups I/2, I/5 and IV/7 on High Resolution Mapping from Space, 2001, 4: 19-21.
[10] Tadono T, Shimada M, Watanabe M, Hashimoto T, Iwata T. Calibration and validation of PRISM onboard ALOS[J]. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 2004, 35(1): 13-18.
[11] Takaku J, Tadono T. Prism on-orbit geometric calibration and DSM performance [J]. IEEE Transactions on Geoscience and Remote Sensing, 2009, 47(12): 4060-4073.
[12] Tadono T, Shimada M, Murakami H, Takaku J. Calibration of PRISM and AVNIR-2 onboard ALOS "Daichi" [J]. IEEE Transactions on Geo-science and Remote Sensing, 2009, 47(12): 4042-4050.
[13] Jiang Y H, Zhang G, Tang X M, Li D R, Huang W C, Pan H B. Geometric calibration and accuracy assessment of Ziyuan-3 multispectral images [J]. IEEE Transactions on Geoscience and Remote Sensing, 2014, 52(7): 4161-4172.
[14] Zhang G, Jiang Y H, Li D R, Huang W C, Pan H B, Tang X M, Zhu X Y. In-orbit geometric calibration and validation of ZY-3 linear array sensors [J]. The Photogrammetric Record, 2014, 29(145): 68-88.
[15] Kubik P, Lebegue L, Fourest S, Delvit J M, de Lussy F, Greslou D, Blanchet G. First in-flight results of Pleiades 1A innovative methods for optical calibration [C]//Proceedings of the Inter national Conference on Space Optics (ICSO), Ajaccio, Corsica, France, 2012: 1-9.
[16] Dingluirard M, Slater P N. Calibration of space-multispectral imaging sensors: a review [J]. Remote Sensing of Environment, 1999, 68(5): 194-205.
[17] Slater P N, Biggar S F, Holm R G, Jackson R D, Mao Y, Moran M S, Palmer J M, Yuan B. Reflectance-and radiance-based methods for the in-flight absolute calibration of multispectral sensors [J]. Remote Sensing of Environment, 1987, 22(1): 11-37.
[18] Smiley B D, Chau A H, Robinson M D. SkySat-1: very high-resolution imagery from a small satellite [C]//Proceedings of SPIE 9241, Sensors, Systems and Next-Generation Satellites October 7, 2014, XVIII: 92411E.
[19] Thomas C S, Hugh H K, Kris J B. Modeling the radiance of the moon for on-orbit calibration[J]. Proceedings of SPIE, 2003, 5151: 463-470.
[20] Vincent M, Gwendoline B, Philippe K, Sophie L, Christophe L, Laurent L, Florie L, Florence P N. Pleiades-HR 1A&1B image quality commissioning: innovative radiometric calibration methods and results [J]. Proceedings of SPIE, The International Society for Optical Engineering, 2013, 8866: 886610.
[21] 刘祥磊, 童小华, 马静. 视频测量影像序列椭圆形人工目标点快速识别和跟踪方法[J]. 测绘学报, 2015, 44(6): 663-669. Liu X L, Tong X H, Ma J. A systemic algorithm of elliptical artificial targets identification and tracking for image sequences from videogrammetry [J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(6): 663-669. (in Chinese)
[22] 吉淑娇, 朱明, 胡汉平. 基于特征点匹配的电子稳像技术[J]. 中国光学, 2013, 6(6): 841-849. Ji S J, Zhu M, Hu H P. Aero-borne electronic image stabilization based on feature point matching[J]. Chinese Optics, 2013, 6(6): 841-849. (in Chinese)
[23] Kim T, Lee S, Paik J. Combined shape and feature-based video analysis and its application to non-rigid object tracking [J]. IET Image Processing, 2011, 5(1): 87-100.
[24] Kiran M, Michael S, Byron D S. SkySat-1: very high-resolution imagery from a small satellite[C]//Proceeding of SPIE 9241, Sensors, Systems, and Next-Generation Satellites XVIII, 2014, 9241: 588-642.
[25] 王霞, 张过, 沈欣, 李贝贝, 蒋永华. 顾及像面畸变的卫星视频稳像[J]. 测绘学报, 2016, 45(2): 194-198. Wang X, Zhang G, Shen X, Li B B, Jiang Y H. Satellite video stabilization with geometric distortion [J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(2): 194-198. (in Chinese)
[26] Park S C, Park M K, Kang M G. Super-resolution image reconstruction: a technical overview[J]. IEEE on Signal Processing Magazine, 2003, 20(3): 21-36.
[27] Murthy K, Shearn M, Smiley B D. SkySat-1: very high-resolution imagery from a small satellite[C]//SPIE Remote Sensing. International Society for Optics and Photonics, 2014: 92411E.
[28] 黎俊, 彭启民, 范植华. 亚像素级图像配准算法研究[J]. 中国图象图形报, 2008, 13(11): 2070-2075. Li J, Peng Q M, Fan Z H. A survey of sub-pixel image registration Methods [J]. Journal of Image and Graphics, 2008, 13(11): 2070-2075. (in Chinese)
[29] Nasrollahi K, Moeslund T B. Super-resolution: a comprehensive survey [J]. Machine Vision & Applications, 2014, 25(6): 1423-1468.
[30] 袁小华, 欧阳晓丽, 夏德深. 超分辨率图像恢复研究综述[J]. 地理与地理信息科学, 2006, 22(3): 43-47. Yuan X H, Ou-Yang X L, Xia D S. A review of super-resolution image restoration [J]. Geography and Geo-information Science, 2006, 22(3): 43-47. (in Chinese)
[31] 苏衡, 周杰, 张志浩. 超分辨率图像重建方法综述[J]. 自动化学报, 2011, 39(8): 1202-1213. Su H, Zhou J, Zhang Z H. Survey of super-resolution image reconstruction methods [J]. Acta Automatica Sinica, 2011, 39(8): 1202-1213. (in Chinese)
[32] Deyun C, Zhiqiang L, Ming G. A superresolution image reconstruction algorithm based on landweber in electrical capacitance tomography [J]. Mathematical Problems in Engineering, 2013: 128172
[33] Elad M, Hel-Or Y. A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur [J]. IEEE Transactions on Image Processing, 2001, 10(8): 1187-1193.
[34] Goto T, Kawamoto Y, Sakuta Y. Learning-based super-resolution image reconstruction on multi-core processor [J]. IEEE Transactions on Consumer Electronics, 2012, 58(3): 941-946.
[35] Li X, Du Y, Feng L. Super-resolution mapping of forests with bitemporal different spatial resolution images based on the spatial-temporal Markov random field [J]. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing, 2014, 7(1): 29-39.
[36] Sobrala, Vacavant A. A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos [J]. Computer Vision and Image Understanding, 2014, 122: 4-21.
[37] 陈星明, 廖娟, 李勃, 陈启美. 动态背景下基于改进视觉背景提取的前景检测[J]. 光学精密工程, 2014, 22(9): 2545-2552. Chen X M, Liao J, Li B, Chen Q M. Foreground detection based on modified ViBe in dynamic background [J]. Optics and Precision Engineering, 2014, 22(9): 2545-2552. (in Chinese)
[38] 刘天良, 郑海红, 罗圣美. 改进的混合动静态背景的分割方法[J]. 西安交通大学学报, 2015, 49(2): 25-30. Liu T L, Zheng H H, Luo S M. An improved subtraction algorithm of background with stationary and non-stationary scenes [J]. Journal of Xi'an Jiaotong University, 2015, 49(2): 25-30. (in Chinese)
[39] Olivier B Vanroogenbroeck M. ViBe: a universal background subtraction algorithm for video sequences [J]. IEEE Transactions on Image Processing, 2011, 20(6): 1709-1724.
[40] Heras Evangelio R H, Patzold M, Keller I. Adaptively splitted GMM with feedback improvement for the task of background subtraction [J]. IEEE Transactions on Information Forensics and Security, 2014, 9(5): 863-874.
[41] Zdenk K, Krystian M, Jiri M. Tracking learning detection [J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2012, 34(7): 1409-1422.
[42] Luca Z, Alessio D B, Xavier L. Joint estimation of segmentation and structure from motion[J]. Computer Vision and Image Understanding, 2013, 117(2): 113-129.
[43] Henriques J F, Caseiro R, Martins P, Batista J. High-speed tracking with kernelized correlation filters [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(3): 583-596.
[44] Ido L. Mean shift trackers with cross-bin metrics [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(4): 695-706,
[45] Xu J, Lu Y, Liu J. Robust tracking via weighted spatio-temporal context learning [J]. IEEE International Conference on Image Processing, 2014: 413-416.
[46] Laurentini A. The visual hull concept for silhouette-based image understanding [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1994, 16(2): 150-162.
[47] Martin W, Aggarwal N. Volumetric descriptions of objects from multiple views [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1983, 5(2): 150-158.
[48] Seitz S M, Curless B, Diebel J. A comparison and evaluation of multi-view stereo reconstruction algorithms [C]//Proceeding of the IEEE Computer Vision and Pattern Recognition, 2006, 1: 519-526.
[49] Carlos H, Vogiatzis G, Cipolla R. Multiview photometric stereo [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008, 30(3): 548-554.
[50] Li Z, Brian C, Aaron H, Steven M. Seitz shape and motion under varying illumination: unifying structure from motion, photometric stereo, and multi-view stereo [C]//Ninth IEEE International Conference on Computer Vision, 2003: 618-625.