卫星视频处理与应用进展

doi:10.3969/j.issn.0255-8297.2016.04.001

Abstract

Abstract:

Video satellites acquire continuous images of targets in a certain time period to dynamically monitor areas of interest in real time. They have become a hot spot in remote sensing satellite development in recent years. In this paper, a survey is given on the development of video satellites and application perspectives of satellite video data. Major challenges facing satellite video are analyzed, focusing on geometric calibration, radiometric calibration, video stabilization, super resolution reconstruction, moving target detection and tracking, 3D reconstruction, and the development trend. Major application fields of satellite video and the future perspectives are discussed.

Key words: satellite video, calibration, stabilization, 3D reconstruction, moving target detection

CLC Number:

N911.73

ZHANG Guo. Satellite Video Processing and Applications[J]. Journal of Applied Sciences, 2016, 34(4): 361-370.

References

[1] 蒋永华. 国产线阵推扫光学卫星高频误差补偿方法研究[D]. 武汉:武汉大学, 2015.
[2] Valorge C, Meygret A, Lebegure L, Henry P, Bouillon A, Breton E, Gachet R, Leger D, Viallefont F. 40 years of experience with SPOT in-flight Calibration [C]//ISPRS International Workshop on Radiometric and Geometric Calibration, Gulfport, Mississippi, USA, 2003.
[3] Breton E, Bouillon A, Gachet R, Delussy F. Pre-fight and in-flight geometric calibration of SPOT5 HRG and HRS images [J]. International Archines of Photogrammetry Remote Sensing and Spatial Information Sciences, 2002, 34(1): 20-25.
[4] Bouillon A, Breton E, Delussy F, Gachet R. Spot5 HRG and HRS first in-flight geometric quality results[C]//International Symposium on Remote Sensing, International Society for Optics and Photonics, 2003: 212-223.
[5] Bouillon A, Breton E, Delussy F. Spot5 geometric image quality [C]//Proceedings of 2003 IEEE International Geoscience and Remote Sensing Symposium, Toulouse, France. 2003: 303-305.
[6] Dial G, Bowen H, Gerlach F, Grodecki J, Oleszczuk R. Ikonos satellite, imagery, and products [J]. Remote Sensing of Environment, 2003, 88(1): 23-36.
[7] Grodecki J, Lutes J. Ikonos geometric calibrations [C]//Proceedings of the ASPRS 2005 Annual Conference, Sowth Dakota, USA, 2005.
[8] Grodecki J, Dial G. Ikonos geometric accuracy validation [J]. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 2002, 34(1): 50-55.
[9] Grodecki J, Dial G. Ikonos geometric accuracy [C]//Proceedings of Joint Workshop of ISPRS Working Groups I/2, I/5 and IV/7 on High Resolution Mapping from Space, 2001, 4: 19-21.
[10] Tadono T, Shimada M, Watanabe M, Hashimoto T, Iwata T. Calibration and validation of PRISM onboard ALOS[J]. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 2004, 35(1): 13-18.
[11] Takaku J, Tadono T. Prism on-orbit geometric calibration and DSM performance [J]. IEEE Transactions on Geoscience and Remote Sensing, 2009, 47(12): 4060-4073.
[12] Tadono T, Shimada M, Murakami H, Takaku J. Calibration of PRISM and AVNIR-2 onboard ALOS "Daichi" [J]. IEEE Transactions on Geo-science and Remote Sensing, 2009, 47(12): 4042-4050.
[13] Jiang Y H, Zhang G, Tang X M, Li D R, Huang W C, Pan H B. Geometric calibration and accuracy assessment of Ziyuan-3 multispectral images [J]. IEEE Transactions on Geoscience and Remote Sensing, 2014, 52(7): 4161-4172.
[14] Zhang G, Jiang Y H, Li D R, Huang W C, Pan H B, Tang X M, Zhu X Y. In-orbit geometric calibration and validation of ZY-3 linear array sensors [J]. The Photogrammetric Record, 2014, 29(145): 68-88.
[15] Kubik P, Lebegue L, Fourest S, Delvit J M, de Lussy F, Greslou D, Blanchet G. First in-flight results of Pleiades 1A innovative methods for optical calibration [C]//Proceedings of the Inter national Conference on Space Optics (ICSO), Ajaccio, Corsica, France, 2012: 1-9.
[16] Dingluirard M, Slater P N. Calibration of space-multispectral imaging sensors: a review [J]. Remote Sensing of Environment, 1999, 68(5): 194-205.
[17] Slater P N, Biggar S F, Holm R G, Jackson R D, Mao Y, Moran M S, Palmer J M, Yuan B. Reflectance-and radiance-based methods for the in-flight absolute calibration of multispectral sensors [J]. Remote Sensing of Environment, 1987, 22(1): 11-37.
[18] Smiley B D, Chau A H, Robinson M D. SkySat-1: very high-resolution imagery from a small satellite [C]//Proceedings of SPIE 9241, Sensors, Systems and Next-Generation Satellites October 7, 2014, XVIII: 92411E.
[19] Thomas C S, Hugh H K, Kris J B. Modeling the radiance of the moon for on-orbit calibration[J]. Proceedings of SPIE, 2003, 5151: 463-470.
[20] Vincent M, Gwendoline B, Philippe K, Sophie L, Christophe L, Laurent L, Florie L, Florence P N. Pleiades-HR 1A&1B image quality commissioning: innovative radiometric calibration methods and results [J]. Proceedings of SPIE, The International Society for Optical Engineering, 2013, 8866: 886610.
[21] 刘祥磊, 童小华, 马静. 视频测量影像序列椭圆形人工目标点快速识别和跟踪方法[J]. 测绘学报, 2015, 44(6): 663-669. Liu X L, Tong X H, Ma J. A systemic algorithm of elliptical artificial targets identification and tracking for image sequences from videogrammetry [J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(6): 663-669. (in Chinese)
[22] 吉淑娇, 朱明, 胡汉平. 基于特征点匹配的电子稳像技术[J]. 中国光学, 2013, 6(6): 841-849. Ji S J, Zhu M, Hu H P. Aero-borne electronic image stabilization based on feature point matching[J]. Chinese Optics, 2013, 6(6): 841-849. (in Chinese)
[23] Kim T, Lee S, Paik J. Combined shape and feature-based video analysis and its application to non-rigid object tracking [J]. IET Image Processing, 2011, 5(1): 87-100.
[24] Kiran M, Michael S, Byron D S. SkySat-1: very high-resolution imagery from a small satellite[C]//Proceeding of SPIE 9241, Sensors, Systems, and Next-Generation Satellites XVIII, 2014, 9241: 588-642.
[25] 王霞, 张过, 沈欣, 李贝贝, 蒋永华. 顾及像面畸变的卫星视频稳像[J]. 测绘学报, 2016, 45(2): 194-198. Wang X, Zhang G, Shen X, Li B B, Jiang Y H. Satellite video stabilization with geometric distortion [J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(2): 194-198. (in Chinese)
[26] Park S C, Park M K, Kang M G. Super-resolution image reconstruction: a technical overview[J]. IEEE on Signal Processing Magazine, 2003, 20(3): 21-36.
[27] Murthy K, Shearn M, Smiley B D. SkySat-1: very high-resolution imagery from a small satellite[C]//SPIE Remote Sensing. International Society for Optics and Photonics, 2014: 92411E.
[28] 黎俊, 彭启民, 范植华. 亚像素级图像配准算法研究[J]. 中国图象图形报, 2008, 13(11): 2070-2075. Li J, Peng Q M, Fan Z H. A survey of sub-pixel image registration Methods [J]. Journal of Image and Graphics, 2008, 13(11): 2070-2075. (in Chinese)
[29] Nasrollahi K, Moeslund T B. Super-resolution: a comprehensive survey [J]. Machine Vision & Applications, 2014, 25(6): 1423-1468.
[30] 袁小华, 欧阳晓丽, 夏德深. 超分辨率图像恢复研究综述[J]. 地理与地理信息科学, 2006, 22(3): 43-47. Yuan X H, Ou-Yang X L, Xia D S. A review of super-resolution image restoration [J]. Geography and Geo-information Science, 2006, 22(3): 43-47. (in Chinese)
[31] 苏衡, 周杰, 张志浩. 超分辨率图像重建方法综述[J]. 自动化学报, 2011, 39(8): 1202-1213. Su H, Zhou J, Zhang Z H. Survey of super-resolution image reconstruction methods [J]. Acta Automatica Sinica, 2011, 39(8): 1202-1213. (in Chinese)
[32] Deyun C, Zhiqiang L, Ming G. A superresolution image reconstruction algorithm based on landweber in electrical capacitance tomography [J]. Mathematical Problems in Engineering, 2013: 128172
[33] Elad M, Hel-Or Y. A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur [J]. IEEE Transactions on Image Processing, 2001, 10(8): 1187-1193.
[34] Goto T, Kawamoto Y, Sakuta Y. Learning-based super-resolution image reconstruction on multi-core processor [J]. IEEE Transactions on Consumer Electronics, 2012, 58(3): 941-946.
[35] Li X, Du Y, Feng L. Super-resolution mapping of forests with bitemporal different spatial resolution images based on the spatial-temporal Markov random field [J]. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing, 2014, 7(1): 29-39.
[36] Sobrala, Vacavant A. A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos [J]. Computer Vision and Image Understanding, 2014, 122: 4-21.
[37] 陈星明, 廖娟, 李勃, 陈启美. 动态背景下基于改进视觉背景提取的前景检测[J]. 光学精密工程, 2014, 22(9): 2545-2552. Chen X M, Liao J, Li B, Chen Q M. Foreground detection based on modified ViBe in dynamic background [J]. Optics and Precision Engineering, 2014, 22(9): 2545-2552. (in Chinese)
[38] 刘天良, 郑海红, 罗圣美. 改进的混合动静态背景的分割方法[J]. 西安交通大学学报, 2015, 49(2): 25-30. Liu T L, Zheng H H, Luo S M. An improved subtraction algorithm of background with stationary and non-stationary scenes [J]. Journal of Xi'an Jiaotong University, 2015, 49(2): 25-30. (in Chinese)
[39] Olivier B Vanroogenbroeck M. ViBe: a universal background subtraction algorithm for video sequences [J]. IEEE Transactions on Image Processing, 2011, 20(6): 1709-1724.
[40] Heras Evangelio R H, Patzold M, Keller I. Adaptively splitted GMM with feedback improvement for the task of background subtraction [J]. IEEE Transactions on Information Forensics and Security, 2014, 9(5): 863-874.
[41] Zdenk K, Krystian M, Jiri M. Tracking learning detection [J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2012, 34(7): 1409-1422.
[42] Luca Z, Alessio D B, Xavier L. Joint estimation of segmentation and structure from motion[J]. Computer Vision and Image Understanding, 2013, 117(2): 113-129.
[43] Henriques J F, Caseiro R, Martins P, Batista J. High-speed tracking with kernelized correlation filters [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(3): 583-596.
[44] Ido L. Mean shift trackers with cross-bin metrics [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(4): 695-706,
[45] Xu J, Lu Y, Liu J. Robust tracking via weighted spatio-temporal context learning [J]. IEEE International Conference on Image Processing, 2014: 413-416.
[46] Laurentini A. The visual hull concept for silhouette-based image understanding [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1994, 16(2): 150-162.
[47] Martin W, Aggarwal N. Volumetric descriptions of objects from multiple views [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1983, 5(2): 150-158.
[48] Seitz S M, Curless B, Diebel J. A comparison and evaluation of multi-view stereo reconstruction algorithms [C]//Proceeding of the IEEE Computer Vision and Pattern Recognition, 2006, 1: 519-526.
[49] Carlos H, Vogiatzis G, Cipolla R. Multiview photometric stereo [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008, 30(3): 548-554.
[50] Li Z, Brian C, Aaron H, Steven M. Seitz shape and motion under varying illumination: unifying structure from motion, photometric stereo, and multi-view stereo [C]//Ninth IEEE International Conference on Computer Vision, 2003: 618-625.

Satellite Video Processing and Applications

PDF

Knowledge

Cited

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments

[1]	YU Shuzhen, OU Qiaofeng, XIONG Bangshu, CHEN Yaofeng. A Calibration Method Based on Defocused Image for Stereo Vision Sensor with Large FOV [J]. Journal of Applied Sciences, 2019, 37(6): 795-805.
[2]	. Source Localization Using Taylor Series Iteration with Perturbation Calibration of Emitter States [J]. Journal of Applied Sciences, 2015, 33(3): 274-289.
[3]	ZENG Chun-yan1,2, MA Li-hong1, DU Ming-hui1. Atom Set Calibration and Step Control for Unknown-Sparsity Reconstruction from Compressive Sensing [J]. Journal of Applied Sciences, 2014, 32(2): 163-169.
[4]	CHEN Xiao-yu1,2, LEI Bo3. Fast and Robust Measurement of Pavement Ruts [J]. Journal of Applied Sciences, 2013, 31(5): 512-518.
[5]	FENG Wen-guang, LIU Shi-bin, LI Ju-ping, GUO Bo, YANG Shang-lin. Error Calibration of Three-Axis Magnetic Heading Sensor [J]. Journal of Applied Sciences, 2013, 31(2): 154-158.
[6]	. Robust Quadratic Stabilization H1 Control for a Class of Linear Switched Systems with Multiple Time-Varying Delays in State and Input [J]. Journal of Applied Sciences, 2011, 29(3): 316-324.
[7]	ZHANG Yi-cheng, TU Da-wei, ZHAO Qi-jie, WANG Mei. General Regular Polygon Method for Camera Calibration in Machine Vision [J]. Journal of Applied Sciences, 2010, 28(6): 621-627.
[8]	DONG Wei-chao, YE Nan, ZHANG Li-yan. Sub-pixel Matching of Square Grid Images for Strain Measurement in Sheet Metal Forming [J]. Journal of Applied Sciences, 2010, 28(3): 254-260.
[9]	WANG Ding1, LI Chang-sheng2, WU Ying1. Optimal Closed-Form Solution to Array Error Matrix Based on Eigenvector [J]. Journal of Applied Sciences, 2009, 27(6): 592-600.
[10]	HUANG Hui;LIU Jian-ye;LI Rong-bing. Error Calibration for Redundancy Collocation of Six MEMS-IMU [J]. Journal of Applied Sciences, 2009, 27(1): 106-110 .
[11]	JIN Shi-qun;ZHANG Li;FAN Li-qin . Error Correction in 3D Reconstruction System Using Single Image [J]. Journal of Applied Sciences, 2007, 25(6): 627-627 .
[12]	SUN Xianbin;LI Dehua;YIN Jie;XIONG Caiquan . Camera Calibration in Computer Vision Based on Artificial Neural Network [J]. Journal of Applied Sciences, 2007, 25(5): 486-486 .
[13]	WU Jia-qi, CHEN Jin-bo. Three Dimensional Reconstruction of Spatial Drone Position and Posture [J]. Journal of Applied Sciences, 2005, 23(6): 640-644.
[14]	WANG Xun-si, DENG Shan-xi, YANG Yong-yue. A New Plane-Corresponding Method for Based Camera Calibration in Vision Measurement [J]. Journal of Applied Sciences, 2004, 22(2): 183-186.
[15]	YANG Yan-sheng. The Design of Fuzzy Adaptive Robust Control Algorithm via the Dissipative System Theory Approach [J]. Journal of Applied Sciences, 2003, 21(2): 151-156.