采用多方向插值融合的快速铁路货运图像修复

doi:10.3969/j.issn.0255-8297.2014.02.012

Abstract

Abstract: High resolution line-scan cameras produce images with missing information due to occlusion caused by foreign objects. In this paper, we propose a framework based on multiple direction interpolation for single image digital restoration to remove high tension wire (HTW) from images for railway loaded condition inspection (LCI) applications. The known region to be reconstructed is automatically segmented into smooth and edge sub-regions. The smooth regions are filled-in with bilinear interpolation based on the information in the neighborhood, which is the minimum among the gradient values in three directions. For the edge regions,the fill-in result is optimized using a data fusion method based on the information in three directions with bi-cubic interpolation. Inpainting is performed for each channel independently based on the HSI color space instead of RGB. Experimental results indicate that better restoration results can be obtained as compared with traditional Bertalmio-Sapiro-Caselles-Bellester (BSCB) and fast marching method (FMM) algorithms. The proposed algorithm can also effectively deal with inpainting of complex color images with high computational efficiency.

Key words: image inpainting, image restoration, data fusion, interpolation, railway loaded condition inspection(RLCI)

CLC Number:

TP391

金星1，俞大海1,2，韩建枫3，李晖晖1，韩军伟1. Fast Inpainting of Railway Freights Images Based on Multiple Direction Interpolation[J]. Journal of Applied Sciences, 2014, 32(2): 191-198.

References

[1] TAUBER Z, LI Z N, DREW M S. Review and preview: disocclusion by inpainting for image-based rendering [J]. IEEE Trans. Syst., Man, Cybern. C, 2007, 37(4): 527 -540.

[2] BERTALMIO M, SAPIRO G. Image inpainting [C]//Proceedings of the ACM SIGGRAPH Conference on Computer Graphics, New York, USA, 2000: 417-424.

[3] CHAN T, SHEN J. Mathematical models for local deterministic inpaintings. Technical Report CAM 00-11, Image Processing Research Group, UCLA, 2000. ftp://ftp.math.ucla.edu/pub/camreport/cam00-11.ps.gz

[4] CHAN T, SHEN J. Non-Texture inpainting by Curvature-Driven diffusions (CDD) [J]. CAM 00-35, Image Processing Research Group, UCLA,2000. ftp://ftp.math.ucla.edu/pub/camreport/cam00-35.pdf

[5] TELEA A C. An image inpainting technique based on the fast marching method [J], Journal of Graphics Tools, 2004, 9(1): 25-36.

[6] CRIMINISI A， PEREZ P， TOYAMA K. Region filling and object removal by exemplar-based image inpainting[J], IEEE Transactions on Image Processing, 2004, 13(9): 1200-1212.

[7] FENG Tang, YING Yiting, WANG Jin, et al. A novel texture synthesis based algorithm for object removal in photographs [C]//Proceedings of 9th Asian Computing Science Conference, Thailand, 2004: 248-258.

[8] BECK J， STEWART C, RADKE R J. LiDAR inpainting from a single image [C]//Proceedings on 12th International Conference on Computer Vision Workshops, 2009: 1441-1448.

[9] 党向盈，吴锡生. 一种新颖基于边缘最大梯度的多方向优化插值算法[J]. 计算机应用研究，2007, 24(9): 317-320.

DANG Xiangying, WU Xisheng, ZHAO Yong. Novel multi-direction optimization interpolation based on edge max-gradient algorithm[J]. Application Research of Computers, 2007, 24(9):317-320.

[10] 吴锡生，党向盈. 一种阈值控制的边缘自适应快速图像插值算法[J]. 计算机工程，2007, 33(22): 226-228.

WU Xisheng, DANG Xiangying, ZHAO Yong. Fast self-adptive edge-oriented interpolation based on threshold method[J]. Computer Engineering, 2007, 33(22)226-228.

[11] ZHANG Xiangjun, WU Xiaolin. Image interpolation by adaptive 2-D autoregressive modeling and soft-decision estimation[J]. IEEE Transactions on Image Processing, 2008, 17(4): 887-896.

[12] SOLTAN E A, ELKHAMY S E. Wavelet-based image interpolation with a least squares algorithm[J]. Computer Engineering Conference, 2010, 10(21): 103-106.

[13] ADAMCZYK K. WALCZAK A. Digital images interpolation with wavelet edge extractors[J]. Human System Interactions, 2010, 6(12): 399-405.

[14] YAROSLAVSKY L P. DFT and DCT based discrete sinc-interpolation methods for direct fourier tomographic reconstruction[J]. Image and Signal Processing and Analysis, 2003, 1(12): 405-410.

[15] LIN T C, TRUONG T K. DCT-based image codec embedded cubic spline interpolation with optimal quantization[J]. IEEE Eighth International Symposium, 2006, 44(2): 11-15.

[16] WU Zhenyu, YU Yongyang, CHEN Changwen. A new hybrid DCT-wiener_based interpolation scheme for video intra frame up-sampling[J]. IEEE Signal Processing Letters, 2010, 17(10): 827-830.

[17] LUKAC R, PLATANIOTIS N, SMOLKA B, VENESANOPOULOS N. Vector operators for color image zooming [C]//Proceedings of the IEEE International Symposium on Industrial Electronics. Dubrovnik, Croatia: IEEE, 2005: 1273-1277.

[18] JIN Liang Hai, LI De Hua, SONG E. Combining vector ordering and spatial information for color image interpolation[J]. Image and Vision Computing, 2009, 27(4): 10-416.

[19] CHA Y, KIM S. Edge-forming methods for color image zooming[J]. IEEE Transactions on Image Processing, 2006, 15(8): 2315-2323.

Fast Inpainting of Railway Freights Images Based on Multiple Direction Interpolation

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments

[1]	SUN Ronghai, SHI Linfu, YU Chunqiang, LAO Huan, TANG Zhenjun. Random Interpolation Method for Data Hiding in Encrypted Images [J]. Journal of Applied Sciences, 2020, 38(3): 419-430.
[2]	SU Wen-xuan, FANG Zhen. Identifying Image Authenticity Based on CFA Inconsistency of Interpolation Characteristics [J]. Journal of Applied Sciences, 2019, 37(1): 33-40.
[3]	CHEN Yan, YU Chun-qiang, HOU Xiao-jie, ZHANG Xian-quan, TANG Zhen-jun, HE Nan. Reversible Information Hiding Method in Encrypted Image Based on Surface Interpolation [J]. Journal of Applied Sciences, 2018, 36(2): 220-236.
[4]	LIU Hua-yong, LI Lu, ZHANG Da-ming, WANG Huan-bao. Construction and Blending of Algebraic-Trigonometric Spline Curves with Two Kinds of Shape Parameters [J]. Journal of Applied Sciences, 2017, 35(3): 383-393.
[5]	ZHANG Lei, LU Yu-ping, YIN Ming. Cooperative Control off Our-Rotor UAV Based on Multi-sensor Fusion [J]. Journal of Applied Sciences, 2016, 34(2): 190-202.
[6]	WANG Wei, ZHANG Jin-yi, ZHANG Hong-hui, CAI Chun-yan, LI Jian-yu. Complementary-Weighted Iterative Fusion Algorithm for Heterogeneous Dual 9-Axis MEMS Inertial Sensor Data [J]. Journal of Applied Sciences, 2015, 33(5): 491-501.
[7]	ZHANG Xiao-lin, FANG Zhen, ZHANG Xin-peng. Forgery Detection via Inter-channel Correlation of CFA Images [J]. Journal of Applied Sciences, 2015, 33(1): 87-94.
[8]	LI Xi1, CHEN Feng-rui2, YU Zhi-feng1,3. Spectral Unmixing of Remote Sensing Images Using Interpolation of Wavelet Coefficients [J]. Journal of Applied Sciences, 2012, 30(6): 613-618.
[9]	SONG Lei1, LI Li-hua1, GAO Xiang-chuan2, PEI Yu-shan1, WANG Hua-lei1. Effect of Imperfect Frame Synchronization on Linear Interpolation of Amplititude and Phase [J]. Journal of Applied Sciences, 2012, 30(5): 441-447.
[10]	REN Ya-fei, KE Xi-zheng. Fusion of Multi-scale Wavelet Decomposition and Application to MEMS Gyroscope Data Processing [J]. Journal of Applied Sciences, 2010, 28(4): 394-398.
[11]	DING Qi, PING Xi-jian. Audio Tampering Detection Based on Band-Partitioning Spectral Smoothness [J]. Journal of Applied Sciences, 2010, 28(2): 142-146.
[12]	ZHANG Jian-jun;WANG Qin. Nonlinear Regularization for Bi-level Image Restoration [J]. Journal of Applied Sciences, 2009, 27(1): 74-78 .
[13]	XIE Wei song;XIONG Yan. Modification of Curves with Rational Cubic Bezier Splines [J]. Journal of Applied Sciences, 2007, 25(2): 216-216 .
[14]	LIU Yi-an, CHEN Song-can, ZHANG Ming-jun, MA Xiu-fang. Application of Buffer Operator and Data Fusion in Target Tracking [J]. Journal of Applied Sciences, 2006, 24(2): 154-158.
[15]	HAN Yu-bing, WU Le-nan. Image Restoration Based on the Modified Paik-Hopfield Neural Network [J]. Journal of Applied Sciences, 2005, 23(2): 126-130.