Restoration of Infrared Images Captured by Aerial Staggered TDI Cameras
-
摘要: 针对航空交错延时积分(Time delay and integration, TDI)红外影像奇数行和偶数行之间灰度差异、错动以及影像降晰问题, 提出了一种交错TDI红外影像复原方法. 首先采用对影像灰度差异不敏感的基于相位相关 (Phase-only correlation, POC) 的位移估计方法估计奇数行影像和偶数行影像之间的亚像素精度位移场. 其次以奇数行影像为参考, 根据位移估计结果对偶数行影像做点对点灰度校正, 并对齐奇数行影像和灰度校正后的偶数行影像. 最后采用BTV (Bilateral total variation)正则化超分辨率重建方法反降晰, 得到复原影像. 实验结果表明复原影像中奇偶行的错动得到有效补偿, 地物的边缘和纹理结构更加清晰, 影像质量显著提高.Abstract: The infrared images captured by aerial staggered time delay and integration (TDI) cameras suffer from gray difference and stagger displacement between the odd field and even field, as well as blur owing to the long integrated exposure time. In order to restore the images, a POC (Phase-only correlation)-based motion estimation method is employed to estimate the motion field between the odd and even fields, because the POC is independent of gray differences between image pairs and can achieve sub-pixel accuracy. The motion field is then used for pixel-to-pixel gray correction of the even field with the odd field as the reference, and the odd field and the corrected even field are aligned. Finally, a BTV-based super-resolution algorithm is used for debluring. Experimental results show that the displacement is effectively compensated, texture and edges are sharper and clearer, and the quality of the restored image is improved obviously.
-
Key words:
- Staggered TDI /
- phase-only correlation (POC) /
- motion estimation /
- image restoration
-
[1] Hochman G, Yitzhaky Y, Kopeika N S, Lauber Y, Citroen M, Stern A. Restoration of images captured by a staggered time delay and integration camera in the presence of mechanical vibrations. Applied Optics, 2004, 43(22): 4345-4354 [2] [2] Zucker M, Pivnik I, Malkinson E, Haski J, Reiner T, Admon D, Keinan M, Yassen M, Sapiro I, Sapir N, Fraenkel A. Long mid-wave infrared detector with time delayed integration. In: Proceedings of the SPIE 4820, Infrared Technology and Applications XXVIII. Seattle, WA: SPIE, 2003. 580 [3] Fan Xiu-Ying, Bao Jin-He, Zhang Yong. Analysis on image sensor MTF of whiskbroom Scan TDI-CCD aerial camera. Optical Technology, 2012, 38(5): 634-637(范秀英, 鲍金河, 张勇. 摆扫式TDI-CCD航空相机传感器MTF分析. 光学技术, 2012, 38(5): 634-637) [4] Wang De-Jiang, Kuang Hai-Peng, Cai Xi-Chang, Liu Zhi-Ming, Zhang Xue-Fei. Digital implementation of forward motion compensation in TDI-CCD panoramic aerial camera. Optics and Precision Engineering, 2008, 16(12): 2465-2472 (王德江, 匡海鹏, 蔡希昌, 刘志明, 张雪菲. TDI-CCD 全景航空相机前向像移补偿的数字实现方法. 光学精密工程, 2008, 16(12): 2465-2472) [5] Yang Fei, Jin Guang, Qu Hong-Song, Yang Xiu-Bin, Xu Kai, Zhang Gui-Xiang. Design and analysis about rapid geometric correction of space whiskbroom time delayed and integration CCD camera. Acta Optica Sinica, 2014, 34(1): 75-81 (杨飞, 金光, 曲宏松, 杨秀彬, 徐开, 张贵祥. 航天时间延迟积分CCD相机摆扫成像快速几何校正设计与分析. 光学学报, 2014, 34(1): 75-81) [6] Pan Sheng-Da, Lin Chang-Qing. Design of scanning imaging system based on 5128 MW TDI IRFPA. Infrared Technology, 2013, 35(2): 74-77(潘胜达, 林长青. 5128中波TDI红外探测器成像系统设计. 红外技术, 2013, 35(2): 74-77) [7] Wang Hua, Wei Zhi-Yong, Zhang Wen-Yu, Wang Xu. Design of 4806 infrared focal plane array signal processing circuit. Infrared Technology, 2009, 31(9): 504-508(王华, 魏志勇, 张文昱, 王旭. 4806红外探测器信号处理电路设计. 红外技术, 2009, 31(9): 504-508) [8] [8] Hadar O, Dror I, Kopeika N S. Image resolution limits resulting from mechanical vibrations. Part IV: real-time numerical calculation of optical transfer functions and experimental verification. Optical Engineering, 1994, 33(2): 566-578 [9] [9] Wang Z L, Li B, Zhang Y, Xiao H S, Zhou C H. Satellite vibration on image quality degradation of remote sensing camera. Research on Precision Instrument and Machinery, 2012, 1(1): 6-10 [10] Liang J, Xu T F, Ni G Q. Compensation with multi motion models for images from TDI-CCD aerial camera. In: Proceedings of the 2010 Symposium on Photonics and Optoelectronic. Chengdu, China: IEEE, 2010. 1-5 [11] Raiter S, Hadar O, Kopeika N S. Image restoration from camera vibration and object motion blur in infrared staggered time-delay and integration systems. Optical Engineering, 2003, 42(11): 3253-3264 [12] Avrin A, Stern A, Kopeika N S. Registration of motion-distorted interlaced images captured by a scanning vector imaging sensor. Applied Optics, 2006, 45(23): 5950-5959 [13] Yitahaky Y, Stern A. Restoration of interlaced images degraded by variable velocity motion. Optical Engineering, 2003, 42(12): 2557-3565 [14] Haik O, Yitzhaky Y. Superresolution reconstruction of a video captured by a vibrated time delay and integration camera. Journal of Electronic Imaging, 2006, 15(2): 023006 [15] Barron J L, Fleet D J, Beauchemin S S, Burkitt T A. Performance of optical flow techniques. International Journal of Computer Vision, 1994, 12: 43-77 [16] Brox T, Bruhn A, Papenberg N, Weickert J. High accuracy optical flow estimation based on a theory for warping. In: Proceedings of the 8th European Conference Computer Vision. Prague, Czech Republic: Springer, 2004. 25-36 [17] Morgan G L K, Liu J G, Yan H S. Precise subpixel disparity measurement from very narrow baseline stereo. IEEE Transactions on Geoscience and Remote Sensing, 2010, 48(9): 3424-3433 [18] Yan H S, Liu J G. Robust sub-pixel disparity estimation and its refinement around depth discontinuity and featureless areas. In: Proceedings of the 2010 IEEE International Geoscience and Remote Sensing Symposium. Honolulu, HI: IEEE, 2010. 4576-4579 [19] Takita K, Aoki T, Sasaki Y, Higuchi T, Kobayashi K. High accuracy subpixel image registration based on phase only correlation. IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, 2003, E86-A(8):1925-1934 [20] Su Heng, Zhou Jie, Zhang Zhi-Hao. Survey of super-resolution image reconstruction methods. Acta Automatica Sinica, 2013, 39(8): 1202-1213 (苏衡, 周杰, 张志浩. 超分辨率图像重建方法综述. 自动化学报, 2013, 39(8): 1202-1213) [21] Li Zhan, Zhang Qing-Feng, Meng Xiao-Hua, Liang Peng, Liu Yu-Bao. Super-resolution reconstruction for multi-resolution image sequence. Acta Automatica Sinica, 2012, 38(11): 1804-1814 (李展, 张庆丰, 孟小华, 梁鹏, 刘玉葆. 多分辨率图像序列的超分辨率重建. 自动化学报, 2012, 38(11): 1804-1814) [22] An Yao-Zu, Lu Yao, Zhao Hong. An adaptive-regularized image super-resolution. Acta Automatica Sinica, 2012, 38(4): 601-608 (安耀祖, 陆耀, 赵红. 一种自适应正则化的图像超分辨率算法. 自动化学报, 2012, 38(4): 601-608) [23] Farsiu S, Robinson D, Elad M, Milanfar P. Fast and robust multi-frame super-resolution. IEEE Transactions on Image Processing, 2004, 13(10): 1327-1344 [24] Farsiu S, Robinson D, Elad M, Milanfar P. Robust shift and add approach to super-resolution. In: Proceedings of the SPIE 5203, International Symposium on Optical Science and Technology. San Diego, CA: SPIE, 2003. 121-130
点击查看大图
计量
- 文章访问数: 1606
- HTML全文浏览量: 94
- PDF下载量: 733
- 被引次数: 0