用户名: 密码: 验证码:
航空异速像移模糊实时恢复算法研究与GPU平台实现
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
航空侦察飞机在做高速低空飞行的时候,飞机与地面目标间存在相对运动,在载机相机的CCD积分时间内,影像会在成像靶面上产生像移,致使成像模糊,降低侦察的质量。载机飞行姿态的不同,会产生不同性质的像移。使用简便的数字图像算法对各种航空模糊图像进行恢复会对所运行算法的有效性及实时性提出严格要求。
     本文首先研究简单的前向像移模糊,提出用一维的维纳滤波(1DWF)算法来实现二维的模糊图像的实时恢复,在确保图像恢复质量的前提下将算法的运算量减少到原先的三分之一。在此基础上,本文对斜视成像所形成的异速像移模糊进行建模,根据像移量的不同对图像进行分割,并使用1DWF算法并行处理各分割区,实现斜视运动模糊图像的快速恢复。
     旋转运动模糊是一种更为复杂的异速像移模糊,本文用基于Bresenham画圆法的坐标转换方法将旋转圆弧上的空间变化模糊转变为常见的线性空间不变模糊,使用1DWF算法对圆弧轨迹上的像素点进行模糊恢复,解决航空成像时旋转运动模糊的实时恢复问题。
     在单一像移模糊的研究基础上,本文进一步提出一种针对多重模糊的图像恢复算法,解决航空成像中多重模糊同时作用时的图像恢复问题。对空间不变模糊的点扩散函数进行合并,减少多重模糊恢复过程的计算误差累计,通过一次解卷积运算实现多重空间不变模糊图像的恢复。
     在实现各种像移模糊有效恢复的同时,本文对各算法的运算量进行分析,使用改进的实数FFT算法替代原图像恢复算法中的复数FFT算法,将图像恢复算法的运算量减少到原先的50%。在此基础上提出一种彩色图像的数据合并处理算法,将彩色运动模糊图像的处理速度提高了3倍,实现彩色运动模糊图像的实时恢复。
     在算法自身效率优化的基础上,本文应用GPGPU技术将算法移植到图形处理器(GPU)平台上,借用GPU硬件并行架构的并行计算能力,进一步的提升算法的运算速度。本文算法在GPU处理平台下用7.95ms即能恢复一帧1024x1024 24位彩色运动模糊图像,恢复图像的PSNR值为31.45。文中最后给出航空成像异速像移实时恢复算法的总体设计方案。
When reconnaissance plane is flying with high-speed and low-altitude, the relative motion will happen between the airplane and the ground object. During the reconnaissance camera's CCD integration time, image motion will occur on the focal plane array of the aerial camera to blur the images and degrade the reconnaissance quality. The flight attitude's difference will lead to different types of image motion. If the image algorithm is used to restore all kinds of motion blurred aerial images for the convenience, the validity and the efficiency of the presented restoration algorithm will be strictly requested.
     At the first, this article studies the simple forward motion. A new algorithm based on one-dimensional wiener filter (1DWF) is proposed to restore the two-dimensional images blurred by forward motion. The new algorithm guarantees the restoration quality and reduces the algorithm computational requirements to original 1/3. Based on this, the mathematic model of the different rates image motion generated by aerial side-oblique imaging is founded According to their different image motion rates, the entire blurred image was segmented into many slices. 1D Wiener filters are used in parallel to restore all the image slices to realize the side-oblique image motion blur quick recovery.
     The rotational motion blur is more complicate than side-oblique image motion blur. An algorithm is proposed to restore the images in real-time, blurred by rotational motion during aerial imaging. In the algorithm, the coordinate conversion based on Bresenham algorithm is applied to transform the space-variant blur on the circular arc paths into space-invariant blur on the pixel lines, and the 1D Wiener filter is used to restore the linearity image motion transformed by coordinate conversion.
     In the sole image motion blur research foundation, an algorithm is proposed to restore the images, simultaneously degraded by multiple blur during aerial imaging in advanced. To reduce the accumulating of calculation error during the restoration for multiple blurred images, the point spread functions (PSFs) of each space-invariant blur in the multiple blurred images are combined by convolving all the linear PSFs together. For that, the multiple blur made up of the space-invariant blurs can be eliminated by a deconvolution restoration.
     While realizes effective restoration to each kind of image motion blur, the computation consumption reduction of each algorithm is carried on. The improved real FFT algorithm is applied to instead the conventional complex FFT algorithm used in the original restoration algorithm to reduce the computation consumption by about 50%. Based on this improvement, an algorithm is proposed to restore the motion-blurred color images in real-time by combined the color components, which makes proposed algorithm 3X faster than the general algorithm.
     In the foundation of algorithm’s efficiency optimization, the GPGPU technology is applied to transplant the algorithm to the graphics processor unit(GPU) platform, Using the parallel computing ability of GPU’s special simultaneous operating mode, the algorithm operating speed is further promoted. The proposed algorithm can restore a 1024x1024 24-bit motion-blurred color image in 7.95ms on GPU, and the PSNR of the restored image is 31.45. In the end, an overall project concerning all real-time restoration algorithms proposed in this paper is presented
引文
[1]史光辉.像移对卫星摄影成像质量的影响[J].光学精密工程,1997,5(4): 31-34
    [2]颜昌翔,王家琪.航空相机像移补偿计算的坐标变换方法[J].光学精密工程,2000,8(3): 203-207
    [3] Reeves S I, Mersereau R M, Blur identification by the method of generalized cross-validation[J]. IEEE Trans Image Processing, 1992, 1(3):301-311.
    [4]翟林培,刘明,修吉宏,考虑飞机姿态角时倾斜航空相机像移速度计算[J],光学精密工程,2006,14(3):490-494
    [5]刘明.基于图像复原的航空摄影前向像移检测及补偿技术研究[D],[博士学位论文].长春:中国科学院长春光学精密机械与物理研究所,2005
    [6]Lareau A G, Advancements in E-O framing [C]. SPIE, 1998, Vol.3431: 96-107
    [7]许永森,丁亚林,田海英,等.斜视状态下航空遥感器像移的计算与补偿[J].光学精密工程,2007,15(11):1779-1783
    [8]Gorin B A, Side oblique real-time orthophotography with the 9Kx9K digital framing camera [C]. SPIE, 2003, Vol.5109: 86-97
    [9]吴宏升,潘凝,翟林培. TDICCD全景式航空相机的像移补偿误差分析[J].光学精密工程,2003,11(6): 545~549
    [10]魏政刚,袁杰辉,蔡元龙.图象质量评价方法的历史、现状和未来[J].中国图像图形学报,1998,3(5):386-389
    [11]刘明,匡海鹏,吴宏圣,等.像移补偿技术综述[J]电光与控制,2004,11(4):46-49
    [12]刘微,运动模糊图像恢复算法的研究与实现[D],[博士学位论文].长春:中国科学院长春光学精密机械与物理研究所,2006
    [13]黄猛,无人机载小型面阵航空相机系统的研制及关键技术研究[D],[博士学位论文].长春:中国科学院长春光学精密机械与物理研究所,2008
    [14] Bernd U, Zeiss Optronik GmbH, ReceLite tactical reconnaissance pod[C], SPIE, 2001, Vol.4492:92-102
    [15]孙丽娜. TDI CCD的驱动实现像移补偿的研究[D]. [博士学位论文].长春:中国科学院长春光学精密机械与物理研究所,2000年.
    [16]吴宏圣. TDI CCD全景航空相机像移补偿研究[D]. [博士学位论文].长春:中国科学院长春光学精密机械与物理研究所,2003年.
    [17] Olson, Gaylord G. Image motion compensation with frame transfer CCD[C]. SPIE 2002 Vol.4567: 153-160.
    [18]娄树理,杨增胜,周晓东.无人机光电侦察、监视技术研究[J].航天电子对抗,2007, 23(2): 28~30
    [19]贾建军,舒嵘,王斌永.无人机大面阵CCD相机遥感系统[J].光电工程,2006,33(8): 90-93
    [20]贾平,张葆,航空光电侦察平台关键技术与发展[J].光学精密工程,2003,11(1): 82-88
    [21]孙杰,林宗坚,崔红霞.无人机低空遥感监测系统[J].遥感信息,2003,(1): 25-27
    [22]Kuffman C. Emergence of tactical, framing infrared reconnaissance[C]. SPIE, 1998: 635-641.
    [23]Banham M R, Katsaggelgs A K, Digital image restoration[J]. IEEE signal proc. mag. 1997, 14(2): 24-41
    [24]Nagel M R, Introduction to“Evaluation of Motion-Degraded Images”Proc. of NASA Electronics Research Center Seminar, Cambridge, MA, 1968 Dec:3-5,
    [25]Castleman K R, Digital Image Processing[M]. Prentice Hall.Inc. Sep 1998.
    [26]Harris J L, Image Evaluation and Restoration[J]. J. Opt. Soc. Amer. May 1966.56:569-574.
    [27]McGlamery B L. Restoration of Turbulence Degraded Images[J]. J. Opt. Soc. Amer.Mar 1967, 57(3): 293-297.
    [28]Helstrom C W. Image Restoration by the Method of Least Squares[J]. J. Opt. Soc. Amer. Mar 1967, 57(3): 297-303
    [29]Slepian D. Linear Least-Squares Filtering of Distorted Images[J]. J. Opt. Soc. Amer. July 1967, 57(7): 918-922.
    [30]Pratt W K, Generalized Wiener Filter Computation Techniques[J]. IEEE Trans, Computers, July 1972 636-641.
    [31]Habibi A. Fast Suboptimal Wiener Filtering of Markov Processes[J]. University of Southern California, USCIPI Report 530, Los Angeles. Mar 1974, 75-80.
    [32]Cannon T M. Digital Image Deblurring by Nonlinear Homomorphic Filtering[D]. Computer Science Department, University of Utah, Salt Lake City. 1974.
    [33]Andrews H C, Hunt B R. Digital Image Restoration[M]. Prentice-Hall Inc. Englewood Cliffs, NJ. 1977.
    [34]Hunt B R. A Matrix Theory Proof of the Discrete Convolution Theorem[J]. IEEE. Trans. 1971, AU-19(4):285-288.
    [35]Hunt B R. The Application of Constrained Least Estimation to Image Restoration by Digital Computer[J]. IEEE Trans, 1973, C-22(9):805-812.
    [36]Robbins G M, Huang T S. Inverse Filtering for Linear Shift-Variant Iamging Systems [J]. Proc. IEEE. July 1972, 60(7):862-872.
    [37]Dempster A P, Laird N M and Rubin D B. Maximum likelihood from incomplete data via the EM algorithm[J]. J Royal Statiscal Ser. B. 1977, vol. 39, no. 1, pp:1-38.
    [38]Zhou Y-T, Chellappa R, Vaid A, and Jenkins B K. Image restoration using a neural network[J]. IEEE Trans. Acoust. Speech, Signal Processing. July 1988, vol. 36, no. 7, pp:141-1151.
    [39]Paik J K and Katsaggelos A K. Image restoration using a modified Hopfield network[J]. IEEE Trans. Image Processing. Jan 1992, vol. 1, pp:49-63.
    [40]Galatsanos N P, Mesarovic V Z, Molina R and Katsaggelos A K. Hierarchical Bayesian Image Restoration from Partially Known Blurs[J]. IEEE Trans. Image Processing. Oct 2000, vol. 9, no. 10, pp:1784-1797.
    [41]孙辉,张葆,刘晶红等.航空光电成像电子稳像技术[J],光学精密工程,2007, 15(8): 1280-1286
    [42]孙辉,熊经武,赵红颖.电子稳像技术在船载电视监视系统中的应用[J],光电工程,2008, 35(2): 103-108
    [43]Mccallum B C. Blind deconvolution by simulated annealing[J]. Optics Communitions, 1990, 75(2):101-105.
    [44]Ayers G R,Dainty J G, Iterative blind deconvolution method and its application[J].Optics Letters,1998,13(7):547-549.
    [45]何斌,马天予,王运坚等. Visual C++数字图像处理[M].北京:人民邮电出版社,2001年4月第1版.
    [46]容观澳.计算机图象处理[M].北京:清华大学出版社,2000.
    [47]阮秋琦.数字图像处理学.北京:电子工业出版社,2001年1月第1版.
    [48]杨枝灵,王开. Visual C++数字图形获取处理及实践应用.北京:人民邮电出版社,2003年1月第1版
    [49]朱秀昌,刘峰,胡栋.数字图像处理与图形通信.北京:北京邮电大学出版社,2002年5月第1版.
    [50]Biemond J, Lagendijk R L, Mersereau R M. Iterative Methods for Image Deblurring[J]. Proceedings of the IEEE, 1990, 78(5): 856-883
    [51]王晓红,赵荣椿.匀速直线运动模糊的PSF之估计[J].计算机应用. 2001, 21(9): 40-41.
    [52]王晓红,赵荣椿.任意方向运动模糊的消除[J].中国图象图形学报. 2000, 5(6): 525-529.
    [53]苏光大.图像并行处理技术[M].清华大学出版社. 2002, 64-65.
    [54]Stokseth P. A., Properties of a defocussed optical system[J], J. Opt. Soc. Am., vol. 59, pp. 1314-1321, Oct. 1969.
    [55]Bienond J, Rieske J, Gerbrands J J, A fast Kalman filter for images degraded by both blur and noise[J]. IEEE Transactions on Acoustics, Speech, and Signal Processing, 1983, 31(5): 1248~1256
    [56]White R L. Image restoration using the damped Richardson-Lucy method [J]. Proc. SPIE, 1994, 2198:1342~1348
    [57]李红阳.运动图像恢复.清华大学工程硕士学位论文[D]. 2000
    [58]冯清枝,杨洪臣,单大国.多帧融合处理技术在运动模糊图像复原中的应用.光学技术,2002,28(5):531-532.
    [59]Sondhi M M, Image restoration: The removal of spatially invariant degradations [J] , Proceedings of the IEEE, 1972,60(7): 842- 853
    [60]王旭辉,郭光亚.匀速运动模糊图像的快速恢复[J].微计算机信息. 2000, 16(5): 5-7.
    [61]王旭辉,郭光亚.匀速运动模糊图像的快速恢复的进一步研究[J].微计算机信息.2000, 16(6): 6-8.
    [62]Wang Z, Vemuri1 B C, and Chen Y. Diffusion tensor MR image restoration[C]. EMMCVPR. 2003, LNCS 2683:421–435.
    [63]于红斌,李志能,陈抗生.一种运动模糊图像的快速恢复算法[J],浙江大学学报(工学版),1999,33(5):564—568
    [64]Nakamura A, Kudo M, Tanaka A. Collaborative filtering using restoration operators[J]. PKDD 2003, LNAI 2838:339-349.
    [65]R Hunt B. A Matrix Theory Proof of the Discrete Convolution Theorem[C]. IEEE. Trans. 1971, AU-19(4):285-288.
    [66]Jain A K, Fundamentals of Digital Image Processing[M]. Prentice-Hall, Englewood Cliffs, N J., 1989.
    [67]贾平,张葆,孙辉.航空成像像移模糊恢复技术[J].光学精密工程,2006,14(4):697-703
    [68]Wiener N.Extrapolation. interpolation. and smoothing of stationary time Series. with engineering application [M].New York: John Wiley and Sons, 1949.
    [69]Zeng S Y, Ding L X, Kang L S. A method to approach optimal restoration in image restoration problems without noise energy information [J]. ACTA MATHEMATICA SCIENTIA, 2003, 23B(4):512-520.
    [70]王新成.高级图像处理技术[M].中国科学技术出版社, 2001
    [71]章毓晋.图像工程上册:图像处理和分析.清华大学出版社.1999
    [72]魏政刚,袁杰辉,蔡元龙.图象质量评价方法的历史、现状和未来.中国图象图形学报,1998,3(5):386-389.
    [73]Eskicioglu A M, Fisher P S, Image Quality Measures and Their Performance[J]. IEEE Transactions on Communications. 1995, 43.
    [74]陆杰,赵忠旭.图象质量评价的发展[J].计算机工程,2000,26(11):4-5,49.
    [75]徐鲁安.图象质量评价方法的研究与实现[D].浙江大学硕士学位论文. 2003: 4-12.
    [76]Wang Z, Bovik A C, A Universal Image Quality Index[J], IEEE SIGNAL PROCESSING LETTERS. 2002, 9.
    [77]Hosaka K,A New Picture Quality Evaluation Method[C], Proceedings of the International Picture Coding Symposium, April 1986.
    [78]Olsson S, Stropplan A M, Baina J,Objective methods for assessment of video quality : state of the art [J]. IEEE Transactions on Broadcasting ,1997, 43(4): 487-495
    [79]曹茂永,孙农亮,郁道银.基于灰度梯度的数字图像评价函数.光电工程,2003,30(6):69-72.
    [80]胡良梅,高隽,何柯峰.图像融合质量评价方法的研究[J].电子学报. 2004, 32(12): 218-221.
    [81]刘艳春.利用传播波方程作运动模糊图像质量恢复的客观评价[D].暨南大学硕士学位论文. 2002年..
    [82]丁艺芳.基于小波变换和视觉系统的图像质量综合评价新方法[D].上海大学博士学位论文. 2001年.
    [83]徐鲁安,章琦等.一种新的图像质量评价方法[J].计算机工程与设计. 2004, 25(3): 418-420.
    [84]魏政刚,袁杰辉,蔡元龙.一种基于视觉感知的图像质量评价方法.电子学报,1999,27(4):79-82.
    [85]Osberger W, Maeder A J. A technique for image quality assessment based on a human visual systerm model. EUSIPCO-98.
    [86]崔清亮.图像质量评价在虹膜识别中的应用研究[D].吉林大学硕士学位论文. 2004年.
    [87]汪孔桥.数字图像的质量评价[J].测控技术. 2000, 19(5): 14-16.
    [88]孙辉,张葆,刘晶红.基于维纳滤波的运动模糊消除算法及其在航空成像系统中的应用[J].光学精密工程,2005,13(6):735—740.
    [89]李仕,孙辉,张葆.一种运动模糊图像的实时恢复算法[J].光学精密工程,2007,15(5):767-772
    [90]吴兆熊,黄振兴,黄顺吉.数学信号处理(下册)[M].北京:国防工业出版社,1985.
    [91]韩昌元,信息光学基础理论及其应用[M]。长春:长春出版社1989。
    [92]程佩青,数字信号处理教程[M]。北京:清华大学出版社,2001
    [93]Smith S W, The Scientist and Engineer's Guide to Digital Signal Processing[M], California: California Technical Publishing, 1997.
    [94]Pharr M, Fernando R. GPU Gems2[M]. Addison-Wesley Professional,March 13, 2005
    [95]张树青,丁亚林,李友一,等.基于像面旋转的画幅遥感相机姿态像移计算[J],光学精密工程,2007,15(9):1432-1438
    [96]张树青,丁亚林,于春风.凝视模式下的画图相机两轴像移补偿[J].光学精密工程,2007,15(11):1789-1795
    [97]孙丽娜,汪永阳,戴明,等.航空光电成像消旋电视数字控制器[J],光学精密工程,2007,15(8):1300-1304
    [98]Ribaric S, Milani M, Kalafatic Z. Restoration of images blurred by circular motion [C], IWISPA 2000. Proceedings of the First International Workshop on, 2000: 53-60
    [99]Hong H Y, Zhang T X, Fast restoration approach for rotational motion blurred image based on deconvolution along the blurring paths [J], Opt. Eng. 2003, 42(12): 3471-3486
    [100]Qi S, Wei X, Jia J. Rotational motion deblurring of rigid object from a single image [C]. Computer Vision, 2007. IEEE 11th International Conference on, Oct. 2007: 1-8
    [101]王志喜,王润云, Bresenham画圆算法的改进[J],计算机工程,2004,30(12):178-180
    [102]汪金友,王淑礼,廖兆曙,3种画圆算法的优劣分析[J],信阳师范学院学报(自然科学版),2005,18(4):486--488
    [103]石慎,张艳宁,郗润平,等,基于Bresenham画线算法的图像快速-高精度旋转算法[J],计算机辅助设计与图形学学报, 2007,19(11): 1387—1392
    [104]李仕,孙辉,张葆.航空斜视成像异速像移实时恢复算法[J].光学精密工程,2009,17(4)
    [105]李仕,孙辉,张葆.旋转运动模糊的实时恢复算法[J].光学精密工程,2009,17(5)
    [106]Tan K CH,Lim H,Tan B T G.Restoration of real-world motion-blurred images[J].CVGIP,1991,53:291-299.
    [107]徐青,张艳,耿则勋,等.遥感影像融合与分辨率增强技术[M],北京:辞学出版社, 2007
    [108]Cooley J W, Tukey J W. An algorithm for the machine calculation of complex Fourier series[J], Mathematics Computation, 1965,19 :296~301
    [109]Bergland G. D., A fast fourier transform algorithm for real-valued series[J]. Comm. of the ACM, 1968, 11(10): 703-710
    [110]Jhang H. H., Using Support Vector Committee Machine for Face Tracking Based on Adaptive Color Space Switching[D], Graduate school of electronic engineering national yunlin university of science & technoloty, 2006
    [111]Süsstrunk S, Buckley R, Swen S, Standard RGB Color Spaces, Proc. IS&T/SID 7th Color Imaging Conference, 1999
    [112]Tschumperle D, Deriche R, Constrained and unconstrained PDEs for vector image restoration[C], Scandinavian Conference on Image Analysis, Bergen, Norway, June 2001.
    [113]Richardson I E G. Video Codec Design: Developing Image and Video Compression Systems[M]. John Wiley & Sons LTD. 2002
    [114]Chai D, Bouzerdoum A, A Bayesian approach to skin color classification in YCbCr colorspace[C], TENCON 2000. Proceedings, 2000 vol.2: 421-424
    [115]李仕,张葆,孙辉航空成像像移补偿的并行计算[J]光学精密工程,2009,17(1)
    [116]刘微,朱明,李向荣,等.运动模糊图像实时恢复的多DSP方案[J].电子器件,2005,28(4):722—725.
    [117]薛一波,王建中,并行处理中加速比的研究[J],计算机工程与设计,1994,16(1):11-16
    [118]谢超,麦联叨,都志辉,等,关于并行计算系统中加速比的研究与分析[J],计算机工程与应用,2003,39(26):66-68
    [119]廖晓群,蔺丽华,DSP并行处理系统设计中的几个关键问题[J],西安科技学院学报,2001,21(3):227-230
    [120]Moreland K, Angel E, The FFT on a GPU[J]. In SIGGRAPH/ Eurographics Workshop on Graphics Hardware 2003 Proceedings, 2003 July: 112–119
    [121]Lim H., Tan K C, Tan B T G. Edge errors in inverse and wiener filter restorations of motion-blurred images and their windowing treatment[J]. CVGIP, 1991, 53: 186-195.
    [122]Lim H., Tan K C, Tan B T G. New methods for restoring motion-blurred images derived from edge error consideration[J]. CVGIP, 1991, 53: 479-490.
    [123]Tan K C, Lim H, Tan B T G. Windowing techniques for image restoration[J]. CVGIP, 1991, 53: 491-500.
    [124]Tan K C, Lim H, Tan B T G. Restoration of real-world motion-blurred images[J], CVGIP, 1991, 53: 291-299.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700