基于FPGA的低复杂度快速SIFT特征提取
|
摘要
尺度不变特征变换(SIFT)算法具有优良的鲁棒性,在计算机视觉领域得到广泛应用。针对SIFT算法高计算复杂度而导致其在CPU上运行实时性低的问题,基于现场可编程门阵列(FPGA)设计了一种低复杂度的快速SIFT硬件架构,主要对算法的特征描述符提取部分进行优化。通过降低梯度信息(包括梯度幅值和梯度方向)的位宽、优化高斯权重系数的产生、简化三线性插值系数的计算和简化梯度幅值直方图索引的求解等方法,避免了指数、三角函数和乘法等复杂计算,降低了硬件设计复杂度和硬件资源消耗。实验结果显示,提出的低复杂度快速SIFT硬件架构,与软件相比,可以获得约200倍的加速;与相关研究相比,速度提高了3倍,特征描述符稳定性提高了18%以上。
Scale invariant feature transform( SIFT) algorithm is widely used in the field of computer vision because of its excellent robustness. In order to solve the problem of low real-time performance of computation-intensive SIFT algorithm on CPU,a fast SIFT hardware architecture is proposed based on field programmable gate array( FPGA),with reduced complexity by optimizing the feature descriptor extraction part of the algorithm. By reducing the bit width of gradient information( including gradient amplitude and gradient direction),optimizing the generation of the Gauss weight coefficients,simplifying the calculation of the three linear interpolation coefficients and simplifying the computation process of the histogram index of the gradient amplitude,the proposed design avoids complex computations such as exponent,trigonometric function and multiplication,and reduces the complexity of hardware architecture and hardware resource consumption. The experimental results show that the proposed low-complexity fast SIFT hardware architecture can speed up by about200 times compared to the software implementation. Compared with the related research,the speed is improved by 3 times and the stability of the feature descriptor is increased by more than 18%.
Scale invariant feature transform( SIFT) algorithm is widely used in the field of computer vision because of its excellent robustness. In order to solve the problem of low real-time performance of computation-intensive SIFT algorithm on CPU,a fast SIFT hardware architecture is proposed based on field programmable gate array( FPGA),with reduced complexity by optimizing the feature descriptor extraction part of the algorithm. By reducing the bit width of gradient information( including gradient amplitude and gradient direction),optimizing the generation of the Gauss weight coefficients,simplifying the calculation of the three linear interpolation coefficients and simplifying the computation process of the histogram index of the gradient amplitude,the proposed design avoids complex computations such as exponent,trigonometric function and multiplication,and reduces the complexity of hardware architecture and hardware resource consumption. The experimental results show that the proposed low-complexity fast SIFT hardware architecture can speed up by about200 times compared to the software implementation. Compared with the related research,the speed is improved by 3 times and the stability of the feature descriptor is increased by more than 18%.
引文
[1]王亭亭,蔡志浩,王英勋.无人机室内视觉/惯导组合导航方法[J].北京航空航天大学学报,2018,44(1):176-186.WANG T T,CAI Z H,WANG Y X. Integrated vision/inertial navigation method of UAVs in indoor environment[J]. Journal of Beijing University of Aeronautics and Astronautics,2018,44(1):176-186(in Chinese).
[2]LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision,2004,60(2):91-110.
[3]JIANG J,LI X,ZHANG G. SIFT hardware implementation for real-time image feature extraction[J]. IEEE Transactions on Circuits and Systems for Video Technology,2014,24(7):1209-1220.
[4]MA W,WEN Z,WU Y,et al. Remote sensing image registration with modified SIFT and enhanced feature matching[J]. IEEE Geoscience and Remote Sensing Letters,2017,14(1):3-7.
[5]LONG J,SHELHAMER E,DARRELL T. Fully convolutional networks for semantic segmentation[C]∥IEEE Conference on Computer Vision and Pattern Recognition. Piscataway,NJ:IEEE Press,2015:3431-3440.
[6]HE K,ZHANG X,REN S,et al. Deep residual learning for image recognition[C]∥IEEE Conference on Computer Vision and Pattern Recognition. Piscataway,NJ:IEEE Press,2016:770-778.
[7]VIJAY K B G,CARNEIRO G,REID I. Learning local image descriptors with deep siamese and triplet convolutional networks by minimizing global loss functions[C]∥IEEE Conference on Computer Vision and Pattern Recognition. Piscataway,NJ:IEEE Press,2016:5385-5394.
[8]王琳,刘强.基于局部特征的多目标图像分割算法[J].激光与光电子学进展,2018,55(6):061002.WANG L,LIU Q. A multi-object image segmentation algorithm based on local features[J]. Laser&Optoelectronics Progress,2018,55(6):061002(in Chinese).
[9]HEYMANN S,MLLER K,SMOLIC A,et al. SIFT implementation and optimization for general-purpose GPU[J]. Media Culture&Society,2007,67(1):7-13.
[10]ZHANG Q,CHEN Y,ZHANG Y,et al. SIFT implementation and optimization for multi-core systems[C]∥IEEE International Symposium on Parallel and Distributed Processing. Piscataway,NJ:IEEE Press,2008:1-8.
[11]LIU Q,LIU J,SANG R,et al. Fast neural network training on fpga using quasi-Newton optimization method[J]. IEEE Transactions on Very Large Scale Integration Systems,2018,26(8):1575-1579.
[12]VOURVOULAKIS J,KALOMIROS J,LYGOURAS J. FPGA accelerator for real-time SIFT matching with RANSAC support[J]. Microprocessors and Microsystems,2017,49:105-116.
[13]QASAIMEH M,SAGAHYROON A,SHANABLEH T. FPGAbased parallel hardware architecture for real-time image classification[J]. IEEE Transactions on Computational Imaging,2015,1(1):56-70.
[14]VOURVOULAKIS J,KALOMIROS J,LYGOURAS J. Fully pipelined FPGA-based architecture for real-time SIFT extraction[J]. Microprocessors and Microsystems,2016,40:53-73.
[15]CHIU L C,CHANG T S,CHEN J Y,et al. Fast SIFT design for real-time visual feature extraction[J]. IEEE Transactions on Image Processing,2013,22(8):3158-3167.
[2]LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision,2004,60(2):91-110.
[3]JIANG J,LI X,ZHANG G. SIFT hardware implementation for real-time image feature extraction[J]. IEEE Transactions on Circuits and Systems for Video Technology,2014,24(7):1209-1220.
[4]MA W,WEN Z,WU Y,et al. Remote sensing image registration with modified SIFT and enhanced feature matching[J]. IEEE Geoscience and Remote Sensing Letters,2017,14(1):3-7.
[5]LONG J,SHELHAMER E,DARRELL T. Fully convolutional networks for semantic segmentation[C]∥IEEE Conference on Computer Vision and Pattern Recognition. Piscataway,NJ:IEEE Press,2015:3431-3440.
[6]HE K,ZHANG X,REN S,et al. Deep residual learning for image recognition[C]∥IEEE Conference on Computer Vision and Pattern Recognition. Piscataway,NJ:IEEE Press,2016:770-778.
[7]VIJAY K B G,CARNEIRO G,REID I. Learning local image descriptors with deep siamese and triplet convolutional networks by minimizing global loss functions[C]∥IEEE Conference on Computer Vision and Pattern Recognition. Piscataway,NJ:IEEE Press,2016:5385-5394.
[8]王琳,刘强.基于局部特征的多目标图像分割算法[J].激光与光电子学进展,2018,55(6):061002.WANG L,LIU Q. A multi-object image segmentation algorithm based on local features[J]. Laser&Optoelectronics Progress,2018,55(6):061002(in Chinese).
[9]HEYMANN S,MLLER K,SMOLIC A,et al. SIFT implementation and optimization for general-purpose GPU[J]. Media Culture&Society,2007,67(1):7-13.
[10]ZHANG Q,CHEN Y,ZHANG Y,et al. SIFT implementation and optimization for multi-core systems[C]∥IEEE International Symposium on Parallel and Distributed Processing. Piscataway,NJ:IEEE Press,2008:1-8.
[11]LIU Q,LIU J,SANG R,et al. Fast neural network training on fpga using quasi-Newton optimization method[J]. IEEE Transactions on Very Large Scale Integration Systems,2018,26(8):1575-1579.
[12]VOURVOULAKIS J,KALOMIROS J,LYGOURAS J. FPGA accelerator for real-time SIFT matching with RANSAC support[J]. Microprocessors and Microsystems,2017,49:105-116.
[13]QASAIMEH M,SAGAHYROON A,SHANABLEH T. FPGAbased parallel hardware architecture for real-time image classification[J]. IEEE Transactions on Computational Imaging,2015,1(1):56-70.
[14]VOURVOULAKIS J,KALOMIROS J,LYGOURAS J. Fully pipelined FPGA-based architecture for real-time SIFT extraction[J]. Microprocessors and Microsystems,2016,40:53-73.
[15]CHIU L C,CHANG T S,CHEN J Y,et al. Fast SIFT design for real-time visual feature extraction[J]. IEEE Transactions on Image Processing,2013,22(8):3158-3167.
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |