2.845

2023影响因子

(CJCR)

  • 中文核心
  • EI
  • 中国科技核心
  • Scopus
  • CSCD
  • 英国科学文摘

留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

基于改进KAZE的无人机航拍图像拼接算法

韩敏 闫阔 秦国帅

韩敏, 闫阔, 秦国帅. 基于改进KAZE的无人机航拍图像拼接算法. 自动化学报, 2019, 45(2): 305-314. doi: 10.16383/j.aas.2018.c170521
引用本文: 韩敏, 闫阔, 秦国帅. 基于改进KAZE的无人机航拍图像拼接算法. 自动化学报, 2019, 45(2): 305-314. doi: 10.16383/j.aas.2018.c170521
HAN Min, YAN Kuo, QIN Guo-Shuai. A Mosaic Algorithm for UAV Aerial Image With Improved KAZE. ACTA AUTOMATICA SINICA, 2019, 45(2): 305-314. doi: 10.16383/j.aas.2018.c170521
Citation: HAN Min, YAN Kuo, QIN Guo-Shuai. A Mosaic Algorithm for UAV Aerial Image With Improved KAZE. ACTA AUTOMATICA SINICA, 2019, 45(2): 305-314. doi: 10.16383/j.aas.2018.c170521

基于改进KAZE的无人机航拍图像拼接算法

doi: 10.16383/j.aas.2018.c170521
基金项目: 

国家自然科学基金委科学仪器基础研究专项 51327004

国家自然科学基金 61773087

国家自然科学基金 61702077

中央高校基本科研业务费 DUT17ZD216

详细信息
    作者简介:

    闫阔  大连理工大学电子信息与电气工程学部硕士研究生.主要研究方向为图像拼接技术.E-mail:yankuo@mail.dlut.edu.cn

    秦国帅  大连理工大学建设工程学部博士研究生.主要研究方向为环境水资源系统分析.E-mail:qgs1991@mail.dlut.edu.cn

    通讯作者:

    韩敏  大连理工大学电子信息与电气工程学部教授.主要研究方向为模式识别, 复杂系统建模与分析及时间序列预测.本文通信作者.E-mail:minhan@dlut.edu.cn

A Mosaic Algorithm for UAV Aerial Image With Improved KAZE

Funds: 

Special Fund for Basic Research on Scientiflc Instruments of National Natural Science Foundation of China 51327004

National Natural Science Foundation of China 61773087

National Natural Science Foundation of China 61702077

Fundamental Research Funds for the Central Universities DUT17ZD216

More Information
    Author Bio:

     Master student at the Faculty of Electronic Information and Electrical Engineering, Dalian University of Technology. His main research interest is image stitching

     Ph. D. candidate at the Faculty of Infrastructure Engineering, Dalian University of Technology. His main research interest is system analysis of environment and water resources

    Corresponding author: HAN Min  Professor at the Faculty of Electronic Information and Electrical Engineering, Dalian University of Technology. Her research interest covers pattern recognition, modeling and analysis of complex system, and time series prediction. Corresponding author of this paper
  • 摘要: 为了更好地解决航拍图像易受光照、旋转变化、尺度变化等影响,KAZE算法实时性较差以及基于K近邻的特征匹配算法耗时较长等问题,该文提出了一种基于改进KAZE的无人机航拍图像拼接算法.该方法首先利用加速的KAZE算法提取图像的特征点,采用二进制特征描述子FREAK(Fast retina keypoint)进行特征点描述,然后使用Grid-KNN算法进行特征点粗匹配,利用随机一致性算法对匹配的特征点进一步提纯并计算几何变换模型,最后采用加权平均算法对图像进行融合.实验结果表明,该文所提算法使图像在光照变化、旋转变化及尺度变化下具有较好的性能,且处理速度较KAZE算法与K近邻特征匹配算法有较大提升,是一种稳定、精确度高、拼接效果良好的无人机航拍图像拼接方法.
    1)  本文责任编委 左旺孟
  • 图  1  FREAK算法采样模式

    Fig.  1  FREAK algorithm sampling mode

    图  2  FREAK算法主方向确定

    Fig.  2  Decision orientation of FREAK

    图  3  Grid-KNN匹配区域示意图

    Fig.  3  The diagram of Grid-KNN matching area

    图  4  基于改进KAZE算法无人机航拍图像拼接流程

    Fig.  4  The process of UAV aerial image mosaic based on improved KAZE algorithm

    图  5  实验数据

    Fig.  5  Experimental data

    图  6  Leuven数据和Boat数据匹配正确率比较

    Fig.  6  The comparison of correct matching rate for Leuven data and Boat data

    图  7  Leuven数据和Boat数据匹配精度比较

    Fig.  7  The comparison of matching accuracy for Leuven data and Boat data

    图  8  图像配准结果

    Fig.  8  The results of matching

    图  9  图像拼接结果

    Fig.  9  The results of stitching

    表  1  特征点提取平均用时比较(ms)

    Table  1  The comparison of feature point extraction average time (ms)

    图像编号 SIFT ORB KAZE 本文算法
    Leuven 2.184 0.032 2.331 0.941
    Boat 2.965 0.036 2.564 0.783
    图 5 (a) 5.586 0.216 5.541 2.908
    图 5 (b) 8.238 0.222 6.000 3.748
    图 5 (c) 4.161 0.151 5.247 2.726
    下载: 导出CSV

    表  2  特征匹配平均用时比较(ms)

    Table  2  The comparison of feature matching average time (ms)

    图像编号 SIFT ORB KAZE 本文算法
    Leuven 0.431 0.268 0.305 0.174
    Boat 1.097 0.530 0.291 0.253
    图 5 (a) 0.992 0.460 1.205 0.324
    图 5 (b) 1.159 0.359 1.560 0.239
    图 5 (c) 1.200 0.331 1.242 0.219
    下载: 导出CSV

    表  3  匹配正确率比较

    Table  3  The comparison of correct matching rate

    图像编号 算法 匹配点对数 正确点对数 CMR (%)
    SIFT 1 492 1 359 91.15
    图 5 (a) ORB 2 253 2 092 81.94
    KAZE 1 427 1 436 99.93
    本文算法 1 358 1356 99.85
    SIFT 1 212 1 063 87.71
    图 5 (b) ORB 1 340 995 74.25
    KAZE 1 415 1 294 91.45
    本文算法 1 280 1 159 90.55
    SIFT 1 527 1 464 95.87
    图 5 (c) ORB 1 573 1 130 71.84
    KAZE 1 438 1 392 96.80
    本文算法 1 285 1 222 95.12
    下载: 导出CSV

    表  4  配准精度比较

    Table  4  The comparison of matching accuracy

    图像编号 SIFT ORB KAZE 本文算法
    图 5 (a) 0.443 1.530 0.356 0.367
    图 5 (b) 0.509 1.729 0.446 0.489
    图 5 (c) 0.158 1.200 0.124 0.152
    下载: 导出CSV
  • [1] Li Z Q, Isler V. Large scale image mosaic construction for agricultural applications. IEEE Robotics and Automation Letters, 2016, 1(1):295-302 doi: 10.1109/LRA.2016.2519946
    [2] 李岩山, 裴继红, 谢维信, 李良群.一种新的无人机航拍序列图像快速拼接方法.电子学报, 2012, 40 (5):935-940 http://d.old.wanfangdata.com.cn/Periodical/dianzixb201205012

    Li Yan-Shan, Pei Ji-Hong, Xie Wei-Xin, Li Liang-Qun. A new fast automatic mosaic method on unmanned aerial vehicle images. Acta Electronica Sinica, 2012, 40(5):935-940 http://d.old.wanfangdata.com.cn/Periodical/dianzixb201205012
    [3] Tsai C H, Lin Y C. An accelerated image matching technique for UAV orthoimage registration. ISPRS Journal of Photogrammetry and Remote Sensing, 2017, 128:130-145 doi: 10.1016/j.isprsjprs.2017.03.017
    [4] Ghosh D, Kaabouch N. A survey on image mosaicing techniques. Journal of Visual Communication and Image Representation, 2016, 34:1-11 doi: 10.1016/j.jvcir.2015.10.014
    [5] Wang Z C, Chen Y F, Zhu Z W, Zhao W D. An automatic panoramic image mosaic method based on graph model. Multimedia Tools and Applications, 2016, 75(5):2725-2740 doi: 10.1007/s11042-015-2619-0
    [6] 张桂梅, 孙晓旭, 刘建新, 储珺.基于分数阶微分的TV-L1光流模型的图像配准方法研究.自动化学报, 2017, 43(12):2213-2224 http://www.aas.net.cn/CN/abstract/abstract19194.shtml

    Zhang Gui-Mei, Sun Xiao-Xu, Liu Jian-Xin, Chu Jun. Research on TV-L1 optical flow model for image registration based on fractional-order differentiation. Acta Automatica Sinica, 2017, 43(12):2213-2224 http://www.aas.net.cn/CN/abstract/abstract19194.shtml
    [7] 蔡国榕, 李绍滋, 吴云东, 苏松志, 陈水利.一种透视不变的图像匹配算法.自动化学报, 2013, 39(7):1053-1061 http://www.aas.net.cn/CN/abstract/abstract18133.shtml

    Cai Guo-Rong, Li Shao-Zi, Wu Yun-Dong, Su Song-Zhi, Chen Shui-Li. A perspective invariant image matching algorithm. Acta Automatica Sinica, 2013, 39(7):1053-1061 http://www.aas.net.cn/CN/abstract/abstract18133.shtml
    [8] Harris C, Stephens M. A combined corner and edge detector. In: Proceedings of the 4th Alvey Vision Conference. Manchester, UK: Alvety Vision Club, 1988. 4-151
    [9] Smith S M, Brady J M. SUSAN-A new approach to low level image processing. International Journal of Computer Vision, 1997, 23(1):45-78 doi: 10.1023/A:1007963824710
    [10] Lowe D G. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 2004, 60(2):91-110 doi: 10.1023/B:VISI.0000029664.99615.94
    [11] 颜雪军, 赵春霞, 袁夏. 2DPCA-SIFT:一种有效的局部特征描述方法.自动化学报, 2014, 40(4):675-682 http://www.aas.net.cn/CN/abstract/abstract18333.shtml

    Yan Xue-Jun, Zhao Chun-Xia, Yuan Xia. 2DPCA-SIFT:an efficient local feature descriptor. Acta Automatica Sinica, 2014, 40(4):675-682 http://www.aas.net.cn/CN/abstract/abstract18333.shtml
    [12] Bay H, Ess A, Tuytelaars T, Van Gool L. Speeded-up robust features (SURF). Computer Vision and Image Understanding, 2008, 110(3):346-359 doi: 10.1016/j.cviu.2007.09.014
    [13] 闫自庚, 蒋建国, 郭丹.基于SURF特征和Delaunay三角网格的图像匹配.自动化学报, 2014, 40(6):1216-1222 http://www.aas.net.cn/CN/abstract/abstract18392.shtml

    Yan Zi-Geng, Jiang Jian-Guo, Guo Dan. Image matching based on SURF feature and Delaunay triangular meshes. Acta Automatica Sinica, 2014, 40(6):1216-1222 http://www.aas.net.cn/CN/abstract/abstract18392.shtml
    [14] Rublee E, Rabaud V, Konolige K, Bradski G. ORB: an efficient alternative to SIFT or SURF. In: Proceedings of the 2011 IEEE International Conference on Computer Vision. Barcelona, Spain: IEEE, 2011. 2564-2571
    [15] 杜承垚, 袁景凌, 陈旻骋, 李涛. GPU加速与L-ORB特征提取的全景视频实时拼接.计算机研究与发展, 2017, 54(6):1316-1325 http://d.old.wanfangdata.com.cn/Periodical/jsjyjyfz201706014

    Du Cheng-Yao, Yuan Jing-Ling, Chen Min-Cheng, Li Tao. Real-time panoramic video stitching based on GPU acceleration using Local ORB feature extraction. Journal of Computer Research and Development, 2017, 54(6):1316-1325 http://d.old.wanfangdata.com.cn/Periodical/jsjyjyfz201706014
    [16] Leutenegger S, Chli M, Siegwart R Y. BRISK: binary robust invariant scalable keypoints. In: Proceedings of 2011 IEEE International Conference on Computer Vision. Barcelona, Spain: IEEE, 2011. 2548-2555
    [17] 董强, 刘晶红, 王超, 周前飞.基于改进BRISK的图像拼接算法.电子与信息学报, 2017, 39(2):444-450 http://d.old.wanfangdata.com.cn/Periodical/dzkxxk201702027

    Dong Qiang, Liu Jing-Hong, Wang Chao, Zhou Qian-Fei. Image mosaic algorithm based on improved BRISK. Journal of Electronics & Information Technology, 2017, 39(2):444-450 http://d.old.wanfangdata.com.cn/Periodical/dzkxxk201702027
    [18] Alcantarilla P F, Bartoli A, Davison A J. KAZE features. In: Proceedings of the 12th European Conference on Computer Vision. Florence, Italy: Springer, 2012. 214-227
    [19] Mukherjee P, Lall B. Saliency and KAZE features assisted object segmentation. Image and Vision Computing, 2017, 61:82-97 doi: 10.1016/j.imavis.2017.02.008
    [20] Alcantarilla P, Nuevo J, Bartoli A. Fast explicit diffusion for accelerated features in nonlinear scale spaces. In: Proceedings of British Machine Vision Conference. Bristol, England, UK: BMVC, 2013. 13.1-13.11
    [21] Alahi A, Ortiz R, Vandergheynst P. Freak: fast retina keypoint. In: Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. Providence, RI, USA: IEEE, 2012. 510-517
    [22] Ma X M, Liu D, Zhang J, Xin J. A fast affine-invariant features for image stitching under large viewpoint changes. Neurocomputing, 2015, 151:1430-1438 doi: 10.1016/j.neucom.2014.10.045
    [23] Tuytelaars T, Mikolajczyk K. Local invariant feature detectors:a survey. Foundations and Trends in Computer Graphics and Vision, 2008, 3(3):177-280 http://d.old.wanfangdata.com.cn/NSTLHY/NSTL_HYCC0214006632/
    [24] Bian J W, Lin W Y, Matsushita Y, Yeung S T, Nguyen T D, Cheng M M. GMS: grid-based motion statistics for fast, ultra-robust feature correspondence. In: Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI, USA: IEEE, 2017. 2828-2837
  • 加载中
图(9) / 表(4)
计量
  • 文章访问数:  2819
  • HTML全文浏览量:  813
  • PDF下载量:  717
  • 被引次数: 0
出版历程
  • 收稿日期:  2017-09-13
  • 录用日期:  2018-01-20
  • 刊出日期:  2019-02-20

目录

    /

    返回文章
    返回