用户名: 密码: 验证码:
基于多视角图像的植物三维重建研究进展
详细信息    查看全文 | 推荐本文 |
  • 英文篇名:Research Progress on Plant Three-dimensional Reconstruction Based on Multi-view Images
  • 作者:周静静 ; 郭新 ; 吴升 ; 杜建军 ; 赵春江
  • 英文作者:ZHOU Jingjing;GUO Xinyu;WU Sheng;DU Jianjun;ZHAO Chunjiang;College of Information Technology ,Shanghai Ocean University;Beijing Research Center for Information Technology in Agricultural;Beijing Key Laboratory of Digital Plant,Beijing Academy of Agriculture and Forestry Sciences;
  • 关键词:三维重建 ; 植物表型 ; 运动恢复结构 ; 多视角立体视觉 ; 高通量表型
  • 英文关键词:three-dimensional reconstruction;;plant phenotype;;structure from motion;;multi-view stereo;;high-throughput phenotype
  • 中文刊名:NKDB
  • 英文刊名:Journal of Agricultural Science and Technology
  • 机构:上海海洋大学信息学院;北京农业信息技术研究中心;北京市农林科学院数字植物北京市重点实验室;
  • 出版日期:2019-02-15
  • 出版单位:中国农业科技导报
  • 年:2019
  • 期:v.21;No.138
  • 基金:国家自然科学基金项目(31671577);; 国家重点研发计划项目(2016YFD0300605-01);; 北京市农林科学院创新能力建设专项(KJCX20180423);北京市农林科学院数字植物科技创新团队项目(JNKYT201604)资助
  • 语种:中文;
  • 页:NKDB201902002
  • 页数:10
  • CN:02
  • ISSN:11-3900/S
  • 分类号:15-24
摘要
快速重建植株三维结构并以三维可视的方式分析研究农作物的形态结构和生长过程、进行表型测量是数字植物及作物育种研究的热点和难点。概述了植物三维重建的研究现状和主流植物三维重建技术,并对各种技术的方法原理和技术优势进行了分类和对比;重点介绍了基于多视角图像三维重建方法 SFM和MVS的研究进展、技术原理以及相关软硬件系统平台;分析了近几年基于多视角图像三维重建方法在植物三维重建中的应用进展,基于多视角图像三维重建方法具有数据获取成本低、获取点云精度高、植物三维重建质量高等技术优势,同时指出了该技术方法的不足之处和未来技术发展趋势,以期为植物三维重建技术的发展、植物表型组学的研究以及低成本高通量设备的研制提供有益参考。
        Rapid reconstruction of plant three-dimensional structure and three-dimensional visual analysis of crop morphological structure,growth process and phenotype measurement are hot and difficult points in digital plant and crop breeding research. This paper summarized the research status and the mainstream technology of plant three-dimensional reconstruction,and classified and compared the methods,principles and technical advantages of various technologies. The research progress,technical principle and related hardware and software system platform of multiview image three-dimensional reconstruction method SFM and MVS were emphatically introduced,and the application progress of multi-perspective image three-dimensional reconstruction in plant three-dimensional reconstruction in recent years were analyzed,the multi-perspective image three-dimensional reconstruction method had the advantages of low cost of data acquisition,high precision of point cloud acquisition and high quality of plant three-dimensional reconstruction. At the same time,the paper also pointed out the shortcomings of this technology and its future development trend,expected to provide useful reference for the development of plant three-dimensional reconstruction technology,the study of plant phenotypic omics and the development of low-cost and high-throughput equipment.
引文
[1]夏春华,施滢,尹文庆.基于TOF深度传感的植物三维点云数据获取与去噪方法[J].农业工程学报,2018,34(6):168-174.Xia C H,Shi Y,Yin W Q.Research on the obtaining and denoising method of plants 3D point cloud data based on TOFdepth sensor[J].Trans.CSAE,2018,34(6):168-174.
    [2]郭新宇,赵春江,肖伯祥,等.玉米三维重构及可视化系统的设计与实现[J].农业工程学报,2007,23(4):144-148.Guo X Y,Zhao C J,Xiao B X,et al..Design and implementation of three-dimensional geometric morphological modeling and visualization system for maize[J].Trans.CSAE,2007,23(4):144-148.
    [3]黄伟.基于植物生长过程仿真的虚拟植物建模研究[D].重庆:重庆大学,硕士学位论文,2011.Huang W.Study on growth modeling of virtual plant based on simulation of growth process[D].Chongqing:Chongqing University,Master Dissertation,2011.
    [4]田丰,常龙昆.基于三层植物模型的大规模植物模拟方法[J].计算机应用研究,2017,34(10):3181-3183.Tian F,Chang L K.Large-scale plant simulation method based on three-layer plant model[J].J.Comp.Appl.,2017,34(10):3181-3183.
    [5]柴靓,何靖,高志宏,等.植物叶片发育及形态建成的研究进展[J].种子,2018(3):46-48.Chai L,He J,Gao Z H,et al..Advances in plant leaf development and morphogenesis research[J].Seeds,2018(3):46-48.
    [6]侯彤瑜.高精度作物冠层结构模型的构建及应用[D].北京:中国农业大学,博士学位论文,2016.Hou T Y.The constructions and applications of the highprecision sturctural models of crop canopy[D].Beijing:China Agricultural University,Doctor Dissertation,2016.
    [7]王洋,肖文,邹焕成,等.基于PROSPECT模型的植物叶片干物质估测建模研究[J].沈阳农业大学学报,2018,49(1):121-127.Wang Y,Xiao W,Zou H C,et al..Plant leaf dry matter estimating and modeling based on PROSPECT model[J].J.Shenyang Agric.Univ.,2018,49(1):121-127.
    [8]胡鹏程,郭焱,李保国,等.基于多视角立体视觉的植株三维重建与精度评估[J].农业工程学报,2015,31(11):209-214.Hu P C,Guo Y,Li B G,et al..Three-dimensional reconstruction and its precision evaluation of plant architecture based on multiple view stereo method[J].Trans.CSAE,2015,31(11):209-214.
    [9]温维亮,赵春江,郭新宇,等.基于t分布函数的玉米群体三维模型构建方法[J].农业工程学报,2018,34(4):192-200.Wen W L,Zhao C J,Guo X Y,et al..Construction method of three-dimensional model of maize colony based on t-distribution function[J].Trans.CSAE,2018,34(4):192-200.
    [10]刘刚,司永胜,冯娟.农林作物三维重建方法研究进展[J].农业机械学报,2014,45(6):38-46.Liu G,Si Y S,Feng J.3D reconstruction of agriculture and forestry crops[J].Trans.CSAM,2014,45(6):38-46.
    [11]胡秀珍.梨树枝干模型构建与三维实现[D].合肥:中国科学技术大学,硕士学位论文,2011.Hu X Z.3D visualization of trunk and branch model of pear tree[D].Hefei:University of Science and Technology of China,Master Dissertation,2011.
    [12]徐超,李乔.基于计算机视觉的三维重建技术综述[J].数字技术与应用,2017,28(1):54-56.
    [13]温维亮.基于三维数字化的玉米株型参数提取方法研究[J].中国农业科学,2018,51(6):1034-1044.Wen W L.Research on maize plant type parameter extraction by using three dimensional digitizing data[J].Chin.Agric.Sci.,2018,51(6):1034-1044.
    [14]丁少闻,张小虎,于起峰,等.非接触式三维重建测量方法综述[J].激光与光电子学进展,2017,54(7):21-35.Ding S W,Zhang X H,Yu Q F,et al..Overview of noncontact 3D reconstruction measurement methods[J].Adv.Laser Optoelectron.,2017,54(7):21-35.
    [15]范宇.SY C-1型铁路建筑限界检测仪的设计与应用[J].中国新技术新产品,2014(10):72-73.
    [16]殷小舟.基于图像的花卉植物三维重建技术研究[D].北京:北京林业大学,硕士学位论文,2013.Yin X Z.Research on image-based three-dimensional flower reconstruction[D].Beijing:Beijing Forestry University,Master Dissertation,2013.
    [17]初广丽,张伟,王延杰,等.基于机器视觉的水果采摘机器人目标识别方法[J].中国农机化学报,2018(2):83-88.Chu G L,Zhang W,Wang Y J,et al..A method of fruit picking robot target identification based on machine vision[J].Chin.J.Agric.Mechan.,2018(2):83-88.
    [18]邓晓辉.基于彩色结构光系统的三维视觉[D].杭州:浙江工业大学,硕士学位论文,2009.Deng X H.3D computer vision based on color structured light system[D].Hangzhou:Zhejiang University of Technology,Master Dissertation,2009.
    [19]佟帅,徐晓刚,易成涛,等.基于视觉的三维重建技术综述[J].计算机应用研究,2011,28(7):2411-2417.Tong S,Xu X G,Yi C T,et al..Overview on vision-based 3Dreconstruction[J].J.Comp.Appl.,2011,28(7):2411-2417.
    [20]Westoby M J,Brasington J,Glasser N F,et al..‘Structurefrom-Motion’photogrammetry:A low-cost,effective tool for geoscience applications[J].Geomorphology,2012,179:300-314.
    [21]周骏.多视图图像三维重建若干关键技术研究[D].成都:电子科技大学,博士学位论文,2018.Zhou J.Research on some key issues for 3D reconstruction using multi-view image[D].Chengdu:University of Electronic Science and Technology,Doctor Dissertation,2018.
    [22]Lhuillier M,Quan L.A Quasi-dense approach to surface reconstruction from uncalibrated images[J].IEEE Trans.Pattern Anal.Machine Intelligence,2005,27(3):418-433.
    [23]Furukawa Y,Ponce J.Accurate,dense,and robust multiview stereopsis[J].IEEE Trans.Pattern Anal.Machine Intelligence,2010,32(8):1362-1376.
    [24]Longuethiggins H C.A computer algorithm for reconstructing a scene from two projections[J].Nature,1981,293(5828):133-135.
    [25]Seitz S M,Curless B,Diebel J,et al..A comparison and evaluation of multi-view stereo reconstruction algorithms[A].In:IEEE Computer Society Conference on Computer Vision&Pattern Recognition[C].New York,2006.
    [26]Lou L,Liu Y,Han J,et al..Accurate multi-view stereo 3Dreconstruction for cost-effective plant phenotyping[A].In:International Conference Image Analysis and Recognition[C].Portugal Vilamoura,2014.
    [27]郭志勇.多视影像密集匹配点云分类与测图应用研究[D].北京:中国地质大学,硕士学位论文,2017.Guo Z Y.Research on classification and mapping application of dense point cloud of multi-view image matching[D].Beijing:China University of Geosciences,Master Dissertation,2017.
    [28]孟超.基于有序图像的三维重建技术研究[D].哈尔滨:哈尔滨工业大学,硕士学位论文,2012.Meng C.3D reconstruction research based on ordered images[D].Harbin:Harbin Institute of Technology,Master Dissertation,2012.
    [29]Snavely N.Bundler:Structure from motion for unordered image collections[J].J.Institute Image Inform.Television Engin.,2011,65(4):479-482.
    [30]魏占玉,Arrowsmith Ramon,何宏林,等.基于Sf M方法的高密度点云数据生成及精度分析[J].地震地质,2015,37(2):636-648.Wei Z Y,Ramon A,He H L,et al..Accuracy analysis of terrain point cloud acquired by“Structure from Motion”using aerial photos[J].Seismol.Geol.,2015,37(2):636-648.
    [31]李俊利,李斌兵,柳方明,等.利用照片重建技术生成坡面侵蚀沟三维模型[J].农业工程学报,2015,31(1):125-132.Li J L,Li B B,Liu F M,et al..Generating 3D model of slope eroded gully based on photo reconstruction technique[J].Trans.CSAE,2015,31(1):125-132.
    [32]Goesele M,Curless B,Seitz S M.Multi-view stereo revisited[A].In:IEEE Computer Society Conference on Computer Vision and Pattern Recognition[C].New York,2006.
    [33]Snavely N,Seitz S M,Szeliski R.Photo tourism:Exploring photo collections in 3D[J].ACM Trans.Graphics,2006,25(3):835-846.
    [34]曹明伟,李书杰,贾伟,等.面向大规模SFM的快速鲁棒特征跟踪算法[J].仪器仪表学报,2017,38(1):252-260.Cao M W,Li S J,Jia W,et al..Fast and robust feature tracking algorithm for large-scale SFM[J].Chin.J.Sci.Instrument,2017,38(1):252-260.
    [35]Wu C C.Towards linear-time incremental structure from motion[A].In:Proceedings of 2013 International Conference on 3DVision[C].USA Seattle,2013.
    [36]Heller J,Havlena M,Jancosek M,et al..3D reconstruction from photographs by CMP Sf M web service[A].In:Proceedings of the 14th IAPR International Conference on Machine Vision Applications[C].Japan Tokyo,2015.
    [37]Fuhrmann S,Langguth F,Moehrle N,et al..MVE:An imagebased reconstruction environment[J].Comp.Graphics,2015,53(A):44-53.
    [38]Wenzel K,Rothermel M,Haala N,et al..SURE-The ifp software for dense image matching[A].In:Proceedings of Photogrammetric Week,2013[C].Germany Stuttgart,2013.
    [39]Cignoni P,Callieri M,Corsini M,et al..Mesh Lab:An opensource mesh processing tool[A].In:Eurographics Italian Chapter Conference 2008[C].Italy Salerno,2008.
    [40]汪雅婕.Pix4Dmapper在无人机航摄应急救灾项目中的应用研究[J].测绘与空间地理信息,2016(9):202-203.Wang Y J.Application and research of Pix4Dmapper in UAVAerophotography for emergency projection[J].Surv.Spatial Geography Inform.,2016(9):202-203.
    [41]Li J,Shi J.The research of 3D reconstruction based on openCV[J].Microelectron.Comp.,2008,25(12):29-32.
    [42]Moulon P,Monasse P,Perrot R,et al..OpenMVG:Open multiple view geometry[A].In:International Workshop on Reproducible Research in Pattern Recognition[C].Mexico Cancún,2016.
    [43]Apollonio F I,Ballabeni M,Giani M.Color enhanced pipelines for reality-based 3D modeling of on site medium sized archeological artifacts[J].Virtual Archaeol.Rev.,2014,5:59-76.
    [44]冯嘉.SIFT算法的研究和改进[D].长春:吉林大学,硕士学位论文,2010.Feng J.The research and improvement of SIFT algorithm[D].Changchun:Jilin University,Master Dissertation,2010.
    [45]Zhang Y,Teng P,Shimizu Y,et al..Estimating 3D leaf and stem shape of nursery paprika plants by a novel multi-camera photography system[J].Sensors,2016,16(6):874.
    [46]Jay S,Rabatel G,Hadoux X,et al..In-field crop row phenotyping from 3D modeling performed using structure from motion[J].Comp.Electron.Agric.,2015,110:70-77.
    [47]Anthony P,Xavier S,Scott B,et al..A novel mesh processing based technique for 3D plant analysis[J].BMC Plant Biol.,2012,12:63.
    [48]Rose J C,Paulus S,Kuhlmann H.Accuracy analysis of a multi-view stereo approach for phenotyping of tomato plants at the organ level[J].Sensors,2015,15(5):9651-9665.
    [49]Miller J,Morgenroth J,Gomez C.3D modelling of individual trees using a handheld camera:Accuracy of height,diameter and volume estimates[J].Urban Forestry Urban Greening,2015,14(4):932-940.
    [50]Hui F,Zhu J Y,Hu P C,et al..Image-based dynamic quantification and high-accuracy 3D evaluation of canopy structure of plant populations[J].Ann.Bot.,2018,121(5):1079-1088.
    [51]Syngelaki M,Hardner M,Oberthuer P,et al..A new method for non-invasive biomass determination based on stereo photogrammetry[J].Bioproc.Biosyst.Engin.,2018,41(3):369-380.
    [52]He J Q,Harrison R J,Li B.A novel 3D imaging system for strawberry phenotyping[J].Plant Methods,2017,13(1):93.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700