增强现实环境下的CPS虚拟装配系统研究与实现
|
摘要
基于双目视觉原理,利用Unity3D游戏引擎开发了一种增强现实环境下的信息物理融合(cyber-physical systems, CPS)虚拟装配系统。通过研究快速定位算法识别特征标记点建立虚拟模型与实物装配单元的配准关系,融合虚拟模型投影图像与实物装配体图像实现虚拟装配仿真,实时输出在视频眼镜结构中显示。经过试验验证,该系统满足CPS实时性、稳定性以及信息世界与物理世界融合的要求。
Based on the principle of binocular vision, a virtual assembly system of cyber-physical systems(CPS) in augmented reality environment was developed by using Unity3 D game engine. The registration relationship between virtual model and real assembly unit was established by studying the fast location algorithm through identifying the feature marker points. The virtual assembly simulation was realized by fusing the projection image of virtual model and the real assembly image, and the real-time output was displayed by the video glasses. The experimental results show that the system meets the requirements of real-time CPS, stability and integration of information world and physical world.
Based on the principle of binocular vision, a virtual assembly system of cyber-physical systems(CPS) in augmented reality environment was developed by using Unity3 D game engine. The registration relationship between virtual model and real assembly unit was established by studying the fast location algorithm through identifying the feature marker points. The virtual assembly simulation was realized by fusing the projection image of virtual model and the real assembly image, and the real-time output was displayed by the video glasses. The experimental results show that the system meets the requirements of real-time CPS, stability and integration of information world and physical world.
引文
[1] YU Xiaoyu,ZHANG Fengjun,DAI Guozhong.Virtual assembly in tangible user interface[J].Journal of Image and Graphics A,2010,15(8):1151-1157.喻晓宇,张凤军,戴国忠.实物界面下的虚拟装配[J].中国图象图形学报A,2010,15(8):1151-1157.
[2] GAO Kang,FAN Jingsong,SHAO Ming,et al.Research and realization of virtual assembly in augmented reality[J].Mechanical & Electrical Engineering Technology,2012,41(9):60-63.高康,范劲松,邵明,等.增强现实环境中虚拟装配的研究与实现[J].机电工程技术,2012,41(9):60-63.
[3] ZHANG Shu.Industrial 4.0 and intelligent manufacturing[J].Machine Design and Manufacturing Engeering.2014,43(8):1-5.张曙.工业4.0和智能制造[J].机械设计与制造工程,2014,43(8):1-5.
[4] IMRAN Q ,ALESSANDRA B,ETIENNE B,et al.Modeling methodologies for cyber-physical systems:research field study on inherent and future challenges[J].Ada User Journal,2015,36(4):246.
[5] WEN Jingrong,WU Muqing,SU Jingfang.Cyber-physical system[J].Acta Automatica Sinica,2012,38(4):507-517.温景容,武穆清,宿景芳.信息物理融合系统[J].自动化学报,2012,38(4):507-517.
[6] LIU Xiangzhi,LIU Xiaojian,WANG Zhixue,et al.A cyber-physical system[J].Shandong Science,2010,23(3):56-61.刘祥志,刘晓建,王知学,等.信息物理融合系统[J].山东科学,2010,23(3):56-61.
[7] AZUMA R T.A survey of augmented reality[J].Presence:Teleoperators and Virtual Environments,1997,6(4):355-385.
[8] HENDERSON S J,FEINER S K.Augmented reality in the psychomotor phase of a procedural task:2011 10th IEEE International Symposium on Mixed and Augmented Reality,Basel,October 26-29,2011[C].USA:IEEE,2011:191-200.
[9] HENDERSON S,FEINER S.Exploring the benefits of augmented reality documentation for maintenance and repair[J].IEEE Transactions on Visualization and Computer Graphics,2011,17(10):1355-1368.
[10] HENDERSON S,FEINER S.Opportunistic tangible user interfaces for augmented reality[J].IEEE Transactions on Visualization and Computer Graphics,2010,16(1):4-16.
[11] HENDERSON S J,FEINER S.Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret:2009 8th IEEE International Symposium on Mixed and Augmented Reality,Orlando,October 19-22,2009[C].USA:IEEE,2009:135-144.
[12] SHEN Ke,PENG Taile.Object recognition and virtual interaction of IOT based on augmented reality[J].Computer Engineering,2010,36(17):98-101,104.沈克,彭太乐.基于增强现实的物联网物体识别与虚拟交互[J].计算机工程,2010,36(17):98-101,104.
[13] ZHANG Xian,ZHANG Guobin,WANG Yangyu,et al.Flexible polishing process research of free-form surface mold based on attitude control[J].Journal of Zhejiang University of Technology,2010,38(3):237-241.张宪,张国斌,王扬渝,等.基于姿态控制的模具自由曲面柔性抛光过程研究[J].浙江工业大学学报,2010,38(3):237-241.
[14] ZHI Jianhui,DONG Xinmin,KONG Xingwei,et al.Analysis of external influence factors in camera calibration.Journal of Applied Optics.2014,35(2),286-291.支健辉,董新民,孔星炜,等.相机标定的外界影响因素分析[J].应用光学,2014,35(2),286-291
[15] WANG Jing,LI Shuangjiang,TIAN Shizhu.Application of binocular stereo vision technology in structural test[J].Journal of Applied Optics.2018,39 (6):821-826.王婧,李双江,田石柱.双目立体视觉技术在结构试验中的应用[J].应用光学.2018,39 (6):821-826.
[16] ZHAO Shan.Measuring method research of deformation displacement about structure specimen in the shaking table test under monocular vision[D].[s.n.]:[S.l.],2016.
[2] GAO Kang,FAN Jingsong,SHAO Ming,et al.Research and realization of virtual assembly in augmented reality[J].Mechanical & Electrical Engineering Technology,2012,41(9):60-63.高康,范劲松,邵明,等.增强现实环境中虚拟装配的研究与实现[J].机电工程技术,2012,41(9):60-63.
[3] ZHANG Shu.Industrial 4.0 and intelligent manufacturing[J].Machine Design and Manufacturing Engeering.2014,43(8):1-5.张曙.工业4.0和智能制造[J].机械设计与制造工程,2014,43(8):1-5.
[4] IMRAN Q ,ALESSANDRA B,ETIENNE B,et al.Modeling methodologies for cyber-physical systems:research field study on inherent and future challenges[J].Ada User Journal,2015,36(4):246.
[5] WEN Jingrong,WU Muqing,SU Jingfang.Cyber-physical system[J].Acta Automatica Sinica,2012,38(4):507-517.温景容,武穆清,宿景芳.信息物理融合系统[J].自动化学报,2012,38(4):507-517.
[6] LIU Xiangzhi,LIU Xiaojian,WANG Zhixue,et al.A cyber-physical system[J].Shandong Science,2010,23(3):56-61.刘祥志,刘晓建,王知学,等.信息物理融合系统[J].山东科学,2010,23(3):56-61.
[7] AZUMA R T.A survey of augmented reality[J].Presence:Teleoperators and Virtual Environments,1997,6(4):355-385.
[8] HENDERSON S J,FEINER S K.Augmented reality in the psychomotor phase of a procedural task:2011 10th IEEE International Symposium on Mixed and Augmented Reality,Basel,October 26-29,2011[C].USA:IEEE,2011:191-200.
[9] HENDERSON S,FEINER S.Exploring the benefits of augmented reality documentation for maintenance and repair[J].IEEE Transactions on Visualization and Computer Graphics,2011,17(10):1355-1368.
[10] HENDERSON S,FEINER S.Opportunistic tangible user interfaces for augmented reality[J].IEEE Transactions on Visualization and Computer Graphics,2010,16(1):4-16.
[11] HENDERSON S J,FEINER S.Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret:2009 8th IEEE International Symposium on Mixed and Augmented Reality,Orlando,October 19-22,2009[C].USA:IEEE,2009:135-144.
[12] SHEN Ke,PENG Taile.Object recognition and virtual interaction of IOT based on augmented reality[J].Computer Engineering,2010,36(17):98-101,104.沈克,彭太乐.基于增强现实的物联网物体识别与虚拟交互[J].计算机工程,2010,36(17):98-101,104.
[13] ZHANG Xian,ZHANG Guobin,WANG Yangyu,et al.Flexible polishing process research of free-form surface mold based on attitude control[J].Journal of Zhejiang University of Technology,2010,38(3):237-241.张宪,张国斌,王扬渝,等.基于姿态控制的模具自由曲面柔性抛光过程研究[J].浙江工业大学学报,2010,38(3):237-241.
[14] ZHI Jianhui,DONG Xinmin,KONG Xingwei,et al.Analysis of external influence factors in camera calibration.Journal of Applied Optics.2014,35(2),286-291.支健辉,董新民,孔星炜,等.相机标定的外界影响因素分析[J].应用光学,2014,35(2),286-291
[15] WANG Jing,LI Shuangjiang,TIAN Shizhu.Application of binocular stereo vision technology in structural test[J].Journal of Applied Optics.2018,39 (6):821-826.王婧,李双江,田石柱.双目立体视觉技术在结构试验中的应用[J].应用光学.2018,39 (6):821-826.
[16] ZHAO Shan.Measuring method research of deformation displacement about structure specimen in the shaking table test under monocular vision[D].[s.n.]:[S.l.],2016.
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |