用户名: 密码: 验证码:
增强现实环境下车间布局设计的注册与协同交互研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
传统车间布局辅助设计的研究主要是从定量的指标上对生成车间进行最优求解,如设备或单元之间的材料流、工件流以及空间利用率等问题上进行最优求解。本文立足于定性分析的角度在传统车间布局辅助设计的基础上引入增强现实(Augmented Reality, AR)技术,针对在增强现实环境下的网络协同式车间布局系统的特点,着重对混合环境下的注册技术、人机交互技术以及网络协同三个关键技术问题进行研究,以望能突破目前车间布局系统难以进行定性分析的瓶颈。本文主要的研究内容及相应的研究方法有以下几个方面:
     首先根据增强现实环境下车间布局系统布局范围的特点,选定相应注册算法,该算法既要保证注册的精度又要满足注册范围的要求。基于以上的事实本文将基于视觉注册与电磁跟踪的注册结合在一起组成了一种混合注册算法。在推导混合注册算法的过程中本文做了两个假设:一是磁跟踪设备不受周边环境的影响;二是发射器和标志物的坐标系完全重合。为了解决假设导致注册精度下降的问题,本文提出了自适应区域基准法来控制误差使其满足增强现实环境下车间布局设计系统的要求。
     其次本文设计了一种在增强现实环境下能被计算机视觉所识别的标志工具—魔法棒。这种魔法棒的正反两面都带有能被计算机所识别的不同标志物等特点,本文充分地利用这一特点来定义并实现了车间布局操作过程中所用到的四种语义模型(选定、平移、旋转、删除)。此外,为了让魔法棒与虚拟模型之间能够正确显示它们之间遮挡关系,采用虚拟替身的方法并贴合到真实的魔法棒中把虚实遮挡问题转化为虚拟物体之间的遮挡问题。
     协同设计被誉为是一种“以人为本”的设计方法,本文将这种思想引入车间布局系统中。首先为多用户协同通信设计了格式统一的通信命令,利用资源锁的方法解决了多用户对同一虚拟模型竞争所产生的冲突问题。通过实验测试并着重解决协同通信过程中所遇到的网络异常(丢包、断网、延时等)问题。
     最后,本文建立了一个基于增强现实硬件和软件系统平台,并通过运行实例验证了本文所提出的注册算法、交互方式和协同通信理论在车间布局系统中的有效性与可行性。
Traditional computer aided workshop layout was attached important to the optimal solution base on quantitative indicators:such as the flow of material, the flow of workpiece and space utilization. We are starting from the view of qualitative analysis and introducing the concept of Augmented Reality (Augmented Reality, AR) on the basis of traditional workshop layout-aided design. Aim at the characteristics of workshop layout system for network collaboration in augmented reality environment, three key issues were focused:registration under the mixed environment technology, human-computer interaction technology and network research in collaboration, and hope to break through the bottleneck that the workshop layout system is unable to conduct qualitative analysis. This paper's main research contents and research methods in the following areas:
     First of all, according to the characteristics of the range in workshop layout system, we will select the corresponding registration algorithm which must ensure the accuracy of registration and also meet the requirements of the scope of registration. Based on above-mentioned fact that we combined computer vision-based registration and the registration method of the electromagnetic tracking to form a hybrid registration algorithm. We made two assumptions in the process of derivation of hybrid algorithm: the one is magnetic tracking device has no errors; the other one is entirely coincidence of the coordinate system between the transmitter and the markers. of course, these two assumptions also caused some impact to the registration accuracy. In order to solve the above problems, this paper presents adaptive regional benchmarks to control error to make it meet the requirements of the workshop layout system.
     Second, an interactive tool was designed magic wand that can be identified by computer vision in augmented reality environment. The magic wand has two-sided with different markers that can be identified by the computer, this feature was used to define and implement our four semantic model that be used in the operation of the workshop layout (selection, translation, rotation. delete). In order to solve problem of occlusion handling, an virtual magic wand were used to fit the real magic wand, Therefore, this problem is transformed into the occlusion handling between the virtual objects and virtual objects.
     Collaborative design is well known as a "people-oriented" design method, this idea will be used into our workshop layout system. We first designed format unified communicative commands for multi-user cooperative communication. Then, make use of lock and unlock to solve multi-user competition conflicts on the same virtual model, the last thing is focus on solving network anomaly problems (such as:packet loss, broken network, delay, etc.) in the process collaborative communication.
     Finally, hardware and software platform of workshop layout system were established based on augmented reality, we are running this platform to validate the theories (registration, interactive and collaborative communication) are effectiveness and feasibility in the workshop layout system.
引文
[1]李扬,孙超,张明敏.跟踪与匹配并行的增强现实注册方法[J].中国图象图形学报,2011,16(4):680-685.
    [2]S Wan, J Lu, H Zhang. The application of augmented reality technologies for factory layout [J].Audio Language and Image Processing (ICALIP),2010 International Conference on.2010:873-876.
    [3]Ran Yang, Zhu Fei, Cheng Kang. Virtual and augmented reality applications in industrial design[J]. Laser Journal,2010:4-6.
    [4]Azuma R, Baillot Y, Behringer R, Feiner S. Recent advances in augmented reality[J]. Computer Graphics and Applications, IEEE,2001.21(6):34-47.
    [5]P. Milgram, A. F. Kishino.Taxonomy of Mixed Reality Visual Displays[J].IEICE Transactions on Information and Systems1994. E77-D(12):1321-1329.
    [6]冉洋,朱飞,陈康.虚拟现实及增强现实技术在工业设计中的应用[J].激光杂志,2010,31(1):4-6.
    [7]Rui Z, H. Hong.Effects of a retro reflective screen on depth perception in a head-mounted projection display[C]. Mixed and Augmented Reality (ISMAR),20109th IEEE International Symposium on.2010. p.137-145.
    [8]王红,周雅,马晋涛.光学透视式增强现实显示系统虚实遮挡问题研究[J].中国图象图形学报,2008,13(8):1566-1569.
    [9]李可歆.手持设备上基于增强现实的虚实交互技术的研究与应用[D].青岛大学,2010.
    [10]M Billinghurst, H Kato, I Poupyrev. The MagicBook-moving seamlessly between reality and virtuality[J]. Computer Graphics and Applications, IEEE,2001.21(3):6-8.
    [11]胡文聪.多投影增强现实系统的研究[D].上海交通大学,2009.
    [12]项天远.可扩展的实时多投影增强现实平台[D].上海交通大学,2011.
    [13]Li L, I.S Burnett, E Cheng. A flexible markerless registration method for video augmented reality[J]. Multimedia Signal Processing (MMSP),2011 IEEE 13th International Workshop,2011:1-6.
    [14]金剑华,陈一民.增强现实中基于视觉与磁力跟踪器的三维注册方法[J].计算机应 用,2006,26(6):1485-1489.
    [15]李启明,陈一民.增强现实系统中磁力跟踪注册的精确性研究[J].计算机工程与设计,2009,30(24):5785-5789.
    [16]De-yi M, etc. Registration with linear regression model in augmented reality[J]. Computer Science and Automation Engineering (CSAE),2011 IEEE International Conference on,2011:520-523.
    [17]Guan T, Wang C. Registration Based on Scene Recognition and Natural Features Tracking Techniques for Wide-Area Augmented Reality Systems[J]. Multimedia, IEEE Transactions,2009,11(8):1393-1406.
    [18]陈明,陈一民,姚争为.基于手形交互与掌纹识别的增强现实应用[J].计算机应用,2009,29(8):2083-2086.
    [19]沈克,彭太乐.基于增强现实的物联网物体识别与虚拟交互[J].计算机工程,2010,36(17):98-101,104.
    [20]Hincapie M, etc. An introduction to Augmented Reality with applications in aeronautical maintenance[C].Transparent Optical Networks (ICTON),2011 13th International Conference on.2011:1-4.
    [21]Sielhorst T, Feuerstein M, Navab N. Advanced Medical Displays:A Literature Review of Augmented Reality [J]. Display Technology,2008,4(4):451-467
    [22]程委,廖学军,李智.增强现实及其军事应用研究[J].计算机技术与发展,2007,17(12):165-168.
    [23]Henderson S, Feiner S. Exploring the Benefits of Augmented Reality Documentation for Maintenance and Repair [J]. Visualization and Computer Graphics, IEEE Transactions,2011.17(10):1355-1368.
    [24]Jeon S, Choi S, Harders M. Rendering Virtual Tumors in Real Tissue Mock-Ups Using Haptic Augmented Reality[J]. Haptics, IEEE Transactions,2012.5(1):77-84.
    [25]常勇,薛立明,姜淑芳.智能手机增强现实关键技术研究[J].计算机工程与应用,2011.47(15):69-71.
    [26]林惊,杨珂,王涌天.移动增强现实系统的关键技术研究[J].中国图象图形学报A,2009,14(3):560-564.
    [27]Back, M.; Childs, T.; Dunnigan, A.; The Virtual Factory:ploring 3D worlds as industrial collaboration and control environments[C]. Virtual Reality Conference (VR), 2010 IEEE,2010, Page(s):257-258
    [28]Back M, etc. The virtual chocolate factory:Building a real world mixed-reality system for industrial collaboration and control [J]. Multimedia and Expo (ICME),2010 IEEE International Conference on,2010:1160-1165.
    [29]Neugebauer R, Purzel F, Schreiber A. Virtual reality-aided planning for energy-autonomous factories[C]. Industrial Informatics (INDIN),2011 9th IEEE International Conference on,2011:250-254.
    [30]Lin Shuzhong, Chen Xiaoming, Sun Huilai. Research on 3D Online Simulation System for Li/MnO2 Coin Cell Production Line Based on Virtual Reality[C]. Computer Modeling and Simulation,2010. ICCMS'10. Second International Conference,2010: 22-26.
    [31]Chen X, Lin S. Research on 3D Interactive Simulation System for Li/MnO2 Coin Cell Production Line Based on Virtual Reality[C]. Measuring Technology and Mechatronics Automation,2009 ICMTMA. International Conference,2009:510-513.
    [32]陈奎.虚拟工厂规划仿真系统的研究与实现[D].杭州电子科技大学,2009.
    [33]黄炜.基于Virtools的工厂虚拟漫游系统的设计与实现[J].电脑知识与技术,2011,07(3):565-567.
    [34]Ertay T, Ruan D, Tuzkaya U R. Integrating data envelopment analysis and analytic hierarchy for the facility layout design in manufacturing systems[J]. Information Sciences,2006,176(3):237-262.
    [35]申建刚,夏国平,邱佩强.基于遗传算法和虚拟现实的施工设备布置系统[J].计算机集成制造系统,2009,15(10):1986-1993.
    [36]郭树伽.基于虚拟现实的齿轮加工设备布局与仿真技术研究[D].南昌大学,2010.
    [37]熊金猛,陈幼平,胡广华.基于增强现实的车间布局仿真系统的设计与开发[J].机械与电子,2007(1):64-67.
    [38]Pentenrieder K, etc. Augmented Reality-based factory planning-an application tailored to industrial needs[C]. Mixed and Augmented Reality,2007. ISMAR 2007,6th IEEE and ACM International Symposium,2007:31-42.
    [39]Georgel P, etc. Photo-based Industrial Augmented Reality application using a single keyframe registration procedure[C]. Mixed and Augmented Reality,2009. ISMAR 2009.8th IEEE International Symposium on.2009:187-188.
    [40]Kato H, etc. A city-planning system based on augmented reality with a tangible interface[C]. Mixed and Augmented Reality,2003. Proceedings. The Second IEEE and ACM International Symposium on,2003:340-341.
    [41]Anagnostou K, Vlamos P. Square AR:Using Augmented Reality for Urban Planning[C]. Games and Virtual Worlds for Serious Applications (VS-GAMES),2011 Third International Conference on,2011:128-131.
    [42]Ercan A.O, Erdem A.T. On sensor fusion for head tracking in augmented reality applications[C]. American Control Conference (ACC),2011.2011:1286-1291.
    [43]Schall G, Wagner D, Reitmayr G, Taichmann E.Global pose estimation using multi-sensor fusion for outdoor Augmented Reality[J]. Mixed and Augmented Reality, 2009. ISMAR 2009.8th IEEE International Symposium on.2009:153-162.
    [44]黄业桃,翁冬冬,臧晓军.基于投影红外标志点的室内大范围增强现实跟踪方法[J].北京理工大学学报,2010.30(11):1360-1364.
    [45]Thomas B.H, etc. Glove-Based Sensor Support for Dynamic Tangible Buttons in Spatial Augmented Reality Design Environments[C]. Wearable Computers (ISWC), 2011 15th Annual International Symposium,2011:109-110.
    [46]Gao Xin, Jia Qingxuan, Hu Huan. A Human-Computer Interaction method with Multi-Dimensional Information in the Teleoperation Augmented Reality System[C]. Computational Intelligence and Security (CIS),2011 Seventh International Conference,2011:180-184.
    [47]ZhiYing Z, etc.The Role of 3-D Sound in Human Reaction and Performance in Augmented Reality Environments[J]. Systems, Man and Cybernetics, Part A:Systems and Humans, IEEE Transactions,2007.37(2):262-272.
    [48]孙超,张明敏,李扬.增强现实环境下的人手自然交互[J].计算机辅助设计与图形学学报,2011,23(4):697-704.
    [49]吴悦明,何汉武,孙健.增强现实装配系统中的人手跟踪与识别技术研究[C].全国高等学校制造自动化研究会第十三届学术年会,2008:1-5.
    [50]Jae-Young L, etc. Design and Implementation of an Augmented Reality System Using Gaze Interaction[C]. Information Science and Applications (ICISA).2011 International Conference on.2011:1-8.
    [51]Manaf, A.S, Sari R.F. Color recognition system with augmented reality concept and finger interaction:Case study for color blind aid system[C].ICT and Knowledge Engineering (ICT & Knowledge Engineering),2011 9th International Conference on. 2012:118-123.
    [52]Collaborative Augmented Reality Application for Information Visualization Support
    [53]Shen Y, Ong S K, Nee A Y C. Product information visualization and augmentation in collaborative design[J]. CAD Computer Aided Design,2008,40(9):963-974.
    [54]王余涛.基于增强现实的协同式装配系统研究[D].中国科学技术大学,2010.
    [55]Godet-Bar G, Rieu D, Dupuy-Chessa S. HCI and business practices in a collaborative method for augmented reality systems[J]. Information and Software Technology, 2010,52(5):492-505.
    [56]Lee J, Han S, Yang J. Construction of a computer-simulated mixed reality environment for virtual factory layout planning[J]. Computers in Industry,2011,62(1):86-98.
    [57]Hotra Z, Holyaka R, Bolshakova I. Arbitrary rotation method for 3D magnetic sensors calibration[C]. CAD Systems in Microelectronics (CADSM).2011 11th International Conference,2011:413-416.
    [58]Mao Li, Shuang Song, Chao Hu.A new calibration method for magnetic sensor array for tracking capsule endoscope[C]. Robotics and Biomimetics (ROBIO),2009 IEEE International Conference,2009:1561-1566.
    [59]Hong-Kyu Kim, Jeung-Jin Moon. Route Tracking of Moving Magnetic Sensor Objects and Data Processing Module in a Wireless Sensor Network[C]. Smart Manufacturing Application,2008. ICSMA 2008. International Conference,2008:343-348.
    [60]章毓晋.计算机视觉教材计算机视觉教程[专著][M].人民邮电出版社,2011
    [61]范志斌.基于图像局部不变性特征的机器人识别与定位[D].北京交通大学,2011.
    [62]唐小伟.数据采集系统中温度数据的数字滤波算法分析[J].真空与低温,2010.16(1):47-50.
    [63]伍灵杰.数据采集系统中数字滤波算法的研究[D].北京林业大学,2010.
    [64]盛君,王毅刚.基于ARToolKit手指交互系统的研究[J].机电工程,2010,27(6):116-119.
    [65]刘莉.增强现实中基于轮廓深度恢复的虚实遮挡方法研究[J].计算机应用与软件,2011,28(1):220-222,245.
    [66]俞文炯,何汉武,吴悦明.增强现实环境下虚实物体遮挡判断方法研究[J].计算机应 用研究,2009,26(9):3270-3273.
    [67]倪剑,闫达远,周雅.增强现实系统中的深度检测技术研究[J].计算机应用研究,2006,26(1):132-136.
    [68]王震江,马宏编.XML基础与实践教程[专著][M].清华大学出版社,2011.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700