全方位视频监视系统
|
摘要
眼睛是人类最主要的感觉器官。在人类感观接受的各种信息中有70％以上来自视觉。视频、图像是对客观事物形象、生动的描述。在今天的信息时代，随着网络、通信和微电子技术的快速发展，视频监视系统以其直观、方便和内容丰富等特点，日益受到人们的青睐，同时，人们也对它提出了更高的要求。
本文提出了全方位视频监视系统的新构想，用多个摄像头同时进行监视，通过对图像失真校正和图像拼接的深入研究，成功地实现了全景拼图，完成了全方位视频监视系统的初步构建。
在图像失真校正的研究中，本文对传统的桶形失真模型进行了改进，取得了较好的校正效果，扩展了现有的图像失真校正理论。本文还对多种图像拼接方法进行了综合的比较和分析，成功地应用了目前关于图像拼接技术的最新理论，为今后人们在图像拼接方面的研究提供了有力的实验依据。
全方位视频监视系统可以应用于视频会议、网上购物、交通控制等多个领域。它对传统的视频监视系统进行了较大的改进，可以提供多用户进行灵活的监视操作，具有很高的应用前景。与此同时，它的硬件结构简单，系统的构建方便并且价格低廉，具有较高的经济价值。
本文是对图像失真校正和图像拼接现有成果的一次成功应用，并且根据实际需要提出了一些新的图像处理方法，相信对今后这一领域的研究可以起到一定的指导作用。
Eye is the most important sense organ for human beings. Among the information people get from sense receptors, more than 70% is from vision. Visions and images are the vivid descriptions of objects. In today's information era, with the rapid development of network, communication and microelectronics technologies, video surveillance system is getting more and more favors from people for its clearness, convenience and abundant content. In the meanwhile, people also put forward more requirements on it.
The paper brings forward the idea of Panoramic Video Surveillance System. Using multi cameras monitoring simultaneously, through deep research on image distortion calibration and image stitching, successfully realizes the panoramic images, and finishes the Panoramic Video Surveillance System's initial construction.
During the research on image distortion correction, the paper receives a good result on camera calibration by improving the traditional barrel distortion model, and expands the current theories on image distortion correction. The paper also compares and analyses many methods on image stitching, and successfully applies the latest image stitching theory. It provides useful experimental proof for future studies.
Panoramic Video Surveillance System can be used in various fields such as videoconference, network shopping and traffic control. It greatly improves the conventional video surveillance system, and has prosperous application future by providing multi-users with flexible operations. At the same time, its simple hardware structure makes the system construction easy and cheap. Therefore the system also has a high economic value.
The paper is a successful application of current image distortion correction and image stitching techniques. It also brings forward some new methods on image processing. It is believable that this paper would be a useful guide for future research on these areas.
本文提出了全方位视频监视系统的新构想，用多个摄像头同时进行监视，通过对图像失真校正和图像拼接的深入研究，成功地实现了全景拼图，完成了全方位视频监视系统的初步构建。
在图像失真校正的研究中，本文对传统的桶形失真模型进行了改进，取得了较好的校正效果，扩展了现有的图像失真校正理论。本文还对多种图像拼接方法进行了综合的比较和分析，成功地应用了目前关于图像拼接技术的最新理论，为今后人们在图像拼接方面的研究提供了有力的实验依据。
全方位视频监视系统可以应用于视频会议、网上购物、交通控制等多个领域。它对传统的视频监视系统进行了较大的改进，可以提供多用户进行灵活的监视操作，具有很高的应用前景。与此同时，它的硬件结构简单，系统的构建方便并且价格低廉，具有较高的经济价值。
本文是对图像失真校正和图像拼接现有成果的一次成功应用，并且根据实际需要提出了一些新的图像处理方法，相信对今后这一领域的研究可以起到一定的指导作用。
Eye is the most important sense organ for human beings. Among the information people get from sense receptors, more than 70% is from vision. Visions and images are the vivid descriptions of objects. In today's information era, with the rapid development of network, communication and microelectronics technologies, video surveillance system is getting more and more favors from people for its clearness, convenience and abundant content. In the meanwhile, people also put forward more requirements on it.
The paper brings forward the idea of Panoramic Video Surveillance System. Using multi cameras monitoring simultaneously, through deep research on image distortion calibration and image stitching, successfully realizes the panoramic images, and finishes the Panoramic Video Surveillance System's initial construction.
During the research on image distortion correction, the paper receives a good result on camera calibration by improving the traditional barrel distortion model, and expands the current theories on image distortion correction. The paper also compares and analyses many methods on image stitching, and successfully applies the latest image stitching theory. It provides useful experimental proof for future studies.
Panoramic Video Surveillance System can be used in various fields such as videoconference, network shopping and traffic control. It greatly improves the conventional video surveillance system, and has prosperous application future by providing multi-users with flexible operations. At the same time, its simple hardware structure makes the system construction easy and cheap. Therefore the system also has a high economic value.
The paper is a successful application of current image distortion correction and image stitching techniques. It also brings forward some new methods on image processing. It is believable that this paper would be a useful guide for future research on these areas.
引文
1 刘富强，钱建生，曹国清. 多媒体图像技术及应用. 人民邮电出版社，2000：1，78～82
2 L.G. Brown. A Survey of Image Registration Techniques. ACM Computing Surveys, Vol.24, No.4, 1992：325~376
3 H.-Y. Shum, Li-Wei-He. Rendering with concentric mosaics. ACM SIGGRAPH, 1999：299~306
4 S. Nayar. A True Omnidirectional Viewer. Technical report, Bell Laboratories, Holmdel, NJ, USA, February 1996
5 何斌，马天予，王运坚，朱红莲. Visual C++ 数字图像处理. 人民邮电出版社，2001：4~8
6 刘文开，丁启芬，刘远航. 数码影响处理实用技术. 辽宁科学技术出版社，2000：25～32
7 数字视频基础. http://www.videostar.com/wen/article/word1/cha_821.htm
8 流媒体的概念. http://www.shine-media.net/zscl/lmtkl.htm
9 刘远航，刘文开，丁启芬. 数码相机选购、使用及数字图像处理指南. 浙江科学技术出版社，1999：20～21
10 望月. 视频卡完全接触.
http://www8.ccidnet.com/DIY/apply/2001/07/04/68_6378.html, 2001
11 T.A. Clarke，J.F. Fryer. The Development of Camera Calibration Methods and Models. Photogrammetric Record. 1998：51~66
12 S.E. Chen. QuickTime VR - An Image Based Approach to Virtual Environment Navigation. Proc. SIGGRAPH. 1995：29~38
13 M.A. Boer, A.G.J. Nijmeijer, C.H. Slump, M.M. Samsom, M.J. Bentum, G.J. Laanstra, H. Snijders, J. Smit and O.E. Herrmann. Real-Time Restoration of Lens-Distorted Images by Digital Image Processing. In Proceedings of the IEEE ProRISC workshop on Circuit, Systems and Signal Processing, March 1994：41~46
14 L. Campbell, A. Bobick. Correcting for Radial Lens Distortion: A Simple Implementation. Tech. Rep. 322, Mass. Inst. Technol. Media Lab. Percept. Comput. Sect., Cambridge, MA, April 1995
15 S. Shah, J.K. Aggarwal. Intrinsic Parameter Calibration Procedure for a (High-Distortion) Fish-Eye Lens Camera with Distortion Model and Accuracy Estimation. Pattern Recognition, Vol29. No.11. 1996：1775~1788
16 孙仲康，沈振康. 数字图像处理及其应用. 国防工业出版社，1985：121~123
17 H. Sawhney, R. Kumar. True Multi-Image Alignment and its Applications to Mosaicing and Lens Distortion Correction. IEEE Trans. Pattern Anal. Machine Intell., vol.21, March 1999: 235~243
18 赵荣春，赵忠明等. 数字图象处理导论. 西北工业大学出版社，1995：194～202
19 J.A. Bangham, S. Marshall. Image and Signal Processing with Mathematical Morphology. Electronics and Communication Engineering Journal, June 1998：117~128
20 彭明生，莫玉龙. 基于数学形态学和神经网络的纹理分类. 上海大学学报（自然科学版），第5卷，第2期，1999
21 王熙法，庄镇泉，王东生. C语言图像处理程序设计. 中国科学技术大学出版社，1994：228～230
22 J. Davis. Mosaics of Scenes with Moving Objects. Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1998：354～360
23 S. Peleg, J. Herman. Panoramic Mosaics by Manifold Projection. IEEE Conference on Computer Vision and Pattern Recognition, June 1997：338~343
24 Chia-Yen Chen, Reinhard Klette: Image Stitching - Comparisons and New Techniques. CAIP 1999： 615～622
25 郑南宁. 计算机视觉与模式识别. 国防工业出版社，1998：49～56
26 R. Klette, P. Zamperoni. Handbook of Image Processing Operators. Chichester: John Wiley and Sons, 1996
T.R. Reed, J.M.H DuBuf. A Review of Recent Texture Segmentation and
27 Feature Extraction Techniques. Image Understanding, 1993, 57：359～372
28 D.L. Milgram. Computer Methods for Creating Photomosaics. IEEE Trans. Comput., vol. C-24, Nov. 1975：1113~1119
29 C. Chen，R. Klette. An Image Stitcher and Its Application in Panoramic Movie Making. Proc. DICTA'97. 1997，12：101～106
30 H.-Y. Shum, R. Szeliski. Panoramic Image Mosaics. Technical Report MSR-TR-97-23, Microsoft Research, September 1997
31 R. Szeliski, H.-Y. Shum. Creating Full View Panoramic Image Mosaics and Texture-mapped Models. Computer Graphics (SIGGRAPH'97), August 1997：251~258
32 R.Y. Tsai, T.S. Huang. Estimating Three-dimensional Motion Parameters of a Rigid Planar Patch. Trans. Acoust., Specch, Signal Processing, vol. ASSP-29, 1981：1147~1152
33 S. Mann, R. Picard. Video Orbits of the Projective Group: A Simple Approach to Featureless Estimation of Parameters. IEEE Trans. Image Processing, vol.6, Sept. 1997：1281～1295
34 Q. Zheng, R. Chellappa. A Computational Vision Approach to Image Registration. IEEE Trans. Image Processing, vol. 2, July 1993: 311~325
35 G. Wolberg. Digital Image Warping. IEEE Comput. Soc. Press monograph 10662. Los Alamitos, CA: IEEE Computer Society Press, 1990
36 G. Adiv. Determining 3D Motion and Structure from Optical Flow Generated by Several Moving Objects. IEEE Trans. Pattern Anal. Machine Intell., vol. 7, July 1995: 384~401
37 F.M. Candocia. Synthesizing a Panoramic Scene with a Common Exposure via the Simultaneous Registration of Images. The 15th Florida Conference on Recent Advances in Robotics, FCRAR 2002, Miami, Florida, May 2002
38 胡俊. 工业以太网和基于Internet的远程监控系统. IIAC2001—第四届工业仪表与自动化会议, 2001, 9
39 胡晓峰，吴玲达，李国辉等. 多媒体系统原理与应用. 人民邮电出版社，1995：46~84
2 L.G. Brown. A Survey of Image Registration Techniques. ACM Computing Surveys, Vol.24, No.4, 1992：325~376
3 H.-Y. Shum, Li-Wei-He. Rendering with concentric mosaics. ACM SIGGRAPH, 1999：299~306
4 S. Nayar. A True Omnidirectional Viewer. Technical report, Bell Laboratories, Holmdel, NJ, USA, February 1996
5 何斌，马天予，王运坚，朱红莲. Visual C++ 数字图像处理. 人民邮电出版社，2001：4~8
6 刘文开，丁启芬，刘远航. 数码影响处理实用技术. 辽宁科学技术出版社，2000：25～32
7 数字视频基础. http://www.videostar.com/wen/article/word1/cha_821.htm
8 流媒体的概念. http://www.shine-media.net/zscl/lmtkl.htm
9 刘远航，刘文开，丁启芬. 数码相机选购、使用及数字图像处理指南. 浙江科学技术出版社，1999：20～21
10 望月. 视频卡完全接触.
http://www8.ccidnet.com/DIY/apply/2001/07/04/68_6378.html, 2001
11 T.A. Clarke，J.F. Fryer. The Development of Camera Calibration Methods and Models. Photogrammetric Record. 1998：51~66
12 S.E. Chen. QuickTime VR - An Image Based Approach to Virtual Environment Navigation. Proc. SIGGRAPH. 1995：29~38
13 M.A. Boer, A.G.J. Nijmeijer, C.H. Slump, M.M. Samsom, M.J. Bentum, G.J. Laanstra, H. Snijders, J. Smit and O.E. Herrmann. Real-Time Restoration of Lens-Distorted Images by Digital Image Processing. In Proceedings of the IEEE ProRISC workshop on Circuit, Systems and Signal Processing, March 1994：41~46
14 L. Campbell, A. Bobick. Correcting for Radial Lens Distortion: A Simple Implementation. Tech. Rep. 322, Mass. Inst. Technol. Media Lab. Percept. Comput. Sect., Cambridge, MA, April 1995
15 S. Shah, J.K. Aggarwal. Intrinsic Parameter Calibration Procedure for a (High-Distortion) Fish-Eye Lens Camera with Distortion Model and Accuracy Estimation. Pattern Recognition, Vol29. No.11. 1996：1775~1788
16 孙仲康，沈振康. 数字图像处理及其应用. 国防工业出版社，1985：121~123
17 H. Sawhney, R. Kumar. True Multi-Image Alignment and its Applications to Mosaicing and Lens Distortion Correction. IEEE Trans. Pattern Anal. Machine Intell., vol.21, March 1999: 235~243
18 赵荣春，赵忠明等. 数字图象处理导论. 西北工业大学出版社，1995：194～202
19 J.A. Bangham, S. Marshall. Image and Signal Processing with Mathematical Morphology. Electronics and Communication Engineering Journal, June 1998：117~128
20 彭明生，莫玉龙. 基于数学形态学和神经网络的纹理分类. 上海大学学报（自然科学版），第5卷，第2期，1999
21 王熙法，庄镇泉，王东生. C语言图像处理程序设计. 中国科学技术大学出版社，1994：228～230
22 J. Davis. Mosaics of Scenes with Moving Objects. Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1998：354～360
23 S. Peleg, J. Herman. Panoramic Mosaics by Manifold Projection. IEEE Conference on Computer Vision and Pattern Recognition, June 1997：338~343
24 Chia-Yen Chen, Reinhard Klette: Image Stitching - Comparisons and New Techniques. CAIP 1999： 615～622
25 郑南宁. 计算机视觉与模式识别. 国防工业出版社，1998：49～56
26 R. Klette, P. Zamperoni. Handbook of Image Processing Operators. Chichester: John Wiley and Sons, 1996
T.R. Reed, J.M.H DuBuf. A Review of Recent Texture Segmentation and
27 Feature Extraction Techniques. Image Understanding, 1993, 57：359～372
28 D.L. Milgram. Computer Methods for Creating Photomosaics. IEEE Trans. Comput., vol. C-24, Nov. 1975：1113~1119
29 C. Chen，R. Klette. An Image Stitcher and Its Application in Panoramic Movie Making. Proc. DICTA'97. 1997，12：101～106
30 H.-Y. Shum, R. Szeliski. Panoramic Image Mosaics. Technical Report MSR-TR-97-23, Microsoft Research, September 1997
31 R. Szeliski, H.-Y. Shum. Creating Full View Panoramic Image Mosaics and Texture-mapped Models. Computer Graphics (SIGGRAPH'97), August 1997：251~258
32 R.Y. Tsai, T.S. Huang. Estimating Three-dimensional Motion Parameters of a Rigid Planar Patch. Trans. Acoust., Specch, Signal Processing, vol. ASSP-29, 1981：1147~1152
33 S. Mann, R. Picard. Video Orbits of the Projective Group: A Simple Approach to Featureless Estimation of Parameters. IEEE Trans. Image Processing, vol.6, Sept. 1997：1281～1295
34 Q. Zheng, R. Chellappa. A Computational Vision Approach to Image Registration. IEEE Trans. Image Processing, vol. 2, July 1993: 311~325
35 G. Wolberg. Digital Image Warping. IEEE Comput. Soc. Press monograph 10662. Los Alamitos, CA: IEEE Computer Society Press, 1990
36 G. Adiv. Determining 3D Motion and Structure from Optical Flow Generated by Several Moving Objects. IEEE Trans. Pattern Anal. Machine Intell., vol. 7, July 1995: 384~401
37 F.M. Candocia. Synthesizing a Panoramic Scene with a Common Exposure via the Simultaneous Registration of Images. The 15th Florida Conference on Recent Advances in Robotics, FCRAR 2002, Miami, Florida, May 2002
38 胡俊. 工业以太网和基于Internet的远程监控系统. IIAC2001—第四届工业仪表与自动化会议, 2001, 9
39 胡晓峰，吴玲达，李国辉等. 多媒体系统原理与应用. 人民邮电出版社，1995：46~84
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |