用户名: 密码: 验证码:
基于计算机视觉的汽车安全辅助驾驶若干关键问题研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
行车安全是交通运输业的永恒主题。近年来,随着汽车保有量的迅速增长,交通事故的发生越来越频繁,它给人类社会带来的危害也日趋严重。在这种背景下,汽车安全辅助驾驶技术受到广泛的关注。作为减少交通事故、降低事故损失的一种有效手段,它成为交通工程领域的研究前沿,代表了未来车辆发展的趋势。
     随着国内外汽车安全辅助驾驶研究的深入开展,一部分相关技术正逐步成熟,并开始走向产品化,但仍然有相当多的技术难题有待进一步解决。本文从中国的交通安全现状出发,利用计算机视觉方法对驾驶员疲劳检测和车外行人检测两个关键问题进行了一些有益的探索,以期为我国安全辅助驾驶技术的研发做出积极的贡献.
     首先对驾驶员眼睛及嘴巴状态检测问题进行了探讨。该研究的目的在于实时捕捉驾驶员长时间的闭眼及打哈欠等与瞌睡行为密切相关的动作。我们以眼睛和嘴巴的外在图像特征为切入点,提出了基于统计学习的疲劳状态检测算法。该算法将状态检测问题看成一个两类分类问题,通过提取感兴趣区域的LBPH-BIN-DIST(LBP直方图的位距离)特征,利用级联AdaBoost分类算法,实现了对闭眼及打哈欠两种状态的监测和区分,为后续疲劳状态的判断打下了坚实的基础。
     其次研究了驾驶员头部姿态的估计问题。该研究的目的在于捕捉驾驶员长时间的低头、抬头或者频繁点头这些反常的动作。该研究由两部分组成:(1)特征点(眼角及嘴角)的定位(2)基于特征点的头部姿态估计。首先用Harris算子得到候选的特征点,然后根据候选特征点邻域的灰度分布进一步提取特征,并用逻辑回归的方法进行特征融合以使定位更加准确。最后,基于定位的特征点信息,利用POSIT算法对头部姿态进行估计。该算法仅需四个以上的特征点就能得到准确的姿态估计。实验结果表明,只要人脸不发生过大角度的运动(约大于60度),所提出的算法均能正确估计出相应人脸的姿态,并对其运动趋势做出正确描述。
     最后是基于贝叶斯网络的疲劳状态估计。该研究的目的是根据疲劳所伴随的各种视觉表现对疲劳进行综合建模,并据此对驾驶员的疲劳程度进行判断。为此,选用睡眠质量、驾驶时段及天气状况等常见且重要的因素作为参数,对一段时间内驾驶员异常的面部动作发生的时长或频率进行观测和统计,并利用贝叶斯网络为工具,建立驾驶疲劳模型。该模型充分考虑了各个参数之间的相互依赖关系,保证了疲劳状态估计结果的准确性。
     此外,采用基于人体配置模型的方法对行人检测问题进行了研究。该研究以监测车辆外部特别是车辆前方的行人为主要目标。首先,用矩形近似人体的四肢和躯干,构建了一个处于行走状态的人体模型。其次,利用形状匹配算法寻找图像中近似矩形的区域作为四肢及躯干的候选,最后用隐马尔可夫解码算法从中寻找满足人体模型的候选区域作为最终检测到的人体。为了加快运算速度和提高匹配准确率,在进行优化处理时,加入了反映人体配置关系和有关人体外表先验知识的一些全局性约束.实验结果表明,我们的方法能够在有效抑制虚警的前提下,实现对车外行人的实时检测和报警。
Vehicle driving safety is a persistent issue in transportation industry.In recent years,along with the growth of the amount of cars,the traffic accidents arise more and more frequently,bringing huge damages to the society.Under this circumstance,Vehicle safety driving assistant technique has drawn great attentions.It is a frontier research topic,and also a effective measurement for preventing the happening and damage of traffic accident.
     Although a few of the vehicle driving-assistant techniques have been used in practical systems,most of the techniques remain immature.This dissertation researches the vehicle driving assistant techniques,mainly on the following two topics:driver fatigue detection,and outside-car pedestrian detection.
     The purpose of eye and mouth detection is to detect the closed eye and yawning mouth which are two major features of fatigue.According to the different appearance of different eye and mouth statuses,we propose a statical learning based method.We treat the status detection problem as a classification problem which is to recognize the abnormal status(closed eye or yawning) from eye and mouth images.We propose to use LBP Histogram Bin Distance(LBPH-BIN-DIST) as an effective feature extraction method.Based on this feature,we construct a cascade AdaBoost classifier to detect the abnormal status.The proposed method is highly accurate and fast.
     The purpose of head pose estimation is to detect the long-time lower or higher head poses,or frequent nodding.These affairs are also an important clue of fatigue.The research consists of two steps.The first step is to accurately locate several facial feature points,such as eye and mouth corners.Then,the second step uses these points for pose estimation.The detection of feature points is based on the grayscale distribution of the neighborhood around these points.We utilize the distribution to extract features, and use logistic regression to fuse several features,and give the final estimation of the feature points.Once we have achieved the location of these feature points,we can use POSIT algorithm for pose estimation.
     To fuse the available fatigue clues,such as eye and mouth status the head pose, also to integrate other external factors that will lead to driver fatigue,such as sleeping quality,time and weather,we use Bayes network to fuse all of these information and to get a final estimation of the probability of fatigue.The fatigue estimation model built by Bayes network considers the correlation and the conditional probabilities of different factors,thus can give more reasonable and overall judgement of fatigue.
     Besides the fatigue detection,the outside-car pedestrian detection is another important issue in driving-assistant research.The aim is to monitor the pedestrian activity, and prevent the potential accidents against pedestrians.Regarding this problem,we use a method based on the model of human body configuration.We first use rectangular to simulate the torso and limbs,and construct a walking human body model.Then,we use chamfer matching algorithm to find the potential human body regions in the images. The algorithm will give several candidates for human body.To identify the real human body,we use hidden Markov model(HMM) decoding algorithm.Some priors about human body are also added into the model as global constraints.The experiment shows that our method can effective detect pedestrian with low false-alarm rate.
引文
[1]王荣本,郭烈,顾柏园,余天洪,张明恒.2006.基于机器视觉的行车安全综合保障系统研究.山东交通学院学报14,2.
    [2]王荣本,游峰,崔高健,郭烈.2004.基于计算机视觉高速智能车辆的道路识别.计算机工程与应用40,26,18-21.
    [3]何国红,李晓明,李埃荣,梁富.2006.疲劳驾驶状态监控装置及方法.中华人民共和国发明专利.
    [4]郭烈,王荣本,金立生,余天洪.2007.基于边缘对称性的车辆前方行人检测方法研究.交通与计算机1.
    [5]郭烈,王荣本,张明恒,金立生.2008.基于adaboost算法的行人检测方法研究.计算机工程6.
    [6]郑培,宋正河,周一鸣.2002.基于perclos的机动车驾驶员驾驶疲劳的识别算法.中国农业大学学报7,2,104-109.
    [7]梁满贵,谢纪刚,裘正定.2003.基于多特征融合的困倦驾驶检测方法.中华人民共和国发明专刹.
    [8]王炳浩,魏建勤,吴永红.2004.汽车驾驶员瞌睡状态脑电波特征的初步探索.汽车工程26,1,70-73.
    [9]彭军强,吴平东,殷罡.2007.疲劳驾驶的脑电特性探索.北京理工大学学报27,7.
    [10]牛学军,朱茵,楼涛.2008.道路交通安全风险预控管理对策.综合运输10.
    [11]吴群,孙守迁,汤重熹.2008.基于心电信号的驾驶疲劳检测方法研究.浙江大学博士学位论文.
    [12]石坚,卓斌.2000.汽车驾驶员主动安全性因素的辨识与分析.上海交通大学学报34,4,441-444.
    [13]王武宏,孙逢春等.2001.道路交通系统中驾驶行为理论与方法.北京:科学出版社.
    [14]孙庆杰,吴恩华.2003.基于矩形拟合的人体检测.软件学报14 8,1388-1393.
    [15]巩航军,李百川.2006.我国道路交通安全现状及对策研究.安全行车,98-100.
    [16]郑文贵,李向云.2006.1996-2003年全国交通事故伤害的时间序列分析.中国卫生事业管理,105-107.
    [17]王贵槐,万剑.2008.汽车安全辅助驾驶支持系统信息感知技术综述.交通与计算机26,3.
    [18]田广,戚飞虎.2008.移动摄像机环境下基于特征变换和svm的分级行人检测算法.电子学报36,5.1024-1028.
    [19]庄继德.1999.汽车地面运输系统工程.北京理工大学出版社.
    [20]蔡自兴.2000.机器人学.清华大学出版社.
    [21]范宏深,倪国强,申会堂.2001.用黑斑的椭圆性质在二值化图像中探测眼睛.光学技术27,4,307-309.
    [22]范宏深,倪国强,申会堂.2002.利用几何特性及神经网络进行人脸探测技术的研究.光学技术28,2,105-107.
    [23]王荣本,郭克友,储江伟.2003.一种基于gabor小波的驾驶员眼部状态识别方法的研究.中国图像图形学报8,9,1043-1047.
    [24]ANDREONE,A.,BELLOTTI,F.,GLORIA,A.D.,LAULETTA,R.2005.Svm-based pedestrian recognition on near-infrared images.In Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis.274-278.
    [25]BARR,L.,HOWARTH,H.,POPKIN,S.,CARROLL,R.J.A review and evaluation of emerging driver fatigue detection measures and technologies.Tech.rep.,John A.Volpe National Transportation Systems Center,Cambridge.
    [26]BERGASA,L.M.,NUEVO,J.,SOTELO,M.A.,BAREA,R.,LOPEZ,M.E.2006.Real-time system for monitoring driver vigilance.IEEE Transcations on Intelligent Transportation Systems 7,63-77.
    [27]BERTOZZI,M.,B ROGGI,A.2004.Pedestrian detection for driver assistance using multiresolution infrared vision.IEEE Transcations on Vehicular Technology 53,6,1666-1678.
    [28]BERTOZZI,M.,BROGGI,A.,LASAGNI,A.2005.Infrared stereo vision-based pedestrian detection.In Proceedings of the IEEE Intelligent Vehicles Symposium.24-29.
    [29]CHEN,D.,CAO,X.B.,XU,Y.W.,QIAO,H.2006.An evolutionary support vector machines classifier for pedestrian detection.In IEEE/RSJ International Conference on Intelligent Robots and Systems.4223-4227.
    [30]CHEN,Q.,Wu,H.,SHIOYAMA,T.,SHIMADA,T.1998.A robust algorithm for 3d head pose estimation.In Proceedings of the 14th International Conference on Pattern Recognition.Vol.2.1356-1359.
    [31]CHENG,H.,ZHENG,N.,QIN,J.2005.Pedestrian detection using sparse gabor filter and support vector machine.In Proceedings of the IEEE Intelligent Vehicles Symposium.583-587.
    [32]CHow,G.,LI,X.1993.Towards a system for automatic facial feature detection.Pattern Recognition 26,1739-1755.
    [33]CO,E.L.,GREGORY,K.B.,JOHNSON,J.M.,ROSEKIND,M.R.1999.Crew factors in flight operations xi:A survey of fatigue factors in regional airline operations.Tech.Rep.NASA/TM-1999-208799,Ames Res.Center,Nat.Aeronautics Space Admin.Oct.
    [34]COOTES,T.F.,EDWARDS,G.J.,TAYLOR,C.J.1998.Active appearance models.In In Proceeding ofECCV98.Vol.2.484-498.
    [35]COOTES,T.F.,TAYLOR,C.J.,COOPER,D.H.,GRAHAM,J.1995.Active shape models:Their training and application.Computer Vision and Image Understanding 61,1,38-59.
    [36]CUTLER,R.,DAVIS,L.S.2000.Robust real-time periodic motion detection,analysis,and applications.IEEE Transcations on Pattern Analysis and Machine Intelligence,781-796.
    [37]DAIMERCHRYSLERAG.2001.The electronic drawbar,http://www.daimlerchrysler.com.
    [38]DEMENTHON,D.F.,DAVIS,L.S.1995.Model-based object pose in 25 lines of code.International Journal of Computer Vision 15,123-141.
    [39]DONG,J.,GE,J.,LUO,Y.2007.Nighttime pedestrian detection with near infrared using cascaded classifiers.In Proceedings of the 1EEL International Conference on Image Processing.Vol.6.
    [40]DuDA,R.2003.模式分类(原书第2版).机械工业出版社.
    [41]DUDA,R.O.,HART,P.E.,STORK,D.G.2003.Pattern Classification,2 ed.China Machine Press.
    [42]ESKANDARIAN,m.,SAYED,R.2005.Driving simulator experiment:Detecting driver fatigue by monitoring eye and steering activity.In NDIA 3rd Annual Intelligent Vehicle Systems Symposium.
    [43]EWALD,A.,WILLHOEFT,V.2000.Laser scanners for obstacle detection in automotive applications.In Proceedings of the IEEE Intelligent Vehicles Symposium.682-687.
    [44]FUERSTENBERG,K.C.,SCHOLZ,J.2005.Reliable pedestrian protection using laserscan-ners.In Proceedings of the IEEE Intelligent Vehicles Symposium.142- 146.
    [45]Gao,W.,Cao,B.,Shan,S.,Zhou,D.,Zhang,X.,Zhao,D.2004.The cas-peal largescale Chinese face database and evaluation protocols.Technical Report No.JDL_TR_04_FR-001,Joint Research and Development Laboratory,CAS.
    [46]GAVRILA,D.M.2000.Pedestrian detection from a moving vehicle.In Proceedings of the European Conference on Computer Vision.37-49.
    [47]GAVRILA,D.M.2001a.A multi-sensor approach for the protection of vulnerable traffic participants-the protector project.In IEEE Instrumentation and Measurement Technology Conference.2044-2048.
    [48]GAVRILA,D.M.2001b.Sensor-based pedestrian protection.IEEE Intelligent Systems 16,77-81.
    [49]GAVRILA,D.M.,GEIBEL,J.2002.Shape-based pedestrian detection and tracking.In Proceedings of the IEEE Intelligent Vehicles Symposium.8-14.
    [50]Gavrila,D.M.,GIEBEL,J.,MUNDER,S.2004.Vision-based pedestrian detectiomthe protector system.In Proceedings of the IEEE Intelligent Vehicles Symposium.410-415.
    [51]GEE,A.,CIPOLLA,R.1996.Fast visual tracking by temporal consensus.Image and Vision Computing 14,105-114.
    [52]GRACE,R.,BYRNE,V.E.,BIERMAN,D.M.A drowsy driver detection system for heavy vehicles.In Technical Conference Proceedings,Ocular Measures of Driver Alertness.
    [53]GRUBB,G.,ZELINSKY,A.,NILSSON,L.,RILEBE,M.2004.3d vision sensing for improved pedestrian safety.In Proceedings of the IEEE Intelligent Vehicles Symposium.19-24.
    [54]HARRIS,C,STEPHENS,M.1988.A combined corner and edge detector.In Alvey vision conference.
    [55]HATTORI,K.,MATSUMORI,S.,SATO,Y.1998.Estimating pose of human face based on symmetry plane using rangeand intensity images.In Proceedings of the 14th International Conference on Pattern Recognition.Vol.2.1183-1187.
    [56]HEALEY,J.,PlCARD,R.2000.Smartcar:Detecting driver stress,in Proc.15th Int.Conf.Pattern Recognition 101,218 228.
    [57]HEISELE,B.,WOHLER,C.1998.Motion-based recognition of pedestrians.In Proceedings of the IEEE International Conference on Pattern Recognition.1325-1330.
    [58]Ho,S.Y,HUANG,H.L.1998.An analytic solution for the pose determination of human faces from a monocular image.Pattern Recognition Letters 19,1045-1054.
    [59]HOGG,T.,Rees,D.,TALHAMI,H.1995.Three-dimensional pose from two-dimensional images:a novel approach using synergetic networks.In IEEE International Conference on Neural Networks.Vol.2.1140-1144.
    [60]Horprasert,T.,Yacoob,Y.,Davis,L.S.1996.Computing 3-d head orientation from a monocular image sequence.In Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.242-247.
    [61]IOFFE,S.,FORSYTH,D.A.2001.Probabilistic methods for finding people.International Journal of Computer Vision 43,1,45-68.
    [62]JI,Q.,LAN,P.,LOONEY,C.2006.A probabilistic framework for modeling and real-time monitoring human fatigue.IEEE Transcations on Systems,Man and Cybernetics 36,862-875.
    [63]JI,Q.,YANG,X.2002.Real-time eye,gaze,and face pose tracking for monitoring driver vigilance.Real-Time Imaging 8,357-377.
    [64]KASS,M.,KITKIN,A.,TERZOPOULOS,D.1998.Snake:Active contour models.International Journal of Computer Vision,321-331.
    [65]KIRCHER,A.,UDDMAN,M.,SANDIN,J.2002.Vehicle control and drowsiness.Tech.rep.,Swedish National Road and Transport Research Institute.
    [66]KUMAR,T.,RAJA,K.,RAMAKRISHNAN,A.G.2002.Eye detection using color cues and projection function.In Proc of IEEE International Conference on Image Processing.22-25.
    [67]MICHAEL,M.M.,ANDRZEJ,O.M.2005.Enhancing pedestrian safety by using the save-u pre-crash system.In IEEE 12th World Congress on ITS.
    [68]MICHAEL,M.M.,BINH,T.T.,JAN,O.2004.A 24 ghz radar-based automotive pre-crash system.In International Workshop on Intelligent Transportation.
    [69]MOHAN,A.,PAPAGEORGIOU,C,POGGIO,T.2001.Example-based object detection in images by components.IEEE Transcations on Pattern Analysis and Machine Intelligence 23,4,349-361.
    [70]MORI,G.,REN,X.,EFORS,A.A.,MALIK,J.2004.Recovering human body configurations:combining segmentation and recognition.In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition.Vol.2.326-333.
    [71]MURASE,H.,NAYAR,S.K.1995.Visual learning and recognition of 3-d objects from appearance.International Journal of Computer Vision 14,1,5-24.
    [72]NANDA,H.,Davis,L.2002.Probabilistic template based pedestrian detection in infrared videos.In Proceedings of the IEEE Intelligent Vehicles Symposium.15-20.
    [73]NHTSA.2007.2005 traffic safety facts data summary booklet.Tech.Rep.810632,NHTSA' s National Center for Statistics and Analysis.
    [74]NIKOLAIDIS,A.,Pitas,I.2000.Facial feature extraction and pose determination.Pattern Recognition 33,1783-1791.
    [75]OJALA,T.,PIETIKAINEN,M.,HARWOOD,D.1996.A comparative study of texture measures with classification based on feature distribution.Pattern Recognition 29,1,51-59.
    [76]OJALA,T.,PIETIK(A|¨)INEN,M.,M(A|¨)ENP(A|¨)(A|¨),T.2002.Multiresolution gray-scale and rotation invariant texture classification with local binary patterns.IEEE Transactions on Pattern Analysis and Machine Intelligence 24,971-987.
    [77]OREN,M.,PAPAGEORGIU,C,SIHNA,P.,ET AL.1997.Pedestrian detection using wavelet templates.In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition.193-199.
    [78]PIETIKAINEN,M.,AHONEN,T.,HADID,A.2004.Face recognition with local binary patterns.In Proceedings of the European Conference on Computer Vision.469-481.
    [79]ROSEKIND,M.R.,Co,E.L.,GREGORY,K.B.,MILLER,D.L.2000.Crew factors in flight operations xiii:A survey of fatigue factors in corporate/executive aviation operations.Tech.Rep.NASA/TM-2000-209610,Ames Res.Center,Nat.Aeronautics Space Admin.Sep.
    [80]ROSEKIND,M.R.,GREGORY,K.B.,Co,E.L.,Miller,D.L.,Dinges,D.F.2000.Crew factors in flight operations xii:A survey of sleep quantity and quality in on-board crew rest facilities.Tech.Rep.NASA/TM-2000-209611,Ames Res.Center,Nat.Aeronautics Space Admin.Sep.
    [81]SEEINGMACHINES.Seeing machines,facelab 5.
    [82]SHASHUA,A.,GDALYAHU,Y.,HAYUN,G.2004.Pedestrian detection for driving assistance systems:single-frame classification and system level performance.In Proceedings of the IEEE Intelligent Vehicles Symposium.1-6.
    [83]SHERRY,P.2000.Fatigue Countermeasures in the Railroad Industry:Past and Current Developments.Washington,D.C.:AAR Press.
    [84]SMARTEYE.2004.Smart eye white paper.http://www.smarteye.se/ smarteyepro3.html.
    [85]SMITH,S.,BRADY,J.1997.Susan:New approach to low level image processing.International Journal of Computer Vision 23,1,45-78.
    [86]SORIA,J.2002.Llega el piloto tecnologico.20-21.
    [87]SZARVAS,M.,YOSHIZAWA,A.,YAMAMOTO,M? OGATA,J.2005.Pedestrian detection with convolutional neural networks.In IEEE Conference on Intelligent Transportation Systems.224-229.
    [88]TIAN,Y,KANADE,T.,COHN,J.2000.Eye-state action unit detection by gabor wavelets.In International Conference on Multimodal Interfaces.143-150.
    [89]TILLEY,A.R.1993.The measure of man and woman:human factors in design.Tech.rep.,H.D.Associates,NY.
    [90]VIOLA,P.,JONES,M.2001.Rapid object detection using a boosted cascade of simple features.In IEEE International Conference on CVPR.511-518.
    [91]WIERWILLE,W.W.,ELLSWORTH,L.A.,ET AL.1994.Research on vehicle based driver status/performance monitoring:Development,validation,and refinement of algorithms for detection of driver drowsiness.Tech.Rep.DOT HS 808 247,Nat.Highway Traffic Safety Admin.,Washington,DC,.
    [92]Xu,F.,FUJIMURA,K.2005.Pedestrian detection and tracking with night vision.IEEE Transactions Intelligent Transportation Systems 6,63-71.
    [93]YUILLE,A.,HALLINAN,P.,COHEN,D.1992.Feature extraction from faces using deformable templates.International Journal of Computer Vision 8,2,99-111.
    [94]ZHAO,L.2001.Dressed human modeling,detection,and parts localization,[博士学位论文],Carnegie Mellon University,CMU-RI-TR-01-19.
    [95]ZHENG,Y,WANG,Z.2008.Minimal neighborhood mean projection function and its application to eye location.Journal of Software.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700