Technical Paper
Prediction of Driver Drowsiness Level Using Recurrent Neural Networks and Multi-Time-Scale Fusion
2021-04-06
2021-01-0909
There is accumulating evidence that drowsy driving is one of the leading causes of vehicle crashes and accidents worldwide. Consequently, automotive manufacturers started to develop in-vehicle drowsiness detection devices. However, due to the limited computation resources and the complexity of the vehicular environment, the existing products' performance is limited. Moreover, the vast majority of the commercialized products focus on monitoring the subject's current drowsiness level, whereas predicting drowsiness level in advance to avoid future risks is overlooked. In this research, a multi-time-scale fusion approach is proposed where prediction results from both long-term and short-term Recurrent Neural Networks (RNN) were combined to predict a person's drowsiness level. Our results indicate that the proposed fusion strategies can successfully capture both the short-term microsleep-related features and long-term sleepiness features and improve the drowsiness prediction performance.