Search Results

An accurate and timely positioning of the vehicle is required at all times for autonomous driving. The global navigation satellite system (GNSS), even when integrated with costly inertial measurement units (IMUs), would often fail to provide high-accuracy positioning due to GNSS-challenged environments such as urban canyons. As a result, visual odometry is proposed as an effective complimentary approach. Although it’s widely recognized that visual odometry should be developed based on both visible and infrared images to address issues such as frequent changes in ambient lightening conditions, the mechanism of visible-infrared fusion is often poorly designed. This study proposes a Generative Adversarial Network (GAN) based model comprises a generator, which aims to produce a fused image combining infrared intensities and visible gradients, and a discriminator whose target is to force the fused image to retain as many details that exist mostly in visible images as possible.

Driver distraction detection is crucial to driving safety when autonomous vehicles are co-piloted. Recognizing drivers’ behaviors that are highly related with distraction from real-time video stream is widely acknowledged as an effective approach mainly due to its non-intrusiveness. In recently years, deep learning neural networks have been adopted to by-pass the procedure of designing features artificially, which used to be the major downside of computer-vision based approaches. However, the detection accuracy and generalization ability is still not satisfying since most deep learning models extracts only spatial information contained in images. This research develops a driver distraction model based on a two-stream, spatial and temporal, convolutional neural network (CNN).

With the improvement of sensor accuracy, sensor data plays an increasingly important role in intelligent vehicle motion control. Good use of sensor data can improve the control of vehicles. However, data-based end-to-end control has the disadvantages of poorly interpreted control models and high time costs; model-based control methods often have difficulties designing high-fidelity vehicle controllers because of model errors and uncertainties in building vehicle dynamics models. In the face of high-speed steering conditions, vehicle control is difficult to ensure stability and safety. Therefore, this paper proposes a hybrid model and data-driven control method. Based on the vehicle state data and road information data provided by vehicle sensors, the method constructs a deep neural network based on LSTM and Attention, which is used as a compensator to solve the performance degradation of the LQR controller due to modeling errors.