Search Results

Image corruptions due to noise, blur, contrast change, etc., could lead to a significant performance decline of Deep Neural Networks (DNN), which poses a potential threat to DNN-based autonomous vehicles. Previous works attempted to explain corruption from a Fourier perspective. By comparing the absolute Fourier spectrum difference between corrupted images and clean images in the RGB color space, they regard the noise from some corruptions (Gaussian noise, defocus blur, etc.) as concentrating on the high-frequency components while others (contrast, fog, etc.) concentrate on the low-frequency components. In this work, we present a new perspective that unifies corruptions as noise from high frequency and thus propose an image augmentation algorithm to achieve a more robust performance against common corruptions. First, we notice the 1/fα statistical rule of the natural image's spectrum and the channels-wise differential sensitivity on the YCbCr color space of the Human Visual System.

Driver behaviors provide abundant information and feedback for future Advanced Driver Assistance Systems (ADAS). Driver’s eye and head may present some typical movement patterns before executing driving maneuvers. It is possible to use driver’s head and eye movement information for predicting driver intention. Therefore, to determine the most important features related to driver intention has attracted widespread research interests. In this paper, a method to analyze the correlation between driver’s visual features and driver intention is proposed, aiming to determine the most representative features for driver intention prediction. Firstly, naturalistic driving experiment is conducted to collect driver’s videos during executing lane keeping and lane change maneuvers. Then, driver’s head and face visual features are extracted from those videos. By using boxplot and independent samples T-test, features which have significant correlation with driver intention are found.

Safety is the cornerstone for Advanced Driver Assistance Systems (ADAS) and Autonomous Driving Systems (ADS). To assess the safety of a traffic situation, it is essential to predict motion states of traffic participants in the future with mathematic models. Accurate vehicle trajectory prediction is an important prerequisite for reasonable traffic situation risk assessment and appropriate decision making. Vehicle trajectory prediction methods can be generally divided into motion model based methods and maneuver model based methods. Vehicle trajectory prediction based on motion models can be accurate and reliable only in the short term. While vehicle trajectory prediction based on maneuver models present more satisfactory performance in the long term, these maneuver models rely on machine learning methods. Abundant data should be collected to train the maneuver recognition model, which increases complexity and lowers real-time performance.

In order to realize driving safety in highway scenarios, autonomous vehicles need to predict and reason about the driving intentions and motion trajectories of surrounding target vehicles in the near feature. Essentially, trajectory prediction of target vehicles can be viewed as a typical time series generation problem, which predicts the future trajectory of the vehicle through analyzing the input of historical trajectory information or its control signals. In actual traffic scenarios, the movement between vehicles is a process of mutual game and cooperation, namely the future trajectory of a vehicle is not only related to its own historical trajectory, but also to surrounding vehicles motion. However, different surrounding traffic participants have different influence on the target vehicle, and the future motion of the vehicle is often affected by some specific surrounding traffic agents deeply.

Speech enhancement can extract clean speech from noise interference, enhancing its perceptual quality and intelligibility. This technology has significant applications in in-car intelligent voice interaction. However, the complex noise environment inside the vehicle, especially the human voice interference is very prominent, which brings great challenges to the vehicle speech interaction system. In this paper, we propose a speech enhancement method based on target speech features, which can better extract clean speech and improve the perceptual quality and intelligibility of enhanced speech in the environment of human noise interference. To this end, we propose a design method for the middle layer of the U-Net architecture based on Long Short-Term Memory (LSTM), which can automatically extract the target speech features that are highly distinguishable from the noise signal and human voice interference features in noisy speech, and realize the targeted extraction of clean speech.