Search Results

The research and development of data-driven highly automated driving system components such as trajectory prediction, motion planning, driving test scenario generation, and safety validation all require large amounts of naturalistic vehicle trajectory data. Therefore, a variety of data collection methods have emerged to meet the growing demand. Among these, camera-equipped drones are gaining more and more attention because of their obvious advantages. Specifically, compared to others, drones have a wider field of bird's eye view, which is less likely to be blocked, and they could collect more complete and natural vehicle trajectory data. Besides, they are not easily observed by traffic participants and ensure that the human driver behavior data collected is realistic and natural. In this paper, we present a complete vehicle trajectory data extraction framework based on aerial videos. It consists of three parts: 1) objects detection, 2) data association, and 3) data cleaning.

Harmony-with-traffic refers to the ability of autonomous vehicles to maximize the driving benefits such as comfort, efficiency, and energy consumption of themselves and the surrounding traffic during interactive driving under traffic rules. In the test of harmony-with-traffic, one or more background vehicles that can respond to the driving behavior of the vehicle under test are required. For this purpose, the functional requirements of car-following model for harmony-with-traffic evaluation are analyzed from the dimensions of test conditions, constraints, steady state and dynamic response. Based on them, an interactive car-following model (ICFM) is developed. In this model, the concept of equivalent distance is proposed to transfer lateral influence to longitudinal. The calculation methods of expected speed are designed according to the different car-following modes divided by interaction object, reaction distance and equivalent distance.

Driver behaviors provide abundant information and feedback for future Advanced Driver Assistance Systems (ADAS). Driver’s eye and head may present some typical movement patterns before executing driving maneuvers. It is possible to use driver’s head and eye movement information for predicting driver intention. Therefore, to determine the most important features related to driver intention has attracted widespread research interests. In this paper, a method to analyze the correlation between driver’s visual features and driver intention is proposed, aiming to determine the most representative features for driver intention prediction. Firstly, naturalistic driving experiment is conducted to collect driver’s videos during executing lane keeping and lane change maneuvers. Then, driver’s head and face visual features are extracted from those videos. By using boxplot and independent samples T-test, features which have significant correlation with driver intention are found.

For the personification of automotive vehicle function performance under common traffic scenarios, analysis of human driver behavior is necessary. Based on China Field Operational Test (China-FOT) database of China Natural Driving Study project, this paper studies the driver's response in the common cut-in scenario. A total of 266 cut-in cases are selected by manual interception of driving recorder video. The relevant traffic environment characteristics are also extracted from video, including light conditions, road conditions, scale and lateral position of cut-in vehicle, etc. Dynamic information is decoded form CAN, such as speed, acceleration and so on. Then image processing results, such as relative speed and distance of cut-in and subject vehicles, are calculated. Statistical results based on above information show the response type and distribution of human driver: the behavior of keeping lane is 96.24%, in which the ratio of braking response is 51.13%.

Cut-in scenario is common in traffic and has potential collision risk. Human driver can detect other vehicle’s cut-in intention and take appropriate maneuvers to reduce collision risk. However, autonomous driving systems don’t have as good performance as human driver. Hence a deeper understanding on driving behavior is necessary. How to make decisions like human driver is an important problem for automated vehicles. In this paper, a method is proposed to classify the dangerous cut-in situations and normal ones. Dangerous cases were extracted automatically from naturalistic driving database using specific detection criteria. Among those cases, 70 valid dangerous cut-in cases were selected manually. The largest deceleration of subject vehicle is over 4 m/s2. Besides, 249 normal cut-in cases were extracted by going through video data of 2000km traveled distance. In normal driving cases, subject vehicle may brake or keep accelerating and the largest deceleration was less than 3 m/s2.

In China there are many mixed driving roads which cause a lot of safety problems between vehicles and pedalcyclists. Research on driver behavior under risk scenarios with pedalcyclist is relatively few. In this paper driver brake parameters under naturalistic driving are studied and pedalcyclists include bicyclist, tricyclist, electric bicyclist and motorcyclist. Brake reaction time and maximum brake jerk are used to evaluate driver brake reaction speed. Average deceleration is used to evaluate the effect of driver brake operation. Maximum deceleration is used to evaluate driver braking ability. Driver behaviors collected in China are classified and risk scenarios with pedalcyclist are obtained. Driver brake parameters are extracted and statistical characteristics of driver brake parameters are obtained. Influence factors are analyzed with univariate ANOVA and regression analysis.

In the recent years, the interaction between human driver and Advanced Driver Assistance System (ADAS) has gradually aroused people’s concern. As a result, the concept of personalized ADAS is being put forward. As an important system of ADAS, Lane Keeping Assistance System (LKAS) also attracts great attention. To achieve personalized LKAS, driver lane keeping characteristic (DLKC) indices which could distinguish different driver lane keeping behavior should be researched. However, there are few researches on DLKC indices for personalized LKAS. Although there are many researches on modeling driver steering behavior, these researches are not sufficient to obtain DLKC indices. One reason is that most of researches are for double lane change behavior which is different from driver lane keeping behavior. The other reason is that the researches on driver lane keeping behavior only provide model structure and rarely discuss identification procedure such as how to select suitable data.

Tracking vehicle trajectories is essential for autonomous vehicles and advanced driver-assistance systems to understand traffic environment and evaluate collision risk. In order to reduce the position deviation and fluctuation of tracking on-road vehicle by millimeter-wave radar (MMWR), an interactive multi-model Kalman filter (IMM-KF) tracking algorithm including data association and track management is proposed. In general, it is difficult to model the target vehicle accurately due to lack of vehicle kinematics parameters, like wheel base, uncertainty of driving behavior and limitation of sensor’s field of view. To handle the uncertainty problem, an interacting multiple model (IMM) approach using Kalman filters is employed to estimate multitarget’s states. Then the compensation of radar ego motion is achieved, since the original measurement is under the radar polar coordinate system.

Cut-in scenarios are common and of potential risk in China but Advanced Driver Assistant System (ADAS) doesn’t work well under such scenarios. In order to improve the acceptance of ADAS, its reactions to Cut-in scenarios should meet driver’s driving habits and expectancy. Brake is considered as an express of risk and brake tendency in normal Cut-in situations needs more investigation. Under critical Cut-in scenarios, driver tends to brake hard to eliminate collision risk when cutting in vehicle right crossing lane. However, under less critical Cut-in scenarios, namely normal Cut-in scenarios, driver brakes in some cases and takes no brake maneuver in others. The time when driver initiated to brake was defined as key time. If driver had no brake maneuver, the time when cutting-in vehicle right crossed lane was defined as key time. This paper focuses on driver’s brake tendency at key time under normal Cut-in situations.

The driver monitoring system (DMS) plays an essential role in reducing traffic accidents caused by human errors due to driver distraction and fatigue. The vision-based DMS has been the most widely used because of its advantages of non-contact and high recognition accuracy. However, the traditional RGB camera-based DMS has poor recognition accuracy under complex lighting conditions, while the IR-based DMS has a high cost. In order to improve the recognition accuracy of conventional RGB camera-based DMS under complicated illumination conditions, this paper proposes a lightweight low-illumination image enhancement network inspired by the Retinex theory. The lightweight aspect of the network structure is realized by introducing a pixel-wise adjustment function. In addition, the optimization bottleneck problem is solved by introducing the shortcut mechanism.

Motivated by applying artificial intelligence technology to the automobile industry, reinforcement learning is becoming more and more popular in the community of intelligent driving research. The reward function is one of the critical factors which affecting reinforcement learning. Its design principle is highly dependent on the features of the agent. The agent studied in this paper can do perception, decision-making, and motion-control, which aims to be the assistant or substitute for human driving in the latest future. Therefore, this paper analyzes the characteristics of excellent human driving behavior based on the six-layer model of driving scenarios and constructs it into a human knowledge graph. Furthermore, for highway pilot driving, the expert demo data is created, and the reward function is self-learned via inverse reinforcement learning. The reward function design method proposed in this paper has been verified in the Unity ML-Agent environment.